QA Challenge #8: Test Automation; Is It Worth the Time and Effort?
Posted on Tue, Oct 04, 2011 @ 08:01 AM
Though a focus on test automation is growing in many organizations, I still see test automation continuing to be an ongoing challenge. I attribute this to several factors:
1) Some organizations don’t understand the benefits or value of automation.
2) Some understand the benefits of automation, but don’t understand how to translate that vision into a success story.
3) Some choose not to automate for fear it will take their jobs away.
Benefits of Test Automation
In some cases, automation may not be the best strategy. However, for processes that are repeatable, routine and time consuming, automation may be the way to go.
Think about:
- Those hundreds of test cases that you have to execute manually on each build
- Trying to recall those regression tests you executed last year that helped you discover a defect
- Manually entering test data to execute a test
- Creating the same test report from scratch for every build
Even though 100% automation may not be possible, a significant and, in some cases, even a small amount of automation can result in improved productivity, reduced cost and less stress. So the initial investment could result in long-term benefits for everyone.
How to Create a Test Automation Success Story
Even if you buy into the benefits of test automation, execution may still be a challenge. Choosing the right strategy is extremely important (see blog Comparing Different Automation Strategies). Once a strategy that suits your need is chosen, execution requires a disciplined approach and the right set of people with the right skills (it’s not true that anyone can automate, please don’t believe what the vendors say).
I would recommend doing a small proof of concept to test your strategy. Create a plan detailing what to automate, when to automate and how (each test could be automated differently; a strategy for each test is needed). If your automation investment is not resulting in any of the benefits mentioned above then revisit your strategy. In my experience, one should easily expect a return of 100% of more growing every year (see blog How Do You Measure ROI in QA).
Insecurity
Because I think many people fear that automation has the potential to take their jobs away, it would be unfair for me to not address this concern. Let’s first agree that when it comes to rule-based logic, calculation, sequential thinking, computers are simply better and faster. They don’t get tired and they don’t get stressed under pressures.
With that said, the role of test automation can only go so far. Software testers, however, can continue to grow exponentially. You can focus on gaining new skills and continuously challenge yourself to do things that computers can’t do faster or better. If you can innovate and improve your processes, and then roll them out to other areas in your organization and your industry, you need not feel threatened by test automation.