Friday, May 17, 2013

How to narrow down focus areas for test process improvement?

Once organization is convinced there is scope for them to increase effectiveness and efficiency of testing, then the next challenge is to find where to start the improvement. In my view one should look at THREE different perspective to see opportunity for improvement:
1. Process (the way testing is done)
2. People (who do testing at different levels)
3. Technology and tools (efficiency and accuracy agents used during testing activities) 

Process perspective:

It is important to look at what we have agreed as process of starting and ending testing in the organization. What are the standard deliverable to demonstrate the process defined is followed. The business scenario always demand light process so that time to accomplish the task is exactly what one can budget in the given scenario. How to know which part of the process needs a new way of doing ? There are SIX attributes I recommend to measure where the process needs fine-tuning.

Effectiveness - Here goal clarity for doing any assigned work is the key. If what is expected at the end of any assigned task is very clear there should be very less rework
Consistent - Common terminologies, common templates, repeatable across projects, reuse focus good
Efficient - Ability to do as per budgeted time/effort, do with less cost, start taking less time than previous cycle
Salable - Adaptable to any growing demand, increased people, more variety of projects
Visible - Clear mirror to see how we look at any stage from all perspective of project end-date, quality, cost
Agile - Achieved all goals for short cycles always

People perspective:

Here again it is important to set expectation for roles as clearly as possible. The competency is more looked as skills than how many times or years he/she had done that task. Here I strongly recommend methodology based testing. Look at HBT (Hypothesis Based Testing by STAG) personal test methodology so that whoever does testing activity are guided by well defined goals at any levels of  testing. 

http://slidesha.re/HBT-Solution-2of6


Technology and Tools perspective: 

Here the technology and tools must be looked as agent for efficiency. Any work which can be done with accuracy, with less time and less effort through tools and technology must be inducted. The common tools we see are defect tracking tool, functional test automation tools, load testing tools. But we have landscape of other tools which may accelerate unit testing, test data creation, reporting and management tools. How are we penetrating these tools keeping ROI (Return On Investment) in focus is the challenge.




Software Quality Management via Test Process Improvement

Ever since the software engineering discipline was born, there is lot of investment to address software quality related issues. The software quality is becoming a continuously challenging as complexity of software and the software solution users expectations are going up significantly. People looked at solution for software quality issue by addressing the software development process looking at standard for process improvements like ISO 9001 and CMMI. The TMMi framework has been developed by the TMMi Foundation as a guideline and reference framework for test process improvement and is positioned as a complimentary model to the CMMI version 1.2 addressing those issues important to test engineering community.

From my experience many projects will budget 30-40% of total cost of project to testing but we always land up in spending more in many cases due to late stage detection of defects or insufficient testing leading to defect escape to field and so on. It is important to look at controlling this software testing budget overflow by focusing on "Effectiveness and Efficiency" factor for all testing efforts in the entire software development life cycle.

I feel by looking at TMMi framework one can find the gaps in people competency to perform a specific role, process over heads in end-to-end software development life cycle, and gaps in usage of right set of tools  which helps to increase efficiency, accuracy and sufficiency factor of testing in this business driven challenging situations. Thought will share the practical application of process driven approach to increase effectiveness and efficiency of testing using TMMi in series of postings. 

Is there a crude way to know where we are currently in test process maturity in your organization? Take a look at these slides.  
http://slidesha. re/MCN-Quick-TP-Assess

TMMi is a registered trademark of TMMi Foundation.
TMMi Foundations makes no warranties of any kind who prefer to use this framework for test process improvement

Appreciate readers views and comments.