Monday, April 11, 2011

Test Efficiency Vs Test Effectiveness

I've seen that many test engineers are confused with the understanding of Software Test Efficiency and Software Test Effectiveness. Below is the summary of what I understand from Efficiency and Effectiveness.

Software Test Efficiency:

- It is internal in the organization how much resources were consumed how much of these resources were utilized.
- Software Test Efficiency is number of test cases executed divided by unit of time (generally per hour).
- Test Efficiency test the amount of code and testing resources required by a program to perform a particular function.

Here are some formulas to calculate Software Test Efficiency (for different factors):

Test efficiency = (total number of defects found in unit+integration+system) / (total number of defects found in unit+integration+system+User acceptance testing)

Testing Efficiency = (No. of defects Resolved / Total No. of Defects Submitted)* 100

Software Test Effectiveness:Software Test Effectiveness covers three aspects:

- How much the customer's requirements are satisfied by the system.
- How well the customer specifications are achieved by the system.
- How much effort is put in developing the system.

Software Test Effectivness judge the Effect of the test enviornment on the application.

Here are some formulas to calculate Software Test Effectiveness (for different factors):

- Test effectiveness = Number of defects found divided by number of test cases executed.

- Test effectiveness = (total number of defects injected +total number of defect found) / (total number of defect escaped)* 100

- Test Effectiveness = Loss due to problems / Total resources processed by the system

No comments: