Test script evaluation system and method
AssigneeAccenture Global Services Limited
InventorsRavikumar Balakrishnan, Rajesh Chengalpathy, S. Yogeswaran
Life of this patent
Estimating the term…
Abstract
A method and a computer system include a protocol evaluation engine that evaluates a test script. The method includes receiving a test script and requirements, developing a set of protocol evaluators, evaluating the test script by comparing the protocol evaluators with the test script, determining a final score for the evaluator for the test script and generating a group score for a plurality of test scripts for identifying a tester for the test script based on the group score. The computer system includes a process and memory and processor executable instructions to carry out the above method.
Claims16
A method for evaluating one or more test scripts used testing aspects target system, comprising:
- receiving, via a communications interface, a test script and a plurality of requirements for the test script wherein the plurality of requirements facilitate evaluation of the test script and are in pre-determined format;
- developing a set of protocol evaluators based on the plurality of requirements, wherein the set of protocol evaluators comprises a business requirements evaluator, a validation language requirements evaluator, a template evaluator, a completeness evaluator, and a descriptiveness evaluator, wherein each protocol evaluator of the set of protocol evaluators contains one or more factors;
- storing the developed set of protocol evaluators in a computer readable memory;
- executing each protocol evaluator with a protocol evaluation engine, wherein:
- execution of the business requirements evaluator controls the protocol evaluator to determine whether the test script tests specified business requirements,
- execution of the language requirements evaluator controls the protocol evaluator to determine whether the test script is written in a specified language,
- execution of the template evaluator controls the protocol evaluator to determine whether the test script is prepared using a specified template,
- execution of the completeness evaluator controls the protocol evaluator to determine whether the test script meets completeness requirements, and
- execution of the descriptiveness evaluator controls the protocol evaluator to determine whether the test script meets descriptiveness requirements,
- wherein execution of each protocol evaluator with the protocol evaluation engine the further comprises
- assigning an initial score to the test script;
- for each protocol evaluator:
- comparing the one or more factors of the protocol evaluator with the test script to thereby determine whether the test script deviates with at least one of the one or more factors of the protocol evaluator, and in response assigning a deviation thereto;
- determining a deductible points for each deviation according to a pre-determined rule up to a maximum deductible points;
- subtracting the deductible points from the initial score for the test script to thereby obtain a final score;
- and
- generating a group score for a plurality of test scripts based on a pre-determined category and the final score of the plurality of test scripts for identifying a tester for the test script based on the group score.
A computer system, comprising:
- a processor coupled with a communications interface and a non-transitory computer readable medium storing processor executable instructions comprising a protocol evaluation engine that evaluates one or more test scripts configured to cause the processor to:
- receive a test script and a plurality of requirements for the test script via the communications interface, wherein the plurality of requirements facilitate evaluation of the test script and are in pre-determined format;
- develop a set of protocol evaluators based on the plurality of requirements evaluator wherein the set of protocol evaluators comprises a business requirements, a validation language requirements evaluator, a template evaluator, a completeness evaluator and a descriptiveness evaluator, wherein each protocol evaluator contains one or more factors;
- store the developed set of protocol evaluators in a computer readable memory;
- execute each protocol evaluator with a protocol evaluation engine, wherein:
- execution of the business requirements evaluator controls the protocol evaluator to determine whether the test script tests specified business requirements,
- execution of the language requirements evaluator controls the protocol evaluator to determine whether the test script is written in a specified language,
- execution of the template evaluator controls the protocol evaluator to determine whether the test script is prepared using a specified template,
- execution of the completeness evaluator controls the protocol evaluator to determine whether the test script meets completeness requirements, and
- execution of the descriptiveness evaluator controls the protocol evaluator to determine whether the test script meets descriptiveness requirements,
- wherein execution of each protocol evaluator with the protocol evaluation engine the further comprises:
- assigning an initial score to the test script;
- for each protocol evaluator:
- comparing the one or more factors of the protocol evaluators with the test script, and determining whether the test script deviates with at least one of the one or more factors, and in response assigning a deviation thereto;
- determining a deductible points for each deviation according to a pre-determined rule up to a maximum deductible points, and determining a final score for the evaluator for the test script by subtracting the deductible points from the initial score for the test script to obtain the final score;
- and
- generate a group score for a plurality of test scripts based on a pre- determined category and the final score of the plurality of test scripts for identifying a tester for the test script based on the group score.
Dependencies are inferred from the claim text.