Back to results
US 11,768,751 B2Granted
Software performance testing
OwnerDennis Lininventor
Life of this patent
Estimating the term…
Abstract
Systems and methods for performance testing software using computer vision. Systems can include a performance testing computer vision system and a computer vision-based performance testbed system. Methods can include generating a computer vision-based testing package and performance testing software in one or more testing environments on at least one virtualized testbed machine according to testing constraints using the computer vision-based testing package.
Claims20
A method comprising:
- presenting to a user through a client device a graphical representation of an output of executing software;
- capturing at least one image of the user interacting with the graphical representation of the output of the executing software;
- applying computer vision to the at least one image to identify graphical elements in the graphical representation of the output of the executing software;
- applying computer vision to the at least one image to identify user interactions with the graphical elements in the graphical representation of the output of the executing software based on the graphical elements identified in the graphical representation of the output of the executing software;
- receiving user input indicating testing constraints for performance testing the software;
- generating a script package based on the user interactions with the graphical elements in the graphical representation of the output of the executing software and the testing constraints;
- forming one or more testing environments on one or more virtualized testbed machines according to the testing constraints;
- performance testing the software in the one or more testing environments according to the testing constraints using the script package;
- conducting performance testing analysis by applying computer vision to output generated by the script package, the performance testing analysis detecting any of a frequency in which the graphical elements change and a degree to which the graphical elements change;
- and
- generating performance testing results based on any of the detected frequency in which the graphical elements change and the degree to which the graphical elements change.
8 more elements
A system comprising:
- a client device configured to present to a user a graphical representation of an output of executing software;
- an event capture engine configured to capture at least one image of the user interacting with the graphical representation of the output of the executing software;
- a user interaction identification engine configured to:
- apply computer vision to the at least one image to identify graphical elements in the graphical representation of the output of the executing software;
- apply computer vision to the at least one image to identify user interactions with the graphical elements in the graphical representation of the output of the executing software based on the graphical elements identified in the graphical representation of the output of the executing software;
- a testing communication engine configured to receive user input indicating testing constraints for performance testing the software;
- a performance testing computer vision-based testing package generation engine configured to generate a script package based on the user interactions with the graphical elements in the graphical representation of the output of the executing software and the testing constraints;
- a testbed machine configuration engine configured to form one or more testing environments on one or more virtualized testbed machines according to the testing constraints;
- a testbed machine operation control engine configured to:
- performance test the software in the one or more testing environments according to the testing constraints using the script package;
- conduct performance testing analysis by applying computer vision to output generated by the script package, the performance testing analysis detecting any of a frequency in which the graphical elements change and a degree to which the graphical elements change;
- and
- generate performance testing results based on any of the detected frequency in which the graphical elements change and the degree to which the graphical elements change.
10 more elements
A system comprising:
- means for presenting to a user through a client device a graphical representation of an output of executing software;
- means for capturing at least one image of the user interacting with the graphical representation of the output of the executing software;
- means for applying computer vision to the at least one image to identify graphical elements in the graphical representation of the output of the executing software;
- means for applying computer vision to the at least one image to identify user interactions with the graphical elements in the graphical representation of the output of the executing software based on the graphical elements identified in the graphical representation of the output of the executing software;
- means for receiving user input indicating testing constraints for performance testing the software;
- means for generating a script package based on the user interactions with the graphical elements in the graphical representation of the output of the executing software and the testing constraints;
- means for forming one or more testing environments on one or more virtualized testbed machines according to the testing constraints;
- means for performance testing the software in the one or more testing environments according to the testing constraints using the script package;
- means for conducting performance testing analysis by applying computer vision to output generated by the script package, the performance testing analysis detecting any of a frequency in which the graphical elements change and a degree to which the graphical elements change;
- and
- means for generating performance testing results based on any of the detected frequency in which the graphical elements change and the degree to which the graphical elements change.
8 more elements
Dependencies are inferred from the claim text.