US 2021/0064516 A1Published application

Performance test using third-party hardware devices

AssigneesAtlassian Pty Ltd., Atlassian Inc.

InventorNancy GOMEZ

Life of this patent

Estimating the term…

Loading patent…

Abstract

Computer-implemented techniques are provided for in-device real time application program performance feature testing by test devices of an independent test device system of a performance test system. The performance test system includes an access control program that limits access to certain performance data that is automatically generated by the test devices, at test. A client device communicatively coupled to the performance test system via an internetwork installs program instructions of a performance test that may be iteratively executed to test an application program under test (APUT) in a test device. Different test conditions adapted to different performance feature testing identifying result data that is processed to determine the performance feature being tested. A test result is determined based on each performance test iteration and the test result, in addition to other test data is displayed on a user interface.

Claims18

Dependent claims

A computer-implemented method comprising:

using a client device that is coupled via one or more internetworks to a performance test system with an independent test device system comprising a plurality of different test devices, initiating a performance test, the performance test system comprising an access control program that limits access to certain performance data that is automatically generated by the test devices during or after the tests;
installing program instructions of a performance test with an application program under test (APUT) in a test device among the plurality of different test devices by calling the access control program;
performing the performance test on the APUT while the APUT is hosted by the test device by executing the program instructions of the performance test during execution of the APUT, the performance test of the APUT comprising:
causing performing one or more performance test iterations of the performance test by:
for each performance test iteration,
monitoring execution of APUT program instructions of the APUT on the test device for a first test condition;
in response to the execution of APUT program instructions meeting the first test condition, starting measuring the performance test metric at a start time;
monitoring the execution of APUT program instructions of the APUT for a second test condition, wherein the first test condition is met before the second test condition can be met;
in response to the execution of APUT program instructions meeting the second test condition, stopping measuring the performance test metric at a stop time;
determining a measured performance test metric based on a difference between the start time and the stop time;
in response to completion of the performance test iterations, determining a test result based on the measured performance test metric of at least some of the performance test iterations and electronically providing the test result for access by the client device;
and
wherein the computer-implemented method is performed by one or more computing devices.

10 more elements

A computer system comprising:

a processor;
a communication interface;
and
a non-transitory computer-readable storage medium storing sequences of instructions, which when executed by the processor, cause the processor to implement a method comprising:
using a client device that is coupled via one or more internetworks to a performance test system with an independent test device system comprising a plurality of different test devices, initiating a performance test, the performance test system comprising an access control program that limits access to certain performance data that is automatically generated by the test devices during or after the tests;
installing program instructions of a performance test with an application program under test (APUT) in a test device among the plurality of different test devices by calling the access control program;
performing a performance test on the APUT while the APUT is hosted by the test device by executing the program instructions of the performance test during execution of the application program, the performance test of the APUT comprising:
causing performing one or more performance test iterations of the performance test by:
for each performance test iteration,
monitoring execution of APUT program instructions of the APUT on the test device for a first test condition;
in response to the execution of APUT program instructions meeting the first test condition, starting measuring the performance test metric at a start time;
monitoring the execution of APUT program instructions of the APUT for a second test condition, wherein the first test condition is met before the second test condition can be met;
in response to the execution of APUT program instructions meeting the second test condition, stopping measuring the performance test metric at a stop time;
determining a measured performance test metric based on a difference between the start time and the stop time;
in response to completion of the performance test iterations, determining a test result based on the measured performance test metric of at least some of the performance test iterations and electronically providing the test result for access by a client device;
and
wherein the computer-implemented method is performed by one or more computing devices.

14 more elements

Dependencies are inferred from the claim text.