System for automatic testing of computer software having output synchronization and capable of responding to asynchronous events

A system for automatic testing of computer software comprising:

• interface means communicating with a system under test loaded with software to be tested;
• memory means for storing inputs to the system under test and expected outputs of the system under test in response to said inputs;
• testing means, operative during a replay session, for supplying said inputs to and for receiving actual outputs, in response to said inputs, from said system under test;
• and
• comparison means for determining differences between said expected outputs and actual outputs,
• wherein said testing means comprises means for identifying, from output of said comparison means, when a predefined asynchronous event has occurred and for responding to it in a predefined manner.

A method for automatic testing of computer software including the steps of:

• communicating via interface means with a system under test loaded with software to be tested;
• storing inputs to the system under test and expected outputs of the system under test in response to said inputs;
• matching the flow of inputs to the system under test in accordance with the varying speed at which the system under test currently operates comprising the steps of:
• during a replay session, supplying said inputs to and receiving actual outputs, in response to said inputs, from said system under test;
• and
• producing comparison outputs which indicate differences between said expected outputs and actual outputs,
• wherein said step of supplying comprises the step of, when a next input is one of a set of user-defined hot-keys, releasing said next input to said system under test either when the comparison output indicates that a current actual output matches the expected output associated with said next input or when a timeout period has ended.

A method for automatic testing of computer software including the steps of:

• communicating via interface means with a system under test loaded with software to be tested;
• storing inputs to the system under test and expected outputs of the system under test in response to said inputs;
• during a replay session, supplying said inputs to and receiving actual outputs, in response to said inputs, from said system under test;
• and
• determining differences between the expected outputs and actual outputs,
• wherein said step of supplying includes the step of identifying, from output of said step of indicating, when a predefined asynchronous event has occurred and for responding to it in a predefined manner.

A system for automatic testing of computer software comprising:

• interface means communicating with a system under test loaded with software
• memory means for storing inputs to the system under test and expected outputs from the system under test in response to said inputs, wherein said expected outputs also include user-defined synchronizing screen objects;
• synchronizing means for matching the flow of inputs to the system under test in accordance with the varying speed at which the system under test currently operates comprising:
• testing means, operative during a replay session, for supplying said inputs to and for receiving actual outputs, in response to said inputs, from said system under test;
• and
• comparison means for determining differences between said expected outputs and actual outputs,
• wherein said testing means comprises:
• second synchronizing means for, when a next input is one of a set of user defined hot-keys, releasing said next input to said system under test either when the comparison output indicates that a current actual output matches a user-defined synchronization output associated with said next input or when a timeout period has ended.