User extensible testing system

In a window-based computer system comprising a central processing unit (CPU), memory, input/output devices comprising a keyboard, mouse and display, wherein the input and output of information is performed through windows defined on the display, a user extensible, automated testing system generating test results for the testing of application programs which compares master data to actual data generated during the testing of the application program, said test results comprising the differences between the master data and actual data, said user extensible, automated testing system comprising:

• journaling means coupled to said window system for generating and replaying a journal file comprising a list of events representative of user actions performed during a user session which, when replayed, cause the application program to be executed in a predetermined manner which tests the application program;
• filter means for eliminating portions of data which are not determinative of the test results, said filter means accepting data generated from the testing of the application programs, said filter means comprising;
• filter functions which, when executed, filter portions of data, each filter function identified by name;
• a filter list file, comprising a list of names of at least one filter function to filter portions of data, said filter list file referenced to determine available filter functions;
• filter execution means coupled to the filter list file and the central processing unit such that the filter functions are executed by the central processing unit to filter portions of data according to the filter functions listed in the filter list file;
• and
• filter modification means coupled to the filter list file, filter functions and to the input/output devices through the window system, the filter modification means modifying the filter list file such that filter functions can be added, deleted or changed;
• save data means to save data generated during the testing of the application program, said save data means being coupled to the window system and to the filter means such that data output from said filter means is input to said save data means, said save data means comprising;
• save data functions, which, when executed, save predetermined portions of the data, each save data function identified by a name;
• save data execution means coupled to said save data functions and the central processing unit such that said save data functions are executed by the central processing unit to save predetermined portions of the data according to specified save data functions, said save data execution means enabled by a plurality of events placed in the journal file representative of user actions which selects the save data function;
• and
• save data modification means coupled to the save data functions and to the input/output devices through the window system so as to modify the save data functions such that save data functions can be added, deleted or changed;
• comparison means for comparing predetermined portions of data from the master data to corresponding portions of data from the actual data, said comparison means being coupled to the save data means such that portions of data saved by the save data functions are input to the comparison means, said comparison means comprising;
• comparison functions, each identified by name, which, when executed, compare predetermined portions of the master data with corresponding predetermined portions of the actual data, determine the differences between the predetermined portions of the master data and actual data, and cause a failure file to be generated containing the actual data saved which have differences as determined by the comparison function;
• comparison execution means coupled to the comparison functions and the central processing unit so as to compare predetermined portions of the master data and actual data according to the comparison functions, said comparison execution means enabled after execution of save data is completed;
• comparison modification means to modify the comparison functions, said comparison modification means coupling the comparison functions to the input/output devices through the window system such that comparison functions can be added, deleted or changed;
• wherein the testing system is extensible by modification of the filter functions, save data functions, comparison functions.