Method to verify correctness of computer system software and hardware components and corresponding test environment

A test environment to verify correctness of computer system software and hardware components by comparing a modified system software and/or hardware version with a verified system software and hardware version which is assumed to work correctly;

• comprising:
• an execution environment running a verified or modified system software version connected to a verified or modified hardware model or hardware system of said computer system comprising at least one chip;
• and
• monitoring means for monitoring communication between said execution environment and said hardware models or hardware systems;
• wherein said test environment generates a corresponding verified trace file by operating said execution environment connected to said verified hardware model or hardware system with said verified system software version and using said monitoring means to monitor and record each hardware access during operation of said execution environment with said verified system software version;
• wherein said test environment generates a corresponding new trace file by operating said execution environment connected to said modified hardware model with said verified system software version, or by operating said execution environment connected to said verified hardware model with said modified system software version, and using said monitoring means to monitor and record each hardware access during operation of said execution environment;
• wherein said test environment defines an arbitrary order for target chips in said verified and said modified hardware model or hardware system version, sorts sequences of entries in both trace files according to said target chip order, compares said sorted trace files by comparing their entries each by each, and outputs a corresponding comparison result.

A computer program product for verifying correctness of computer system software and hardware components, the computer program product comprising:

• a computer-readable storage medium readable by a processor and storing instructions for execution by the processor for performing a method comprising:
• verifying correctness of computer system software and hardware components by comparing a modified system software and/or hardware version of said computer with a verified system software and hardware version of said computer which is assumed to work correctly using a test environment, which comprises an execution environment running a verified or modified system software version connected to a verified or modified hardware model or hardware system version of said computer comprising at least one chip, the verifying including:
• operating said test environment with said verified system software and hardware version;
• monitoring and recording each hardware access during operation of said test environment with said verified system software and hardware version to generate a corresponding verified trace file;
• operating said test environment with said modified system software and/or hardware version;
• monitoring and recording each hardware access to generate a corresponding new trace file during operation of said test environment with said modified system software and/or hardware version;
• defining an arbitrary order for target chips in said verified and said modified hardware model or hardware system version;
• sorting sequences of entries in both trace files according to said target chip order;
• and
• comparing said sorted trace files by comparing their entries each by each and outputting a corresponding comparison result.