Identifying severity of test execution failures by analyzing test execution logs

A computer system for determining severity of execution test failures, the computer system comprising:

• one or more computer processors;
• one or more computer readable storage media;
• program instructions stored on the computer readable storage media for execution by at least one of the one or more computer processors, the program instructions comprising:
• program instructions to identifying, by one or more computer processors, a test report log for a regression test;
• program instructions to identify one or more errors in the identified test report log;
• program instructions to determine a severity category for the one or more identified errors in the identified test report log;
• program instructions to determine a severity category for the identified test report log wherein determining a severity category for the identified test report log comprises:
• program instructions to identify a previous test report log with similar errors to the identified one or more errors in the identified test report log;
• program instructions to assign a severity category assigned to the previous test report log to the identified test report log;
• program instructions to identify at least one preset error message that matches an error message included in the identified test report log and corresponds to a plurality of severity categories;
• and
• program instructions to determine a severity category from a plurality of severity categories that includes a most identical preset error message in relation to error messages in the identified test report log;
• wherein program instructions to determine a severity category for the identified test report log, further comprises:
• program instructions to determine a percentage completion that corresponds to the identified test report log based on the identified one or more errors;
• program instructions to assign a severity category, from a plurality of severity categories, to the identified test report log based on the determined percentage completion;
• program instructions to identify a number of user interfaces without proper accessibility;
• program instructions to assign a severity category, from a plurality of severity categories, to the identified test report log based on the determined identified number of user interfaces without proper accessibility;
• program instructions to identify one or more messages for trace and bug log files;
• program instructions to assign a severity category, from a plurality of severity categories, to the identified test report log based on the identified one or more messages for trace and bug log files;
• program instructions to determine a percentage completion that corresponds to the identified test report log based on the identified one or more errors;
• program instructions to identify a number of user interfaces without proper accessibility;
• and
• program instructions to assign a severity category, from a plurality of severity categories, to the identified test report log based on the determined percentage completion and the identified number of user interfaces without proper accessibility;
• and
• program instructions to determine a severity category for the identified test report log based on the determined severity category for the one or more identified errors in the identified test report log.