# US 12,222,843 B2 · AI bug-fix positioning by LSTM > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,222,843 B2 - Document ID: US12222843B2 - Status: Granted - Kind: B2 - Application number: 18/095,035 - Filed: 2023-01-10 - Published: 2023-07-13 - Granted: 2025-02-11 - Earliest claimed: 2022-01-13 - Assignees: Dell Products L.P. - Applicants: Dell Products L.P. - Inventors: Jiacheng Ni; Spenser Sheng; Kay Shan; Stefanie Menghuan Chen - Web page: https://patentgrep.com/patent/US12222843B2 ## CPC - G06F 11/3698: Environments for analysis, debugging or testing of software - G06F 11/3688: {for test execution, e.g. scheduling of test suites} - G06N 3/0442: characterised by memory or gating, e.g. long short-term memory [LSTM] or gated recurrent units [GRU] - G06N 3/09: Supervised learning - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS ## Abstract Methods, system, and non-transitory processor-readable storage medium for bug fix system are provided herein. An example method includes executing at least one test on a system using an automated test tool. The bug fix system predicts at least one characteristic of a test related failure that occurred during the execution using test data produced by the automated test tool. The bug fix system predicts at least one source of the test related failure using the test data produced by the automated test tool. ## Claims ### Claim 1 A method comprising: executing at least one test on a system using an automated test tool; receiving, by a system environment machine learning system, from the automated test tool, a result associated with the executing the at least one test; in response to the receiving, invoking, by a bug fix system, a product or test machine learning system, wherein the product or test machine learning system classifies the result; in response to the classification, invoking, by the bug fix system, at least one of a test script machine learning system and a remedy machine learning system; in response to the invoking the at least one of the test script machine learning system and the remedy machine learning system, predicting, by the bug fix system, at least one characteristic of a test related failure that occurred during the execution using test data produced by the automated test tool; and predicting, by the bug fix system, at least one source of the test related failure using the test data produced by the automated test tool, wherein the method is performed by at least one processing device comprising a processor coupled to a memory. ### Claim 2 (depends on 1) The method of claim 1 wherein the predicting, by the bug fix system, the at least one characteristic of the test related failure comprises: determining, by the system environment machine learning system, that the test related failure is not caused by an environmental factor; and providing, by the bug fix system, the test related failure to the product/test product or test machine learning system. ### Claim 3 (depends on 1) The method of claim 1 wherein the predicting, by the bug fix system, the at least one characteristic of the test related failure comprises: determining, by the product or test machine learning system, that the test related failure is caused by product code; and providing, by the bug fix system, the test related failure to the remedy machine learning system. ### Claim 4 (depends on 1) The method of claim 1 wherein the predicting, by the bug fix system, the at least one characteristic of the test related failure comprises: determining, by the remedy machine learning system, that the test related failure should be fixed; and providing, by the bug fix system, the test related failure to a source code machine learning system. ### Claim 5 (depends on 1) The method of claim 1 wherein the predicting, by the bug fix system, the at least one characteristic of the test related failure comprises: determining, by the product or test machine learning system, that the test related failure is caused by test code; and providing, by the bug fix system, the test related failure to the test script machine learning system. ### Claim 6 (depends on 1) The method of claim 1 wherein the predicting, by the bug fix system, the at least one source of the test related failure comprises: predicting, by the test script machine learning system, a location in a test script that caused the test related failure. ### Claim 7 (depends on 1) The method of claim 1 wherein the predicting, by the bug fix system, the at least one source of the test related failure comprises: predicting, by a source code machine learning system, a location in a source code that caused the test related failure. ### Claim 8 (depends on 1) The method of claim 1 wherein the system environment machine learning system is trained on the test data produced by the automated test tool to predict whether the test related failure is caused by an environmental factor or the system. ### Claim 9 (depends on 1) The method of claim 1 wherein the product or test machine learning system is trained on the test data produced by the automated test tool to predict whether the test related failure is caused by product code or test code. ### Claim 10 (depends on 1) The method of claim 1 wherein the remedy machine learning system is trained on the test data produced by the automated test tool to predict whether to remedy the test related failure. ### Claim 11 (depends on 1) The method of claim 1 wherein the test script machine learning system is trained on the test data produced by the automated test tool to predict a test script that caused the test related failure. ### Claim 12 (depends on 1) The method of claim 1 wherein a source code machine learning system is trained on the test data produced by the automated test tool to predict a location in a source code that caused the test related failure. ### Claim 13 (depends on 1) The method of claim 1 wherein the at least one source of the test related failure is a location in source code that caused the test related failure. ### Claim 14 (depends on 1) The method of claim 1 wherein the at least one source of the test related failure is a location in a test script that caused the test related failure. ### Claim 15 (depends on 1) The method of claim 1 wherein the predicting, by the bug fix system, the at least one characteristic of the test related failure and the predicting, by the bug fix system, the at least one source of the test related failure is performed by at least one long short-term memory neural network. ### Claim 16 (depends on 1) The method of claim 1 wherein the test data produced by the automated test tool comprises at least one of standard output, standard error, and stack trace. ### Claim 17 A system comprising: at least one processing device comprising a processor coupled to a memory; the at least one processing device being configured: to execute at least one test on a system using an automated test tool; to receive, by a system environment machine learning system, from the automated test tool, a result associated with the executing the at least one test; in response to the receiving, to invoke, by a bug fix system, a product or test machine learning system, wherein the product or test machine learning system classifies the result; in response to the classification, to invoke, by the bug fix system, at least one of a test script machine learning system and a remedy machine learning system; in response to the invoking the at least one of the test script machine learning system and the remedy machine learning system, to predict, by the bug fix system, at least one characteristic of a test related failure that occurred during the execution using test data produced by the automated test tool; and to predict, by the bug fix system, at least one source of the test related failure using the test data produced by the automated test tool. ### Claim 18 (depends on 17) The system of claim 17 wherein the predicting, by the bug fix system, the at least one characteristic of the test related failure and the predicting, by the bug fix system, the at least one source of the test related failure is performed by at least one long short-term memory neural network. ### Claim 19 (depends on 17) The system of claim 17 wherein the system configured to predict, by the bug fix system, the at least one characteristic of the test related failure is further configured to: determine, by the product or test machine learning system, that the test related failure is caused by product code; provide, by the bug fix system, the test related failure to the remedy machine learning system; determine, by the remedy machine learning system, that the test related failure should be fixed; provide, by the bug fix system, the test related failure to a source code machine learning system; and wherein the system configured to predict, by the bug fix system, the at least one source of the test related failure is further configured to: predict, by the source code machine learning system, a location in source code that caused the test related failure. ### Claim 20 A computer program product comprising a non-transitory processor-readable storage medium having stored therein program code of one or more software programs, wherein the program code when executed by at least one processing device causes said at least one processing device: to execute at least one test on a system using an automated test tool; to receive, by a system environment machine learning system, from the automated test tool, a result associated with the executing the at least one test; in response to the receiving, to invoke, by a bug fix system, a product or test machine learning system, wherein the product or test machine learning system classifies the result; in response to the classification, to invoke, by the bug fix system, at least one of a test script machine learning system and a remedy machine learning system; in response to the invoking the at least one of the test script machine learning system and the remedy machine learning system, to predict, by the bug fix system, at least one characteristic of a test related failure that occurred during the execution using test data produced by the automated test tool; and to predict, by the bug fix system, at least one source of the test related failure using the test data produced by the automated test tool.