# US 2021/0200662 A1 · System and method to use past computer executable instructions to evaluate proposed computer executable instructions

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0200662 A1
- Document ID: US20210200662A1
- Status: Published application
- Kind: A1
- Application number: 16/731,499
- Filed: 2019-12-31
- Published: 2021-07-01
- Earliest claimed: 2019-12-31
- Assignees: Visa International Service Association
- Applicants: Visa International Service Association
- Inventors: Yue Li; Theodore Harris; Tatiana Korolevskaya
- Web page: https://patentgrep.com/patent/US20210200662A1

## CPC

- G06F 11/3616: {using software metrics}
- G06F 11/3644: {by instrumenting at runtime}
- G06F 11/3688: {for test execution, e.g. scheduling of test suites}
- G06F 21/562: {Static detection}
- G06F 21/563: {by source code analysis}
- G06N 3/09: Supervised learning
- G06N 20/00: Machine learning
- G06N 3/044: Recurrent networks, e.g. Hopfield networks
- G06N 3/088: Non-supervised learning, e.g. competitive learning
- G06N 5/01: Dynamic search techniques; Heuristics; Dynamic trees; Branch-and-bound
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS

## Abstract

Computer executable instructions including code sections are received and compared to previously analyzed computer executable instructions. The code sections are then analyzed and assigned a risk score. If the risk score is over a threshold, an alarm may be communicated or the system may substitute computer executable instructions that may have been created according to a standard or have been previously approved.

## Claims

### Claim 1

A method of analyzing computer executable instructions for risk comprising:
receiving computer executable instructions, wherein the computer executable instructions are yet to be executed;
determining a proposed risk factor for the computer executable instructions, wherein the determining the proposed risk factor comprises:
determining code level analyzable elements from the computer executable instructions, wherein the determining comprises reviewing a coding style of the computer executable instructions based on one or more of the following: comments in the computer executable instructions, libraries used by the computer executable instructions, indentation lines of codes of the computer executable instructions, uses of sub-routines of the computer executable instructions, existence of commands in the computer executable instructions, and lack of commands in the computer executable instructions;
recursively separating recognizable sections of the code level analyzable elements from unrecognizable sections;
executing a comparison of a first analyzable element to past analyzable elements stored in the memory that were previously scored as risk factors, wherein the comparison compares the coding style to coding styles stored in the memory;
based on the comparison, calculating a coding style similarity score as part of the proposed risk factor;
determining a threshold for the proposed risk factor according to at least one of the following: a government authority with grades of thresholds, and a past history of the proposed risk factor of the computer executable instructions; and
in response to the determined risk factor calculated for the first analyzable element being meeting over the determined threshold, undertaking a risk response,
wherein the risk response comprises one of the following: communicating a risk warning associated with the computer executable instructions, replacing the computer executable instructions identified as risk with a comparable computer executable instructions that have been determined to have an acceptable risk, or placing a hold on the computer executable instructions.

### Claim 2 (depends on 1)

The method of claim 1, wherein the first analyzable element and the proposed risk factor for the first analyzable element are added to the memory.

### Claim 3 (depends on 1)

The method of claim 1, further comprising:
executing a comparison for additional code level analyzable elements in the computer executable instructions to past code level analyzable elements stored in the memory that were previously scored as the risk factors;
based on the comparisons, calculating a total risk factor, wherein the total risk factor comprises the total of the risk factors for the additional code level analyzable elements; and
in response to the total risk factor calculated for the additional code level analyzable elements being over the threshold, executing a risk response.

### Claim 4 (depends on 3)

The method of claim 3, further comprising:
analyzing libraries used by the computer executable instructions;
determining a risk factor for the libraries;
calculating an updated total risk factor wherein the updated total risk factor comprises a total of the risk factors for the additional code level analyzable elements and the risk factor determined for the libraries; and
in response to the updated total risk factor being over the threshold, executing the risk response.

### Claim 5 (depends on 1)

The method of claim 1, wherein determining code level analyzable elements from the computer executable instructions comprises:
in response to the coding similarity score being over the threshold, classifying the computer executable instructions.

### Claim 6 (depends on 5)

The method of claim 5, wherein classifying the computer executable instructions comprises:
comparing the computer executable instructions to previously classified computer executable instructions;
determining a similarity value between the computer executable instructions and previously classified computer executable instructions;
ranking the similarity values;
in response to the similarity value for the previously classified computer executable instructions being over the threshold, classifying the computer executable instructions as the previously classified computer executable instructions.

### Claim 7 (depends on 1)

The method of claim 1, further comprising:
determining deviations in the computer executable instructions from model computer executable instructions;
communicating the deviations to a user;
allowing the user to select to modify the deviations to follow the model computer executable instructions; and
modifying the deviations in the computer executable instructions to follow the model computer executable instructions.

### Claim 8 (depends on 1)

The method of claim 1, further comprising:
determining deviations in the computer executable instructions from model computer executable instructions;
in response to the deviation being determined to be a threat;
communicating the deviations to a supervisor;
allowing the supervisor to select to modify the deviations to follow the model computer executable instructions; and
modifying the deviations in the computer executable instructions to follow the model computer executable instructions.

### Claim 9

A computer system comprising an input output circuit, a memory and a processor physically configured according to computer executable instructions, the computer executable instructions comprising instructions for:
receiving computer executable instructions, wherein the computer executable instructions are yet to be executed;
determining a risk factor for the computer executable instructions, wherein the determining the risk factor comprises:
determining code level analyzable elements from the computer executable instructions, wherein the determining comprises reviewing a coding style of the computer executable instructions based on one or more of the following: comments in the computer executable instructions, libraries used by the computer executable instructions, indentation lines of codes of the computer executable instructions, uses of sub-routines of the computer executable instructions, existence of commands in the computer executable instructions, and lack of commands in the computer executable instructions;
recursively separating recognizable sections of the code level analyzable elements from unrecognizable sections;
executing a comparison of a first analyzable element to past analyzable elements stored in the memory that were previously scored as risk factors, wherein the comparison compares the coding style to coding styles stored in the memory;
based on the comparison, calculating a coding style similarity score as part of the proposed risk factor;
determining a threshold for the risk factor according to at least one of the following: a government authority with grades of thresholds, and a past history of the risk factor of the computer executable instructions; and
in response to the determined risk factor calculated for the first analyzable element being meeting the determined threshold, undertaking a risk response,
wherein the risk response comprises one of the following: communicating a risk warning associated with the computer executable instructions, replacing the computer executable instructions identified as risk with a comparable computer executable instructions that have been determined to have an acceptable risk, or placing a hold on the computer executable instructions.

### Claim 10 (depends on 9)

The computer system of claim 9, wherein the first analyzable element and the risk factor for the first analyzable element are added to the memory.

### Claim 11 (depends on 9)

The computer system of claim 9, further comprising computer executable instructions for:
executing a comparison for additional code level analyzable elements in the computer executable instructions to past code level analyzable elements stored in the memory previously scored as risk factors;
based on the comparisons, calculating a total risk factor wherein the total risk factor comprises the total of the risk factors for the additional code level analyzable elements;
in response to the total risk factor calculated for the additional code level analyzable elements being over the threshold, undertaking the risk response.

### Claim 12 (depends on 9)

The computer system of claim 9, further comprising computer executable instructions for:
analyzing libraries used by the computer executable instructions;
determining a risk factor for the libraries;
calculating an updated total risk factor wherein the updated total risk factor comprises a total of the risk factors for the additional code level analyzable elements and the risk factor determined for the libraries; and
in response to the updated total risk factor being over the threshold, executing the risk response.

### Claim 13 (depends on 9)

The computer system of claim 9, wherein determining code level analyzable elements from the computer executable instructions comprises computer executable instructions for:
in response to the coding similarity score being over the threshold, classifying the computer executable instructions.

### Claim 14 (depends on 9)

The computer system of claim 9, wherein classifying the computer executable instructions comprises computer executable instructions for:
comparing the computer executable instructions to previously classified computer executable instructions;
determining a similarity value between the computer executable instructions and previously classified computer executable instructions;
ranking the similarity values;
in response to the similarity value for the previously classified computer executable instructions being over the threshold, classifying the computer executable instructions as the previously classified computer executable instructions.

### Claim 15 (depends on 9)

The computer system of claim 9, further comprising computer executable instructions for:
determining deviations in the computer executable instructions from model computer executable instructions;
communicating the deviations to a user;
allowing the user to select to modify the deviations to follow the model computer executable instructions; and
modifying the deviations in the computer executable instructions to follow the model computer executable instructions.

### Claim 16 (depends on 9)

The computer system of claim 9, further comprising computer executable instructions for:
determining deviations in the computer executable instructions from model computer executable instructions;
in response to the deviation being determined to be a threat;
communicating the deviations to a supervisor;
allowing the supervisor to select to modify the deviations to follow the model computer executable instructions; and
modifying the deviations in the computer executable instructions to follow the model computer executable instructions.

### Claim 17

A tangible non-transitory computer readable medium comprising computer executable instructions for:
receiving computer executable instructions, wherein the computer executable instructions are yet to be executed;
determining a risk factor for the computer executable instructions, wherein the determining the risk factor comprises:
determining code level analyzable elements from the computer executable instructions, wherein the determining comprises reviewing a coding style of the computer executable instructions based on one or more of the following: comments in the computer executable instructions, libraries used by the computer executable instructions, indentation lines of codes of the computer executable instructions, uses of sub-routines of the computer executable instructions, existence of commands in the computer executable instructions, and lack of commands in the computer executable instructions;
recursively separating recognizable sections of the code level analyzable elements from unrecognizable sections;
executing a comparison of a first analyzable element to past analyzable elements stored in the memory that were previously scored as risk factors, wherein the comparison compares the coding style to coding styles stored in the memory;
based on the comparison, calculating a coding style similarity score as part of the proposed risk factor;
determining a threshold for the risk factor according to at least one of the following: a government authority with grades of thresholds, and a past history of the risk factor of the computer executable instructions; and
in response to the determined risk factor calculated for the first analyzable element being meeting the determined threshold, undertaking a risk response,
wherein the risk response comprises one of the following: communicating a risk warning associated with the computer executable instructions, replacing the computer executable instructions identified as risk with a comparable computer executable instructions that have been determined to have an acceptable risk, or placing a hold on the computer executable instructions.

### Claim 18 (depends on 17)

The tangible non-transitory computer readable medium of claim 17, further comprising computer executable instructions for:
executing a comparison for additional code level analyzable elements in the computer executable instructions to past code level analyzable elements stored in a memory previously scored as risk factors;
based on the comparisons, calculating a total risk factor wherein the total risk factor comprises the total of the risk factors for the additional code level analyzable elements;
in response to the total risk factor calculated for the additional code level analyzable elements being over the threshold, executing the risk response.

### Claim 19 (depends on 18)

The tangible non-transitory computer readable medium of claim 18, further comprising computer executable instructions for:
analyzing libraries used by the computer executable instructions;
determining a risk factor for the libraries;
calculating an updated total risk factor wherein the updated total risk factor comprises a total of the risk factors for the additional code level analyzable elements and the risk factor determined for the libraries;
in response to the updated total risk factor being over the threshold, executing the risk response.

### Claim 20 (depends on 17)

The tangible non-transitory computer readable medium of claim 17, wherein determining code level analyzable elements from the computer executable instructions comprises:
in response to the coding similarity score being over the threshold, classifying the computer executable instructions.
