# US 2025/0165616 A1 · Generating predicted end-to-end cyber-security attack characteristics via bifurcated machine learning-based processing of multi-modal data systems and methods

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0165616 A1
- Document ID: US20250165616A1
- Status: Published application
- Kind: A1
- Application number: 18/607,141
- Filed: 2024-03-15
- Published: 2025-05-22
- Earliest claimed: 2023-01-19
- Assignees: Citibank, N.A.
- Applicants: Citibank, N.A.
- Inventors: William Franklin Cameron; Pramod Goyal; Prithvi Narayana Rao; Manjit Rajaretnam; Miriam Silver
- Web page: https://patentgrep.com/patent/US20250165616A1

## CPC

- G06F 21/577: {Assessing vulnerabilities and evaluating computer system security}
- G06F 21/552: {involving long-term monitoring or reporting}
- H04L 63/1433: {Vulnerability analysis}
- H04L 63/20: {for managing network security; network security policies in general (filtering policies H04L63/0227)}
- G06F 2221/034: Test or assess a computer or a system
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)

## Abstract

Systems and methods for generating predicted end-to-end cyber-security attack characteristics via bifurcated machine learning-based processing of multi-modal data are disclosed. The system accesses multi-modal data indicating a set of security information related to a computing system. The system then generates a set of extracted characteristics indicating a cyber-security attack on the computing system, via a supervised machine learning model, using the multi-modal data. Using this information, the system generates a revised set of extracted characteristics indicating the cyber-security attack, via an unsupervised machine learning model, using the extracted set of characteristics indicating the cyber-security attack, where the revised set of characteristics includes at least one new characteristic that was not included in the extracted set of characteristics indicating the cyber-security attack on the computing system. The system then generates for display a graphical representation of the revised set of extracted characteristics.

## Claims

### Claim 1

A system for generating predicted end-to-end cyber-security attack characteristics via bifurcated machine learning-based processing of multi-modal data, the system comprising:
at least one hardware processor; and
at least one non-transitory memory storing instructions, which, when executed by the at least one hardware processor, cause the system to:
access multi-modal data indicating a set of security information related to a computing system of an entity, the multi-modal data comprising (i) security attributes of computing system components of the computing system, (ii) security policy information of the computing system of the entity, and (iii) third party-derived security vulnerability information;
apply a supervised machine learning model to the multi-modal data to generate a set of extracted characteristics indicating a cyber-security attack on the computing system of the entity,
wherein the supervised machine learning model is trained on historical multi-modal data indicating labeled subsets of the historical multi-modal data, and
wherein the labeled subsets of the historical multi-modal data indicate whether the subset of the historical multi-modal data indicates a cyber-security attack;
apply an embedding model to the extracted set of characteristics indicating the cyber-security attack to generate a vectorized representation of the extracted set of characteristics indicating the cyber-security attack;
apply an unsupervised machine learning model to the vectorized representation of the extracted set of characteristics indicating the cyber-security attack to generate a revised set of extracted characteristics indicating the cyber-security attack on the computing system of the entity,
wherein the revised set of extracted characteristics includes at least one new characteristic that was not included in the extracted set of characteristics indicating the cyber-security attack on the computing system of the entity; and
generate for display, at a graphical user interface (GUI), a graphical representation of the revised set of extracted characteristics indicating the cyber-security attack on the computing system of the entity.

### Claim 2 (depends on 1)

The system of claim 1, wherein the instructions, which, when executed by the at least one hardware processor, cause the system to:
store the revised set of extracted characteristics indicating the cyber-security attack on the computing system of the entity in a database; and
in response to storing the revised set of extracted characteristics indicating the cyber-security attack on the computing system of the entity, cause a training routine to be performed on the supervised machine learning model, the training routine comprising updating one or more parameters of the supervised machine learning model based on the revised set of characteristics indicating the cyber-security attack.

### Claim 3 (depends on 2)

The system of claim 2, wherein the instructions, which, when executed by the at least one hardware processor, cause the system to:
prior to causing the training routine to be performed on the supervised machine learning model, receive a verification indication of the revised set of extracted characteristics indicating the cyber-security attack on the computing system of the entity from a user; and
in response to receiving a positive verification indication of the revised set of extracted characteristics indicating the cyber-security attack on the computing system of the entity from the user, cause the training routine to be performed on the supervised machine learning model.

### Claim 4 (depends on 1)

The system of claim 1, wherein the supervised machine learning model comprises a set of supervised machine learning models, and wherein the instructions, which, when executed by the at least one hardware processor, cause the system to:
categorize the multi-modal data into a set of categories corresponding to a data format of the security information related to the computing system of the entity;
determine, for each supervised machine learning model of the set of supervised machine learning models, a data format that the respective supervised machine learning model is configured to receive; and
generate the set of extracted characteristics indicating the cyber-security attack on the computing system of the entity by:
for each category of the set of categories of the multi-modal data, providing the respective category of the multi-modal data as input to a respective supervised machine learning model based on a matching data format of (i) the respective category and (ii) the respective supervised machine learning model.

### Claim 5 (depends on 1)

The system of claim 1, wherein the unsupervised machine learning model comprises a generative adversarial network (GAN), the generative adversarial network comprising a generator component and a discriminator component, the generator component being a variational auto encoder (VAE) configured to generate synthetic data representing characteristics of the cyber-security attack on the computing system of the entity.

### Claim 6 (depends on 1)

The system of claim 1, wherein the revised set of extracted characteristics indicating the cyber-security attack on the computing system of the entity is provided to a blackboard machine learning model to generate computing-aspect impact levels reflecting a measure of security for a second computing system platform.

### Claim 7

A method for generating predicted end-to-end cyber-security attack characteristics via bifurcated machine learning-based processing of multi-modal data, the method comprising:
accessing multi-modal data indicating a set of security information related to a computing system of an entity;
applying a supervised machine learning model to the multi-modal data to generate a set of extracted characteristics indicating a cyber-security attack on the computing system of the entity,
wherein the supervised machine learning model is trained on historical multi-modal data indicating labeled subsets of the historical multi-modal data, and
wherein the labeled subsets of the historical multi-modal data indicate whether the subset of the historical multi-modal data indicates a cyber-security attack;
applying an unsupervised machine learning model to the extracted set of characteristics indicating the cyber-security attack to generate a revised set of extracted characteristics indicating the cyber-security attack on the computing system of the entity,
wherein the revised set of extracted characteristics includes at least one new characteristic that was not included in the extracted set of characteristics indicating the cyber-security attack on the computing system of the entity; and
generating for display a graphical representation of the revised set of extracted characteristics indicating the cyber-security attack on the computing system of the entity.

### Claim 8 (depends on 7)

The method of claim 7, further comprising:
applying an embedding model to the extracted set of characteristics indicating the cyber-security attack to generate a vectorized representation of the extracted set of characteristics indicating the cyber-security attack.

### Claim 9 (depends on 7)

The method of claim 7, wherein the multi-modal data comprises (i) security attributes of computing system components of the computing system, (ii) security policy information of the computing system of the entity, and (iii) third party-derived security vulnerability information.

### Claim 10 (depends on 7)

The method of claim 7, further comprising:
storing the revised set of extracted characteristics indicating the cyber-security attack on the computing system of the entity in a database; and
in response to storing the revised set of extracted characteristics indicating the cyber-security attack on the computing system of the entity, causing a training routine to be performed on the supervised machine learning model, the training routine comprising updating one or more parameters of the supervised machine learning model based on the revised set of characteristics indicating the cyber-security attack.

### Claim 11 (depends on 10)

The method of claim 10, further comprising:
prior to causing the training routine to be performed on the supervised machine learning model, receiving a verification indication of the revised set of extracted characteristics indicating the cyber-security attack on the computing system of the entity from a user; and
in response to receiving a positive verification indication of the revised set of extracted characteristics indicating the cyber-security attack on the computing system of the entity from the user, causing the training routine to be performed on the supervised machine learning model, wherein the positive verification indication of the revised set of extracted characteristics is received.

### Claim 12 (depends on 7)

The method of claim 7, wherein the supervised machine learning model comprises a set of supervised machine learning models, and wherein the method further comprises:
categorizing the multi-modal data into a set of categories corresponding to a data format of the security information related to the computing system of the entity;
determining, for each supervised machine learning model of the set of supervised machine learning models, a data format that the respective supervised machine learning model is configured to receive; and
generating the set of extracted characteristics indicating the cyber-security attack on the computing system of the entity by:
for each category of the set of categories of the multi-modal data, providing the respective category of the multi-modal data as input to a respective supervised machine learning model based on a matching data format of (i) the respective category and (ii) the respective supervised machine learning model.

### Claim 13 (depends on 7)

The method of claim 7, wherein the unsupervised machine learning model comprises a generative adversarial network (GAN), the generative adversarial network comprising a generator component and a discriminator component, the generator component being a variational auto encoder (VAE) configured to generate synthetic data representing characteristics of the cyber-security attack on the computing system of the entity.

### Claim 14 (depends on 7)

The method of claim 7, wherein the revised set of extracted characteristics indicating the cyber-security attack on the computing system of the entity is provided to a blackboard machine learning model to generate computing-aspect impact levels reflecting a measure of security for a second computing system platform.

### Claim 15

One or more non-transitory, computer-readable media comprising instructions that, when executed by one or more processors, cause operations comprising:
accessing multi-modal data indicating a set of security information related to a computing system of an entity;
applying a supervised machine learning model to the multi-modal data to generate a set of extracted characteristics indicating a cyber-security attack on the computing system of the entity,
wherein the supervised machine learning model is trained on historical multi-modal data indicating labeled subsets of the historical multi-modal data, and
wherein the labeled subsets of the historical multi-modal data indicate whether the subset of the historical multi-modal data indicates a cyber-security attack;
applying an unsupervised machine learning model to the extracted set of characteristics indicating the cyber-security attack to generate a revised set of extracted characteristics indicating the cyber-security attack on the computing system of the entity,
wherein the revised set of extracted characteristics includes at least one new characteristic that was not included in the extracted set of characteristics indicating the cyber-security attack on the computing system of the entity; and
generating for display a graphical representation of the revised set of extracted characteristics indicating the cyber-security attack on the computing system of the entity.

### Claim 16 (depends on 15)

The media of claim 15, wherein the instructions, when executed by the one or more processors, further cause operations comprising:
storing the revised set of extracted characteristics indicating the cyber-security attack on the computing system of the entity in a database; and
in response to storing the revised set of extracted characteristics indicating the cyber-security attack on the computing system of the entity, causing a training routine to be performed on the supervised machine learning model, the training routine comprising updating one or more parameters of the supervised machine learning model based on the revised set of characteristics indicating the cyber-security attack.

### Claim 17 (depends on 16)

The media of claim 16, wherein the instructions, when executed by the one or more processors, further cause operations comprising:
prior to causing the training routine to be performed on the supervised machine learning model, receiving a verification indication of the revised set of extracted characteristics indicating the cyber-security attack on the computing system of the entity from a user; and
in response to receiving a positive verification indication of the revised set of extracted characteristics indicating the cyber-security attack on the computing system of the entity from the user, causing the training routine to be performed on the supervised machine learning model.

### Claim 18 (depends on 15)

The media of claim 15, wherein the supervised machine learning model comprises a set of supervised machine learning models, and wherein the instructions, when executed by the one or more processors, further cause operations comprising:
categorizing the multi-modal data into a set of categories corresponding to a data format of the security information related to the computing system of the entity;
determining, for each supervised machine learning model of the set of supervised machine learning models, a data format that the respective supervised machine learning model is configured to receive; and
generating the set of extracted characteristics indicating the cyber-security attack on the computing system of the entity by:
for each category of the set of categories of the multi-modal data, providing the respective category of the multi-modal data as input to a respective supervised machine learning model based on a matching data format of (i) the respective category and (ii) the respective supervised machine learning model.

### Claim 19 (depends on 15)

The media of claim 15, wherein the unsupervised machine learning model comprises a generative adversarial network (GAN), the generative adversarial network comprising a generator component and a discriminator component, the generator component being a variational auto encoder (VAE) configured to generate synthetic data representing characteristics of the cyber-security attack on the computing system of the entity.

### Claim 20 (depends on 15)

The media of claim 15, wherein the revised set of extracted characteristics indicating the cyber-security attack on the computing system of the entity is provided to a blackboard machine learning model to generate computing-aspect impact levels reflecting a measure of security for a second computing system platform.
