# US 2025/0384129 A1 · Semi-supervised malware classification using representation-agnostic transformer models

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0384129 A1
- Document ID: US20250384129A1
- Status: Published application
- Kind: A1
- Application number: 18/900,317
- Filed: 2024-09-27
- Published: 2025-12-18
- Earliest claimed: 2024-06-14
- Assignees: CrowdStrike, Inc.
- Applicants: CrowdStrike, Inc.
- Inventors: Florian Störtz; Felix Schwyzer; Marian Radu; Mihaela-Petruta Gaman
- Web page: https://patentgrep.com/patent/US20250384129A1

## CPC

- G06F 21/56: Computer malware detection or handling, e.g. anti-virus arrangements
- G06N 20/00: Machine learning
- G06F 2221/034: Test or assess a computer or a system
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS

## Abstract

A method of monitoring an endpoint for malicious code includes obtaining a corpus of files collected by an endpoint protection system, selecting a subset of the corpus of files comprising labeled files, wherein the subset of the corpus is representative of the corpus of files, and training a first artificial intelligence (AI) model, using the subset of the corpus of files in byte form, to infer labels for unlabeled data. The method further includes applying the first AI model to unlabeled files of the corpus of files in byte form to generate labels for the unlabeled files, performing supervised training of a second AI model using the corpus of files and the labels generated for the unlabeled data, and deploying the second AI model to the endpoint protection system.

## Claims

### Claim 1

A method comprising:
obtaining a corpus of files collected by an endpoint protection system;
selecting a subset of the corpus of files comprising labeled files, wherein the subset of the corpus is representative of the corpus of files;
training a first artificial intelligence (AI) model, using the subset of the corpus of files in byte form, to infer labels for unlabeled data;
applying the first AI model to unlabeled files of the corpus of files in byte form to generate labels for the unlabeled files;
performing, by a processing device, supervised training of a second AI model using the corpus of files and the labels generated for the unlabeled data; and
deploying the second AI model to the endpoint protection system.

### Claim 2 (depends on 1)

The method of claim 1, wherein the corpus of files is associated with at least one of a file type or event type.

### Claim 3 (depends on 1)

The method of claim 1, wherein selecting the subset of the corpus of files comprises:
identifying a plurality of files in the corpus of files that are labeled; and
selecting the subset of the corpus of files, from the identified plurality files that are labeled, to represent characteristics of the corpus of files.

### Claim 4 (depends on 3)

The method of claim 3, wherein selecting the subset of the corpus of files further comprises:
determining that the plurality of files in the corpus that are labeled is insufficient to train the first AI model; and
labeling additional files in the corpus of files to produce a sufficient subset of the corpus of files that are labeled.

### Claim 5 (depends on 4)

The method of claim 4, wherein training the first AI model further comprises:
randomly sampling byte segments of each file of the subset of the corpus of files in byte form; and
inputting the byte segments of each file of the subset of the corpus of files as training data for the first AI model.

### Claim 6 (depends on 1)

The method of claim 1, wherein applying the first AI model to unlabeled files of the corpus of files to generate labels for the unlabeled files comprises:
for each file in the unlabeled files of the corpus of files:
generating, by the first AI model, a decision variable for the file based on the file in byte form;
determining whether the decision variable satisfies a label generation threshold; and
in response to the decision variable satisfying the label generation threshold, generating a first label for the file based on the decision variable.

### Claim 7 (depends on 6)

The method of claim 6, further comprising:
for each file in the unlabeled files of the corpus of files:
generating an embedding based on the file, wherein the embedding comprises a plurality of data points for the file;
applying a third AI model to the embedding to generate a second label for the file; and
in response to determining that the decision variable generated by the first AI model does not satisfy the label generation threshold, assigning the second label to the file.

### Claim 8

A system comprising:
a memory; and
a processing device, operatively coupled to the memory, to:
obtain a corpus of files collected by an endpoint protection system;
select a subset of the corpus of files comprising labeled files, wherein the subset of the corpus is representative of the corpus of files;
train a first artificial intelligence (AI) model, using the subset of the corpus of files in byte form, to infer labels for unlabeled data;
apply the first AI model to unlabeled files of the corpus of files in byte form to generate labels for the unlabeled files;
perform supervised training of a second AI model using the corpus of files and the labels generated for the unlabeled files; and
deploy the second AI model to the endpoint protection system.

### Claim 9 (depends on 8)

The system of claim 8, wherein the corpus of files is associated with at least one of a file type or event type.

### Claim 10 (depends on 8)

The system of claim 8, wherein to select the subset of the corpus of file, the processing device is to:
identify a plurality of files in the corpus of files that are labeled; and
select the subset of the corpus of files, from the identified plurality files that are labeled, to represent characteristics of the corpus of files.

### Claim 11 (depends on 10)

The system of claim 10, wherein to select the subset of the corpus of files the processing device is to:
determine that the plurality of files in the corpus that are labeled is insufficient to train the first AI model; and
label additional files in the corpus of files to produce a sufficient subset of the corpus of files that are labeled.

### Claim 12 (depends on 11)

The system of claim 11, wherein to train the first AI model, the processing device is further to:
randomly sample byte segments of each file of the subset of the corpus of files in byte form; and
input the byte segments of each file of the subset of the corpus of files as training data for the first AI model.

### Claim 13 (depends on 8)

The system of claim 8, wherein to apply the first AI model to unlabeled files of the corpus of files to generate labels for the unlabeled files, the processing device is to:
for each file in the unlabeled files of the corpus of files:
generate, by the first AI model, a decision variable for the file based on the file in byte form;
determine whether the decision variable satisfies a label generation threshold; and
in response to the decision variable satisfying the label generation threshold, generate a first label for the file based on the decision variable.

### Claim 14 (depends on 13)

The system of claim 13, wherein to apply the first AI model to unlabeled data of the corpus of files to generate labels for the unlabeled data, the processing device is to:
for each file in the unlabeled files of the corpus of files:
generate an embedding based on the file, wherein the embedding comprises a plurality of data points for the file;
apply a third AI model to the embedding to generate a second label for the file; and
in response to determining that the decision variable generated by the first AI model does not satisfy the label generation threshold, assign the second label to the file.

### Claim 15

A non-transitory computer readable medium having instructions encoded thereon that, when executed by a processing device, cause the processing device to:
obtain a corpus of files collected by an endpoint protection system;
select a subset of the corpus of files comprising labeled files, wherein the subset of the corpus is representative of the corpus of files;
train a first artificial intelligence (AI) model, using the subset of the corpus of files, to infer labels for unlabeled data;
apply the first AI model to unlabeled files of the corpus of files to generate labels for the unlabeled files;
perform, by the processing device, supervised training of a second AI model using the corpus of files and the labels generated for the unlabeled files; and
deploy the second AI model to the endpoint protection system.

### Claim 16 (depends on 15)

The non-transitory computer readable medium of claim 15, wherein to select the subset of the corpus of file, the processing device is to:
identify a plurality of files in the corpus of files that are labeled; and
select the subset of the corpus of files, from the identified plurality files that are labeled, to represent characteristics of the corpus of files.

### Claim 17 (depends on 16)

The non-transitory computer readable medium of claim 16, wherein to select the subset of the corpus of files the processing device is to:
determine that the plurality of files in the corpus that are labeled is insufficient to train the first AI model; and
label additional files in the corpus of files to produce a sufficient subset of the corpus of files that are labeled.

### Claim 18 (depends on 17)

The non-transitory computer readable medium of claim 17, wherein to train the first AI model, the processing device is further to:
randomly sample byte segments of each file of the subset of the corpus of files in byte form; and
input the byte segments of each file of the subset of the corpus of files as training data for the first AI model.

### Claim 19 (depends on 15)

The non-transitory computer readable medium of claim 15, wherein to apply the first AI model to unlabeled data of the corpus of files to generate labels for the unlabeled data, the processing device is to:
for each file in the unlabeled data of the corpus of files:
generate, by the first AI model, a decision variable for the file based on the file in byte form;
determine whether the decision variable satisfies a label generation threshold; and
in response to the decision variable satisfying the label generation threshold, generate a first label for the file based on the decision variable.

### Claim 20 (depends on 19)

The non-transitory computer readable medium of claim 19, wherein to apply the first AI model to unlabeled data of the corpus of files to generate labels for the unlabeled data, the processing device is to:
for each file in the unlabeled data of the corpus of files:
generate an embedding based on the file, wherein the embedding comprises a plurality of data points for the file;
apply a third AI model to the embedding to generate a second label for the file; and
in response to determining that the decision variable generated by the first AI model does not satisfy the label generation threshold, assign the second label to the file.
