# US 2025/0095350 A1 · Meta-testing of representations learned using self-supervised tasks

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0095350 A1
- Document ID: US20250095350A1
- Status: Published application
- Kind: A1
- Application number: 18/471,209
- Filed: 2023-09-20
- Published: 2025-03-20
- Earliest claimed: 2023-09-20
- Assignees: NVIDIA Corporation
- Applicants: Nvidia Corporation
- Inventors: Wonmin BYEON; Sudarshan BABU; Shalini DE MELLO; Jan KAUTZ
- Web page: https://patentgrep.com/patent/US20250095350A1

## CPC

- G06V 10/82: using neural networks
- G06V 10/776: Validation; Performance evaluation
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

One embodiment of the present invention sets forth a technique for executing a machine learning model. The technique includes performing a first set of training iterations to convert a prediction learning network into a first trained prediction learning network based on a first support set associated with a first set of classes. The technique also includes executing a first trained representation learning network to convert a first data sample into a first latent representation, where the first trained representation learning network is generated by training a representation learning network using a first query set, a first set of self-supervised losses, and a first set of supervised losses. The technique further includes executing the first trained prediction learning network to convert the first latent representation into a first prediction of a first class that is not included in the second set of classes.

## Claims

### Claim 1

A computer-implemented method for executing a machine learning model, the method comprising:
performing a first set of training iterations to convert a prediction learning network into a first trained prediction learning network based on a first support set of training data, wherein the first support set of training data is associated with a first set of classes;
executing a first trained representation learning network to convert a first data sample into a first latent representation, wherein the first trained representation learning network is generated by training a representation learning network using a first query set of training data, a first set of self-supervised losses associated with the first query set of training data, and a first set of supervised losses associated with the first query set of training data, and wherein the first query set of training data is associated with a second set of classes that is different from the first set of classes; and
executing the first trained prediction learning network to convert the first latent representation into a first prediction of a first class that is not included in the second set of classes.

### Claim 2 (depends on 1)

The computer-implemented method of claim 1, further comprising performing a second set of training iterations to pre-train the prediction learning network and the representation learning network using a second support set of training data that is associated with the second set of classes.

### Claim 3 (depends on 2)

The computer-implemented method of claim 2, wherein the second set of training iterations comprises a first subset of training iterations that pre-train the representation learning network using a second set of supervised losses associated with the second support set of training data and a second subset of training iterations that pre-train the prediction learning network using a second set of self-supervised losses associated with the second support set of training data.

### Claim 4 (depends on 1)

The computer-implemented method of claim 1, further comprising:
performing a second set of training iterations to convert the first trained prediction learning network into a second trained prediction learning network based on a second support set of training data that is associated with a third set of classes;
executing the first trained representation learning network to convert a second data sample into a second latent representation; and
executing the second trained prediction learning network to convert the second latent representation into a second prediction of a second class that is not included in the first set of classes or the second set of classes.

### Claim 5 (depends on 4)

The computer-implemented method of claim 4, further comprising computing one or more performance metrics based on the first prediction, the second prediction, and a set of labels associated with the first data sample and the second data sample.

### Claim 6 (depends on 1)

The computer-implemented method of claim 1, wherein performing the first set of training iterations comprises performing a plurality of training operations on the prediction learning network using a second set of supervised losses associated with the first support set of training data.

### Claim 7 (depends on 1)

The computer-implemented method of claim 1, further comprising generating the prediction learning network using the first query set of training data and the first set of supervised losses.

### Claim 8 (depends on 1)

The computer-implemented method of claim 1, wherein the first set of supervised losses is computed between a set of predictions generated by the prediction learning network from a set of training samples included in the first query set of training data and a set of labels for the set of training samples.

### Claim 9 (depends on 1)

The computer-implemented method of claim 1, wherein the first set of self-supervised losses is computed between a set of training samples included in the first query set of training data and a set of infilling results generated by the representation learning network from one or more portions of the set of training samples.

### Claim 10 (depends on 1)

The computer-implemented method of claim 1, wherein the first data sample is included in a first query set of test data corresponding to the first support set of training data.

### Claim 11

One or more non-transitory computer-readable media storing instructions that, when executed by one or more processors, cause the one or more processors to perform the steps of:
performing a first set of training iterations to convert a prediction learning network into a first trained prediction learning network based on a first support set of training data, wherein the first support set of training data is associated with a first set of classes;
executing a first trained representation learning network to convert a first data sample into a first latent representation, wherein the first trained representation learning network is generated by training a representation learning network using a first query set of training data, a first set of self-supervised losses associated with the first query set of training data, and a first set of supervised losses associated with the first query set of training data, and wherein the first query set of training data is associated with a second set of classes that is different from the first set of classes; and
executing the first trained prediction learning network to convert the first latent representation into a first prediction of a class that is not included in the second set of classes.

### Claim 12 (depends on 11)

The one or more non-transitory computer-readable media of claim 11, wherein the instructions further cause the one or more processors to perform the step of performing a second set of training iterations to pre-train the prediction learning network using a second support set of training data that is associated with the second set of classes and a second set of self-supervised losses associated with the second support set of training data.

### Claim 13 (depends on 11)

The one or more non-transitory computer-readable media of claim 11, wherein the instructions further cause the one or more processors to perform the steps of:
performing a second set of training iterations to convert the first trained prediction learning network into a second trained prediction learning network based on a second support set of training data that is associated with a third set of classes;
executing the first trained representation learning network to convert a second data sample into a second latent representation; and
executing the second trained prediction learning network to convert the second latent representation into a second prediction of a second class that is not included in the first set of classes or the second set of classes.

### Claim 14 (depends on 11)

The one or more non-transitory computer-readable media of claim 11, wherein training the representation learning network comprises:
executing an encoder included in the representation learning network to convert augmented versions of a set of training samples included in the first query set of training data into a set of latent representations;
executing a decoder included in the representation learning network to convert the set of latent representations into a set of self-supervised training output; and
performing one or more training operations on the representation learning network using the first set of self-supervised losses computed between the set of self-supervised training output and the set of training samples.

### Claim 15 (depends on 14)

The one or more non-transitory computer-readable media of claim 14, wherein the first set of self-supervised losses comprises a mean squared error.

### Claim 16 (depends on 14)

The one or more non-transitory computer-readable media of claim 14, wherein the set of training samples comprises a set of images.

### Claim 17 (depends on 14)

The one or more non-transitory computer-readable media of claim 14, wherein the augmented versions of the set of training samples comprise at least one of a partial representation of a training sample or a transformed training sample.

### Claim 18 (depends on 11)

The one or more non-transitory computer-readable media of claim 11, wherein the first trained representation learning network is further generated by training the representation learning network using a second support set of training data that is associated with the second set of classes and a second set of self-supervised losses associated with the second support set of training data.

### Claim 19 (depends on 11)

The one or more non-transitory computer-readable media of claim 11, wherein the first set of supervised losses comprises a classification loss associated with a set of labels included in the first query set of training data.

### Claim 20

A system, comprising:
one or more memories that store instructions, and
one or more processors that are coupled to the one or more memories and, when executing the instructions, are configured to perform the steps of:
performing a first set of training iterations to convert a prediction learning network into a first trained prediction learning network based on a first support set of training data, wherein the first support set of training data is associated with a first set of classes;
executing a first trained representation learning network to convert a first data sample into a first latent representation, wherein the first trained representation learning network is generated by training a representation learning network using a first query set of training data, a first set of self-supervised losses associated with the first query set of training data, and a first set of supervised losses associated with the first query set of training data, and wherein the first query set of training data is associated with a second set of classes that is different from the first set of classes; and
executing the first trained prediction learning network to convert the first latent representation into a first prediction of a class that is not included in the second set of classes.
