# US 2023/0409911 A1 · Information processing device, information processing method, and non-transitory computer-readable recording medium storing information processing program

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2023/0409911 A1
- Document ID: US20230409911A1
- Status: Published application
- Kind: A1
- Application number: 18/458,363
- Filed: 2023-08-30
- Published: 2023-12-21
- Earliest claimed: 2021-03-15
- Assignees: Fujitsu Limited
- Applicants: Fujitsu Limited
- Inventors: Yuya OBINATA; Takuma YAMAMOTO
- Web page: https://patentgrep.com/patent/US20230409911A1

## CPC

- G06N 3/08: Learning methods
- G06N 3/0895: Weakly supervised learning, e.g. semi-supervised or self-supervised learning
- G06N 3/0464: Convolutional networks [CNN, ConvNet]
- G06N 3/09: Supervised learning
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS

## Abstract

An information processing device including: memory configured to store a plurality of pieces of labeled data in which a label that represents a correct answer is associated with object data, a plurality of pieces of unlabeled data that is object data not associated with a correct answer, and a deep learning model; and processor circuitry configured to perform processing including: generating a pseudo label based on the plurality of pieces of unlabeled data and the deep learning model; calculating, based on the pseudo label and each label included in the plurality of pieces of labeled data, a loss for a result obtained by identifying the plurality of pieces of unlabeled data through the deep learning model, and a loss for a result obtained by identifying the plurality of pieces of labeled data through the deep learning model; and updating the deep learning model based on the calculated losses.

## Claims

### Claim 1

An information processing device comprising:
memory configured to store a plurality of pieces of labeled data in which a label that represents a correct answer is associated with object data, a plurality of pieces of unlabeled data that is object data not associated with a correct answer, and a deep learning model; and
processor circuitry coupled to the memory, the processor circuitry being configured to perform processing including:
generating a pseudo label based on the plurality of pieces of unlabeled data and the deep learning model;
calculating, based on the pseudo label and each label included in the plurality of pieces of labeled data, a loss for a result obtained by identifying the plurality of pieces of unlabeled data through the deep learning model, and a loss for a result obtained by identifying the plurality of pieces of labeled data through the deep learning model; and
updating the deep learning model based on the calculated losses, wherein
the deep learning model includes a feature amount extraction layer and an identification layer,
the processing further includes:
performing first model output processing, the first model output processing including acquiring the deep learning model, holding the deep learning model as a first deep learning model, and inputting the unlabeled data to the first deep learning model to obtain a first output value; and
performing second model output processing, the second model output processing including acquiring the deep learning model, holding the deep learning model as a second deep learning model, and inputting the labeled data to the second deep learning model to obtain a second output value,
the calculating includes:
performing first loss calculation processing including calculating a first loss by using the first output value obtained by the first model output processing and the pseudo label; and
performing second loss calculation processing including calculating a second loss by using the second output value obtained by the second model output processing and the label, and
the updating includes performing, based on both the first loss and the second loss, first update to the first deep learning model and second update to the second deep learning model.

### Claim 2 (depends on 1)

The information processing device according to claim 1, wherein
the updating includes:
performing similar update for the feature amount extraction layer included in each of the first deep learning model and the second deep learning model as the first update and the second update; and
performing different update for each of a first identification layer included in the first deep learning model and a second identification layer included in the second deep learning model.

### Claim 3 (depends on 1)

The information processing device according to claim 1, wherein
the generating of the pseudo label includes:
classifying the plurality of pieces of unlabeled data into a predetermined number of clusters based on an output value obtained by inputting the plurality of pieces of unlabeled data to the deep learning model; and
assigning the pseudo label to each of the clusters.

### Claim 4 (depends on 1)

The information processing device according to claim 1, the processing further comprising performing model output processing, the model output processing including integrating the unlabeled data and the labeled data to create integrated data, and inputting the integrated data to the deep learning model to obtain an output value,
wherein the calculating includes
generating an integrated label by integrating the label included in the labeled data and the pseudo label, and
calculating the loss based on the output value obtained by using the model output processing and the integrated label.

### Claim 5

An information processing method implemented by a computer, the information processing method comprising:
accessing a storage device that stores a plurality of pieces of labeled data in which a label that represents a correct answer is associated with object data, a plurality of pieces of unlabeled data that is object data not associated with a correct answer, and a deep learning model;
generating a pseudo label based on the plurality of pieces of unlabeled data and the deep learning model;
calculating, based on the pseudo label and each label included in the plurality of pieces of labeled data, a loss for a result obtained by identifying the plurality of pieces of unlabeled data through the deep learning model, and a loss for a result obtained by identifying the plurality of pieces of labeled data through the deep learning model; and
updating the deep learning model based on the calculated losses, wherein
the deep learning model includes a feature amount extraction layer and an identification layer,
the processing further includes:
performing first model output processing, the first model output processing including acquiring the deep learning model, holding the deep learning model as a first deep learning model, and inputting the unlabeled data to the first deep learning model to obtain a first output value; and
performing second model output processing, the second model output processing including acquiring the deep learning model, holding the deep learning model as a second deep learning model, and inputting the labeled data to the second deep learning model to obtain a second output value,
the calculating includes:
performing first loss calculation processing including calculating a first loss by using the first output value obtained by the first model output processing and the pseudo label; and
performing second loss calculation processing including calculating a second loss by using the second output value obtained by the second model output processing and the label, and
the updating includes performing, based on both the first loss and the second loss, first update to the first deep learning model and second update to the second deep learning model.

### Claim 6

A non-transitory computer-readable recording medium storing an information processing program for causing a computer to perform processing including:
accessing a storage device that stores a plurality of pieces of labeled data in which a label that represents a correct answer is associated with object data, a plurality of pieces of unlabeled data that is object data not associated with a correct answer, and a deep learning model;
generating a pseudo label based on the plurality of pieces of unlabeled data and the deep learning model;
calculating, based on the pseudo label and each label included in the plurality of pieces of labeled data, a loss for a result obtained by identifying the plurality of pieces of unlabeled data through the deep learning model, and a loss for a result obtained by identifying the plurality of pieces of labeled data through the deep learning model; and
updating the deep learning model based on the calculated losses, wherein
the deep learning model includes a feature amount extraction layer and an identification layer,
the processing further includes:
performing first model output processing, the first model output processing including acquiring the deep learning model, holding the deep learning model as a first deep learning model, and inputting the unlabeled data to the first deep learning model to obtain a first output value; and
performing second model output processing, the second model output processing including acquiring the deep learning model, holding the deep learning model as a second deep learning model, and inputting the labeled data to the second deep learning model to obtain a second output value,
the calculating includes:
performing first loss calculation processing including calculating a first loss by using the first output value obtained by the first model output processing and the pseudo label; and
performing second loss calculation processing including calculating a second loss by using the second output value obtained by the second model output processing and the label, and
the updating includes performing, based on both the first loss and the second loss, first update to the first deep learning model and second update to the second deep learning model.
