# US 2022/0019898 A1 · Information processing apparatus, information processing method, and storage medium

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2022/0019898 A1
- Document ID: US20220019898A1
- Status: Published application
- Kind: A1
- Application number: 17/232,148
- Filed: 2021-04-16
- Published: 2022-01-20
- Earliest claimed: 2020-07-14
- Assignees: Fujitsu Limited
- Applicants: Fujitsu Limited
- Inventors: Akihiko KASAGI
- Web page: https://patentgrep.com/patent/US20220019898A1

## CPC

- G06N 3/084: Backpropagation, e.g. using gradient descent
- G06N 3/04: Architecture, e.g. interconnection topology
- G06N 3/045: Combinations of networks
- G06N 3/0464: Convolutional networks [CNN, ConvNet]
- G06N 3/09: Supervised learning
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS

## Abstract

An information processing method executed by a computer, the method includes inputting training data to a machine learning model that includes a convolution layer and acquire an output result by the machine learning model; extracting a specific element that meets a specific condition from among elements included in error information based on an error between the training data and the output result; and performing machine learning of the convolution layer using the specific element.

## Claims

### Claim 1

An information processing apparatus, comprising:
a memory; and
a processor coupled to the memory and the processor configured to:
input training data to a machine learning model that includes a convolution layer and acquire an output result by the machine learning model,
extract a specific element that meets a specific condition from among elements included in error information based on an error between the training data and the output result, and
perform machine learning of the convolution layer using the specific element.

### Claim 2 (depends on 1)

The information processing apparatus according to claim 1, wherein the processor configured to
extract an element of which a value is equal to or more than a threshold or a predetermined number of elements of which a value is large from among the elements included in the error information as the specific elements.

### Claim 3 (depends on 1)

The information processing apparatus according to claim 1, wherein
the machine learning model includes the convolution layer and a plurality of layers, and
the processor configured to:
acquire the output result by forward propagating the training data from an input layer to an output layer of the machine learning model,
backpropagate the error information from the output layer to the input layer,
perform machine learning based on the error information backpropagated to a layer other than the convolution layer,
extract the specific element from the error information backpropagated to the convolution layer regarding the convolution layer, and
perform machine learning using the specific element.

### Claim 4 (depends on 3)

The information processing apparatus according to claim 3, wherein the processor configured to:
acquire, at the time of the forward propagation, feature amount information regarding a feature amount input to the convolution layer, and
perform, at the time of the backpropagation, machine learning of the convolution layer by using the feature amount information and the specific element.

### Claim 5 (depends on 4)

The information processing apparatus according to claim 4, wherein
the convolution layer generates a feature amount from data propagated by the forward propagation through filtering using a filter, and
the processor configured to:
calculate an error gradient of the filter using the feature amount information and the specific element and
update the filter on the basis of the error gradient as machine learning of the convolution layer.

### Claim 6 (depends on 5)

The information processing apparatus according to claim 5, wherein the processor configured to:
acquire the output result that is a result of determining the image data by the machine learning model according to an input of the training data that is image data,
calculate an error gradient of the filter by using the feature amount information that has a predetermined image size and is generated from the image data at the time of the forward propagation, and the error information,
updating the filter by a convolution operation based on the error gradient.

### Claim 7 (depends on 6)

The information processing apparatus according to claim 6, wherein the processor configured to:
extract a sparse matrix that includes an index and a value of the specific element from the error information,
acquire a rectangular region corresponding to the index from the feature amount information, and
update the filter by the convolution operation that scalar-multiplies the value of the sparse matrix by each piece of the feature amount information in the rectangular region and performs addition.

### Claim 8

An information processing method executed by a computer, the method comprising:
inputting training data to a machine learning model that includes a convolution layer and acquire an output result by the machine learning model;
extracting a specific element that meets a specific condition from among elements included in error information based on an error between the training data and the output result; and
performing machine learning of the convolution layer using the specific element.

### Claim 9

A non-transitory computer-readable storage medium storing a program that causes a computer to execute a process, the process comprising:
inputting training data to a machine learning model that includes a convolution layer and acquire an output result by the machine learning model;
extracting a specific element that meets a specific condition from among elements included in error information based on an error between the training data and the output result; and
performing machine learning of the convolution layer using the specific element.
