# US 2026/0099737 A1 · Information processing device, information processing method, and computer program product

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2026/0099737 A1
- Document ID: US20260099737A1
- Status: Published application
- Kind: A1
- Application number: 19/284,780
- Filed: 2025-07-30
- Published: 2026-04-09
- Earliest claimed: 2024-10-04
- Assignees: Kabushiki Kaisha Toshiba
- Applicants: Kabushiki Kaisha Toshiba
- Inventors: Kota Watanabe; Yuto Yamaji; Hiroo Saito; Yushiro Kashimoto; Daisuke Kobayashi
- Web page: https://patentgrep.com/patent/US20260099737A1

## CPC

- G06N 5/045: Explanation of inference; Explainable artificial intelligence [XAI]; Interpretable artificial intelligence
- G06V 10/62: relating to a temporal dimension, e.g. time-based feature extraction; Pattern tracking
- G06V 10/761: {Proximity, similarity or dissimilarity measures}
- G06V 10/82: using neural networks
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

An information processing device according to an embodiment includes a hardware processor connected to a memory. The processor receives an input of input information including recognition target data. The processor executes one or more recognition tasks. Each of the recognition tasks is a task of recognizing the recognition target data based on reference information including reference data, one or more pieces of attention region information indicating an entire or a partial attention region of the reference data, and explanatory information about the attention region. The processor outputs information including recognition result obtained by executing the one or more recognition tasks.

## Claims

### Claim 1

An information processing device comprising
a hardware processor connected to a memory and configured to:
receive an input of input information including recognition target data;
execute one or more recognition tasks, each being a task of recognizing the recognition target data based on reference information including reference data, one or more pieces of attention region information indicating an entire or a partial attention region of the reference data, and explanatory information about the attention region; and
output information including recognition result obtained by executing the one or more recognition tasks.

### Claim 2 (depends on 1)

The information processing device according to claim 1, wherein
the recognition target data includes at least one of a first image, a first time series image, first three-dimensional data, or a first audio signal,
the reference data includes a second image in a case where the recognition target data includes the first image,
the reference data includes a second time series image in a case where the recognition target data includes the first time series image,
the reference data includes second three-dimensional data in a case where the recognition target data includes the first three-dimensional data, and
the reference data includes a second audio signal in a case where the recognition target data includes the first audio signal.

### Claim 3 (depends on 1)

The information processing device according to claim 1, wherein the explanatory information is an optional text describing an attention region indicated by the attention region information.

### Claim 4 (depends on 1)

The information processing device according to claim 1, wherein
the hardware processor is further configured to:
calculate a first similarity based on a feature of recognition target data and a feature of reference data,
select the reference data for which the first similarity is higher, and
calculate a second similarity between an attention region of the selected reference data and a partial region of the recognition target data, the second similarity being calculated based on a feature of an attention region indicated by the attention region information of the selected reference data, a feature of the explanatory information of the selected reference data, and a feature of the partial region of the recognition target data, and
the one or more recognition tasks each recognize the recognition target data based on the first similarity and the second similarity.

### Claim 5 (depends on 1)

The information processing device according to claim 1, wherein
the hardware processor is further configured to execute two or more of the recognition tasks, and
the input information further includes information designating a recognition task to be executed among the two or more of the recognition tasks.

### Claim 6 (depends on 1)

The information processing device according to claim 1, wherein
the hardware processor is further configured to generate a response to a question on the recognition target data, and
the input information further includes a text indicating the question.

### Claim 7 (depends on 1)

The information processing device according to claim 1, wherein the hardware processor is further configured to receive an input of the reference information.

### Claim 8 (depends on 1)

The information processing device according to claim 1, wherein the hardware processor is further configured to extract feature information about an attention region indicated by the attention region information, the feature information being extracted based on the reference data, the attention region information, and the explanatory information.

### Claim 9

An information processing method implemented by a computer, the method comprising:
receiving an input of input information including recognition target data;
executing one or more recognition tasks, each being a task of recognizing the recognition target data based on reference information including reference data, one or more pieces of attention region information indicating an entire or a partial attention region of the reference data, and explanatory information about the attention region; and
outputting information including recognition result obtained by executing the one or more recognition tasks.

### Claim 10

A computer program product comprising a non-transitory computer readable recording medium on which a computer program executable by a computer is stored, the computer program instructing the computer to perform processing, the processing including:
receiving an input of input information including recognition target data;
executing one or more recognition tasks, each being a task of recognizing the recognition target data based on reference information including reference data, one or more pieces of attention region information indicating an entire or a partial attention region of the reference data, and explanatory information about the attention region; and
outputting information including recognition result obtained by executing the one or more recognition tasks.
