# US 2026/0094415 A1 · Learning process visualization system, information processing device, and information processing method

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2026/0094415 A1
- Document ID: US20260094415A1
- Status: Published application
- Kind: A1
- Application number: 19/412,991
- Filed: 2025-12-09
- Published: 2026-04-02
- Earliest claimed: 2023-06-19
- Assignees: Mitsubishi Electric Corporation
- Applicants: Mitsubishi Electric Corporation
- Inventors: Shotaro ISHIGAMI
- Web page: https://patentgrep.com/patent/US20260094415A1

## CPC

- G06N 20/00: Machine learning
- G06V 10/764: using classification, e.g. of video objects
- G06N 3/04: Architecture, e.g. interconnection topology
- G06N 3/045: Combinations of networks
- G06N 3/0464: Convolutional networks [CNN, ConvNet]
- G06N 3/08: Learning methods
- G06N 5/045: Explanation of inference; Explainable artificial intelligence [XAI]; Interpretable artificial intelligence
- G06T 5/50: using two or more images, e.g. averaging or subtraction
- G06V 10/25: Determination of region of interest [ROI] or a volume of interest [VOI]
- G06V 10/761: {Proximity, similarity or dissimilarity measures}
- G06T 2207/20221: Image fusion; Image merging
- G06V 2201/07: Target detection
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

A visualization result display control device includes a display control unit to perform display control of aligning and displaying a first similar portion superimposed display and a second similar portion superimposed display, the first similar portion superimposed display showing a first display superimposed on a misclassified sample, the first display visualizing a first similar portion of the misclassified sample to an extracted sample that is a sample having a feature similar to the misclassified sample, the misclassified sample being a sample that has been misclassified into a prediction class by an object detection model, and the second similar portion superimposed display showing a second display superimposed on the extracted sample, and the second display visualizing a second similar portion of the extracted sample to the misclassified sample.

## Claims

### Claim 1

A learning process visualization system comprising:
processing circuitry
to search for a sample having a feature similar to a feature of a misclassified sample from a misclassified bounding box group including a group of misclassified bounding boxes, and to extract a found sample as an extracted sample, the misclassified sample being a sample that has been misclassified into a prediction class by an object detection model; and
to perform display control of aligning and displaying a first similar portion superimposed display and a second similar portion superimposed display, the first similar portion superimposed display showing a first display superimposed on the misclassified sample, the first display visualizing a first similar portion between the misclassified sample and the extracted sample, the second similar portion superimposed display showing a second display superimposed on the extracted sample, the second display visualizing a second similar portion between the extracted sample and the misclassified sample.

### Claim 2

A learning process visualization system comprising:
processing circuitry
to search for a sample having a feature similar to a feature of training data of a misclassified sample from an existing image database that is a database of existing images, and to extract a found sample as an extracted sample, the misclassified sample being a sample that has been misclassified into a prediction class by an object detection model; and
to perform display control of aligning and displaying a first similar portion superimposed display and a second similar portion superimposed display, the first similar portion superimposed display showing a first display superimposed on the misclassified sample, the first display visualizing a first similar portion between the misclassified sample and the extracted sample, the second similar portion superimposed display showing a second display superimposed on the extracted sample, the second display visualizing a second similar portion between the extracted sample and the misclassified sample.

### Claim 3

A learning process visualization system comprising:
processing circuitry
to search for a sample having a feature similar to a feature of training data of a misclassified sample from a misclassified bounding box group including a group of misclassified bounding boxes, and to extract a found sample as an extracted sample, the misclassified sample being a sample that has been misclassified into a prediction class by an object detection model; and
to perform display control of aligning and displaying a first similar portion superimposed display and a second similar portion superimposed display, the first similar portion superimposed display showing a first display superimposed on the misclassified sample, the first display visualizing a first similar portion between the misclassified sample and the extracted sample, the second similar portion superimposed display showing a second display superimposed on the extracted sample, the second display visualizing a second similar portion between the extracted sample and the misclassified sample.

### Claim 4

A learning process visualization system comprising:
processing circuitry
to search for a similar sample belonging to a prediction class of a misclassified sample, and to extract a found similar sample as an extracted sample, the misclassified sample being a sample that has been misclassified into a prediction class by an object detection model; and
to perform display control of aligning and displaying a first similar portion superimposed display and a second similar portion superimposed display, the first similar portion superimposed display showing a first display superimposed on the misclassified sample, the first display visualizing a first similar portion between the misclassified sample and the extracted sample, the second similar portion superimposed display showing a second display superimposed on the extracted sample, the second display visualizing a second similar portion between the extracted sample and the misclassified sample.

### Claim 5

A learning process visualization system comprising:
processing circuitry
to search for a partially detected sample, and to extract a found partially detected sample as an extracted sample, the partially detected sample being a sample belonging to a same correct class and prediction class as a correct class and a prediction class of a misclassified sample, and obtained by partially detecting an object, the misclassified sample being a sample that has been misclassified into a prediction class by an object detection model; and
to perform display control of aligning and displaying a first similar portion superimposed display and a second similar portion superimposed display, the first similar portion superimposed display showing a first display superimposed on the misclassified sample, the first display visualizing a first similar portion between the misclassified sample and the extracted sample, the second similar portion superimposed display showing a second display superimposed on the extracted sample, the second display visualizing a second similar portion between the extracted sample and the misclassified sample.

### Claim 6 (depends on 1)

The learning process visualization system according to claim 1, wherein the processing circuitry is further configured to specify the first similar portion and generate the first similar portion superimposed display, and to specify the second similar portion and generate the second similar portion superimposed display.

### Claim 7 (depends on 1)

The learning process visualization system according to claim 1, wherein the processing circuitry is further configured to perform display control of displaying related information related to a misclassified sample that is a target of the first similar portion superimposed display.

### Claim 8

An information processing device comprising:
processing circuitry:
to acquire a first information related to a misclassified sample that is a sample misclassified into a class different from a correct class by an object detection model;
to acquire a first feature amount of the acquired first information;
to acquire an extracted sample having a second feature amount similar to the misclassified sample, on a basis of the first feature amount of the misclassified sample, from samples belonging to a prediction class to which the misclassified sample is predicted to belong by the object detection model; and
to output the acquired first information and the acquired extracted sample to a displaying device.

### Claim 9

An information processing device comprising:
processing circuitry:
to acquire a first information related to a misclassified sample that is a sample misclassified into a class different from a correct class by an object detection model;
to acquire a first feature amount of the acquired first information;
to acquire an extracted sample having a second feature amount similar to the misclassified sample, on a basis of the first feature amount of the misclassified sample, from a misclassified bounding box group including a group of misclassified bounding boxes; and
to output the acquired first information and the acquired extracted sample to a displaying device.

### Claim 10 (depends on 8)

The information processing device according to claim 8, wherein the first information includes any one of the misclassified sample, an original image including the misclassified sample, and training data of the misclassified sample.

### Claim 11 (depends on 8)

The information processing device according to claim 8, wherein the processing circuitry is further configured to acquire the extracted sample, on a basis of a correct class of the misclassified sample, from samples belonging to the correct class.

### Claim 12 (depends on 8)

The information processing device according to claim 8, wherein the processing circuitry is further configured to acquire the extracted sample, on a basis of the prediction class of the misclassified sample and the correct class of the misclassified sample, from partially detected samples that belong to the prediction class and the correct class and that are samples obtained by partially detecting an object.

### Claim 13 (depends on 8)

The information processing device according to claim 8, wherein the processing circuitry is further configured to perform display control of displaying a second information that is information related to the first information, and the first information on a displaying device.

### Claim 14 (depends on 13)

The information processing device according to claim 13, wherein the second information includes any one of information about a prediction class, information about a correct class, and information about a type of misclassification.

### Claim 15

An information processing method comprising:
acquiring a first information related to a misclassified sample that is a sample misclassified into a class different from a correct class by an object detection model;
acquiring a first feature amount of the acquired first information;
acquiring an extracted sample having a second feature amount similar to the misclassified sample, on a basis of the first feature amount of the misclassified sample, from samples belonging to a prediction class to which the misclassified sample is predicted to belong by the object detection model; and
outputting the acquired first information and the acquired extracted sample to a displaying device.

### Claim 16

An information processing method comprising:
acquiring a first information related to a misclassified sample that is a sample misclassified into a class different from a correct class by an object detection model;
acquiring a first feature amount of the acquired first information;
acquiring an extracted sample having a second feature amount similar to the misclassified sample, on a basis of the first feature amount of the misclassified sample, from a misclassified bounding box group including a group of misclassified bounding boxes; and
outputting the acquired first information and the acquired extracted sample to a displaying device.
