# US 2023/0267705 A1 · Information processing system and inference method

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2023/0267705 A1
- Document ID: US20230267705A1
- Status: Published application
- Kind: A1
- Application number: 17/990,766
- Filed: 2022-11-21
- Published: 2023-08-24
- Earliest claimed: 2022-02-21
- Assignees: Fujitsu Limited
- Applicants: Fujitsu Limited
- Inventors: Takanori NAKAO; Xuying LEI
- Web page: https://patentgrep.com/patent/US20230267705A1

## CPC

- G06V 10/454: {Integrating the filters into a hierarchical structure, e.g. convolutional neural networks [CNN]}
- G06V 10/771: Feature selection, e.g. selecting representative features from a multi-dimensional feature space
- G06N 3/045: Combinations of networks
- G06N 3/0464: Convolutional networks [CNN, ConvNet]
- G06N 3/063: using electronic means
- G06T 7/74: {involving reference images or patches}
- G06V 10/25: Determination of region of interest [ROI] or a volume of interest [VOI]
- G06V 10/7715: {Feature extraction, e.g. by transforming the feature space, e.g. multi-dimensional scaling [MDS]; Mappings, e.g. subspace methods}
- G06V 10/82: using neural networks
- G06T 2207/20081: Training; Learning
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

An information processing system includes an edge computer that implements a preceding stage of a learning model, and a cloud computer that implements a subsequent stage of the learning model, wherein the edge computer includes a first processor configured to calculate a first feature amount by inputting a first image to the preceding stage, identify an area of interest in the first image based on the first feature amount, generate a second image obtained by masking the area of interest in the first image, calculate a second feature amount by inputting the second image to the preceding stage, and transmit the second feature amount to the cloud computer, and the cloud computer includes a second processor configured to infer an object included in the second image by inputting the second feature amount to the subsequent stage.

## Claims

### Claim 1

An information processing system, comprising:
an edge computer that implements a plurality of layers of a preceding stage among a plurality of layers included in a learning model; and
a cloud computer that implements a plurality of layers of a subsequent stage obtained by removing the plurality of layers of the preceding stage from the plurality of layers included in the learning model,
wherein
the edge computer includes:
a first processor configured to:
calculate a first feature amount by inputting a first image to a top layer among the plurality of layers of the preceding stage;
identify an area of interest in the first image based on the first feature amount;
generate a second image obtained by masking the area of interest in the first image;
calculate a second feature amount by inputting the second image to the top layer among the plurality of layers of the preceding stage; and
transmit the second feature amount to the cloud computer, and
the cloud computer includes:
a second processor configured to:
infer an object included in the second image by inputting the second feature amount to a top layer among the plurality of layers of the subsequent stage.

### Claim 2 (depends on 1)

The information processing system according to claim 1, wherein
the first feature amount includes a feature map including a plurality of areas for each of which a numerical value that indicates a degree to which a feature of the first image appears is set, and
the first processor is further configured to:
identify, as areas of interest, areas of the first image that correspond to areas of the feature map for which the numerical value equal to or greater than a threshold is set, based on the feature map.

### Claim 3 (depends on 1)

The information processing system according to claim 1, wherein
the first processor is further configured to:
execute processing of adjusting a ratio of the areas of interest to an entire area of the first image to be less than a predetermined ratio.

### Claim 4

An inference method, comprising:
calculating, by a first computer, a first feature amount by inputting a first image to a top layer among the plurality of layers of the preceding stage;
identifying, by the first computer, an area of interest in the first image based on the first feature amount;
generating, by the first computer, a second image obtained by masking the area of interest in the first image;
calculating, by the first computer, a second feature amount by inputting the second image to the top layer among the plurality of layers of the preceding stage;
transmitting, by the first computer, the second feature amount to the cloud computer; and
inferring, by a second computer different from the first computer, an object included in the second image by inputting the second feature amount to a top layer among the plurality of layers of the subsequent stage.

### Claim 5 (depends on 4)

The inference method according to claim 4, wherein
the first feature amount includes a feature map including a plurality of areas for each of which a numerical value that indicates a degree to which a feature of the first image appears is set, and
the method further comprises:
identifying by the first computer, as areas of interest, areas of the first image that correspond to areas of the feature map for which the numerical value equal to or greater than a threshold is set, based on the feature map.

### Claim 6 (depends on 4)

The inference method according to claim 4, further comprising:
executing, by the first computer, processing of adjusting a ratio of the areas of interest to an entire area of the first image to be less than a predetermined ratio.

### Claim 7

A non-transitory computer-readable recording medium storing a program for causing a first computer and a second computer different from the first computer to execute a process, the process comprising:
calculating, by the first computer, a first feature amount by inputting a first image to a top layer among the plurality of layers of the preceding stage;
identifying, by the first computer, an area of interest in the first image based on the first feature amount;
generating, by the first computer, a second image obtained by masking the area of interest in the first image;
calculating, by the first computer, a second feature amount by inputting the second image to the top layer among the plurality of layers of the preceding stage;
transmitting, by the first computer, the second feature amount to the cloud computer; and
inferring, by the second computer, an object included in the second image by inputting the second feature amount to a top layer among the plurality of layers of the subsequent stage.

### Claim 8 (depends on 7)

The non-transitory computer-readable recording medium according to claim 7, wherein
the first feature amount includes a feature map including a plurality of areas for each of which a numerical value that indicates a degree to which a feature of the first image appears is set, and
the process further comprises:
identifying by the first computer, as areas of interest, areas of the first image that correspond to areas of the feature map for which the numerical value equal to or greater than a threshold is set, based on the feature map.

### Claim 9 (depends on 7)

The non-transitory computer-readable recording medium according to claim 7, the process further comprising:
executing, by the first computer, processing of adjusting a ratio of the areas of interest to an entire area of the first image to be less than a predetermined ratio.
