# US 2022/0284700 A1 · Task appropriateness determination apparatus

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2022/0284700 A1
- Document ID: US20220284700A1
- Status: Published application
- Kind: A1
- Application number: 17/675,711
- Filed: 2022-02-18
- Published: 2022-09-08
- Earliest claimed: 2021-03-04
- Assignees: Subaru Corporation
- Applicants: Subaru Corporation
- Inventors: Shinichirou OKINO; Tomoki HOSOTANI; Tomohiro KIRA
- Web page: https://patentgrep.com/patent/US20220284700A1

## CPC

- G06V 10/7753: {Incorporation of unlabelled data, e.g. multiple instance learning [MIL]}
- G06Q 10/063114: {Status monitoring or status determination for a person or group}
- G06Q 50/04: Manufacturing
- G06V 10/25: Determination of region of interest [ROI] or a volume of interest [VOI]
- G06V 20/64: Three-dimensional [3D] objects
- G06V 20/70: Labelling scene content, e.g. deriving syntactic or semantic representations
- G06V 40/10: Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V 40/28: {Recognition of hand or arm movements, e.g. recognition of deaf sign language (static hand signs G06V40/113)}
- G08B 7/06: using electric transmission {, e.g. involving audible and visible signalling through the use of sound and light sources}
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G08B: SIGNALLING SYSTEMS, e.g. PERSONAL CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS

## Abstract

A task appropriateness determination apparatus includes a first learning unit causing artificial intelligence (AI) to learn image information of an index indicating a target object in a task appropriately completed state, an appropriate image provider providing an image possibly including the target object in the appropriately completed state and the index, a second learning unit causing the AI to detect an image where the index is present from the provided image after learning of the index, and learn image information of the target object in the image where the index is present, an image capturing unit capturing an image of a region including the target object and the index at least after the task, and a task appropriateness determiner determining that the task has been appropriately performed in response to detection by the AI of the target object roughly identical to the learned target object in the appropriately completed state.

## Claims

### Claim 1

A task appropriateness determination apparatus configured to cause artificial intelligence to learn an image of a target object in an appropriately completed state in which a task has been appropriately completed, and, in response to detection of an image of the target object that is roughly identical to the learned image of the target object in the appropriately completed state, determine that the task has been appropriately performed, the task appropriateness determination apparatus comprising:
a first learning unit configured to cause the artificial intelligence to learn image information of an index indicating presence of the target object in the appropriately completed state;
an appropriate image provider configured to provide an image possibly including an image of the target object in the appropriately completed state and an image of the index;
a second learning unit configured to cause the artificial intelligence to detect an image in which the image information of the index is present from the image provided by the appropriate image provider after learning of the index by the first learning unit, and to cause the artificial intelligence to learn image information of the target object in the image in which the index is present;
an image capturing unit configured to capture an image of a region including the target object and the index at least after the task; and
a task appropriateness determiner configured to determine that the task has been appropriately performed in response to detection by the artificial intelligence of the image information of the target object in which the target object in the image captured by the image capturing unit is roughly identical to the pre-learned image information of the target object in the appropriately completed state.

### Claim 2 (depends on 1)

The task appropriateness determination apparatus according to claim 1, wherein the first learning unit causes the artificial intelligence to learn the image information of the index from the image provided by the appropriate image provider.

### Claim 3 (depends on 2)

The task appropriateness determination apparatus according to claim 2, wherein
the first learning unit causes the artificial intelligence to learn a certain region where there is the image information of the index in the image provided by the appropriate image provider or a certain region near the image information of the index, and
the second learning unit causes the artificial intelligence to learn the image information of the target object in the certain region of the image in which the index is present.

### Claim 4 (depends on 3)

The task appropriateness determination apparatus according to claim 3, wherein
the task appropriateness determiner is configured to cause the artificial intelligence to detect a captured image of the image information of the index from the image captured by the image capturing unit, and, in response to detection by the artificial intelligence of the image information of the target object that is roughly identical to the learned target object in the appropriately completed state in the certain region of the captured image of the index, determine that the task has been appropriately performed.

### Claim 5 (depends on 4)

The task appropriateness determination apparatus according to claim 4, wherein the task appropriateness determiner comprises a reporting unit that, in a case where the task has been performed inappropriately, reports that the task has been performed inappropriately.

### Claim 6

A task appropriateness determination apparatus configured to cause artificial intelligence to learn an image of a target object in an appropriately completed state in which a task has been appropriately completed, and, in response to detection of an image of the target object that is roughly identical to the learned image of the target object in the appropriately completed state, determine that the task has been appropriately performed, the task appropriateness determination apparatus comprising:
circuitry configured to
cause the artificial intelligence to learn image information of an index indicating presence of the target object in the appropriately completed state,
provide an image possibly including an image of the target object in the appropriately completed state and an image of the index,
cause the artificial intelligence to detect an image in which the image information of the index is present from the provided image after learning of the index, and cause the artificial intelligence to learn image information of the target object in the image in which the index is present,
capture an image of a region including the target object and the index at least after the task, and
determine that the task has been appropriately performed in response to detection by the artificial intelligence of the image information of the target object in which the target object in the captured image is roughly identical to the pre-learned image information of the target object in the appropriately completed state.
