# US 2021/0174099 A1 · Image processing system, image processing device, image processing method and program storage medium

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0174099 A1
- Document ID: US20210174099A1
- Status: Published application
- Kind: A1
- Application number: 16/953,835
- Filed: 2020-11-20
- Published: 2021-06-10
- Earliest claimed: 2019-12-10
- Assignees: Toyota Jidosha Kabushiki Kaisha
- Applicants: Toyota Jidosha Kabushiki Kaisha
- Inventors: Ryota OKUBI
- Web page: https://patentgrep.com/patent/US20210174099A1

## CPC

- G06V 20/58: Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads
- G06T 7/248: {involving reference images or patches}
- G06T 7/70: Determining position or orientation of objects or cameras (camera calibration G06T7/80)
- G06V 20/64: Three-dimensional [3D] objects
- G06T 2207/30261: Obstacle
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

An image processing system includes: a possibility determination unit that determines whether there is a possibility that an obstacle is shown in an image acquired by an image acquisition device of a vehicle; a transmitting unit that transmits, from the vehicle, image information of the acquired image if it has been determined that there is a possibility that an obstacle is shown therein; a receiving unit that receives the image information from vehicles; a processing unit that performs image processing to identify an obstacle shown in the acquired image; and a duplication determination unit that determines whether or not an identified obstacle, which has been identified in a previous acquired image, is shown in a subsequent acquired image received by the receiving unit, wherein the processing unit performs the image processing on the subsequent acquired image if the subsequent acquired image has been determined to not show the identified obstacle.

## Claims

### Claim 1

An image processing system, comprising:
one or more memories; and
one or more processors coupled to the one or more memories, the one or more processors being configured to:
determine whether there is a possibility that an obstacle is shown in an acquired image that is acquired by an image acquisition device provided at a vehicle,
transmit, from the vehicle, image information relating to the acquired image in a case in which the acquired image has been determined that there is a possibility that an obstacle is shown therein,
receive image information from a plurality of vehicles,
determine whether or not an identified obstacle, which has been identified in a previous acquired image associated with previous image information, is shown in a subsequent acquired image associated with subsequent image information received from the plurality of vehicles, and
perform image processing to identify an obstacle shown in the subsequent acquired image in a case in which the subsequent acquired image has been determined to not show the identified obstacle.

### Claim 2 (depends on 1)

The image processing system according to claim 1, wherein the one or more processors are configured to:
receive the image information together with position information attached to the acquired image, and
determine whether or not the identified obstacle is shown in the subsequent acquired image, by determining at least whether or not the identified obstacle is shown in the subsequent acquired image at a same position as in the previous acquired image.

### Claim 3 (depends on 1)

The image processing system according to claim 1, wherein the one or more processors are further configured to:
receive other position information associated with another vehicle,
determine whether the other vehicle having the other position information has approached the identified obstacle corresponding to the position information, and
send hazard information to the other vehicle in a case in which it is determined that the other vehicle has approached the identified obstacle.

### Claim 4

An image processing method, comprising:
determining whether there is a possibility that an obstacle is shown in an acquired image that is acquired by an image acquisition device provided at a vehicle;
transmitting, from the vehicle to a server, image information relating to the acquired image, in a case in which it has been determined that there is a possibility that the acquired image shows an obstacle;
receiving, by the server, image information from a plurality of vehicles;
determining, by the server, whether or not an identified obstacle, which has been identified in a previous acquired image associated with previous image information, is shown in a subsequent acquired image associated with subsequent image information received from the plurality of vehicles; and
performing image processing to identify an obstacle shown in the subsequent acquired image in a case in which the subsequent acquired image has been determined to not show the identified obstacle.

### Claim 5

A non-transitory storage medium storing a program executable by a computer to perform image processing, the image processing comprising:
determining whether there is a possibility that an obstacle is shown in an acquired image that is acquired by an image acquisition device provided at a vehicle;
transmitting, from the vehicle to a server, image information relating to the acquired image in a case in which it has been determined that there is a possibility that the acquired image shows an obstacle;
receiving, by the server, image information from a plurality of vehicles;
determining, by the server, whether or not an identified obstacle, which has been identified in a previous acquired image associated with previous image information, is shown in a subsequent acquired image associated with subsequent image information received from the plurality of vehicles; and
performing image processing to identify an obstacle shown in the subsequent acquired image in a case in which the subsequent acquired image has been determined to not show the identified obstacle.

### Claim 6

An image processing device, comprising:
a memory; and
a processor coupled to the memory, the processor being configured to:
receive, from a plurality of vehicles, image information relating to acquired images, which are acquired by the plurality of vehicles, in which it has been determined that there is a possibility that an obstacle is shown in the acquired images;
determine whether or not an identified obstacle, which has been identified in a previous acquired image associated with previous image information, is shown in a subsequent acquired image associated with subsequent image information received from plurality of vehicles; and
perform image processing to identify an obstacle shown in the subsequent acquired image in a case in which the subsequent acquired image has been determined to not show the identified obstacle.

### Claim 7

An image processing method, comprising:
receiving, from a plurality of vehicles, image information relating to acquired images, which are acquired by the plurality of vehicles, in which it has been determined that there is a possibility that an obstacle is shown in the acquired images;
determining whether or not an identified obstacle, which has been identified in a previous acquired image associated with previous image information, is shown in a subsequent acquired image associated with subsequent image information received from the plurality of vehicles; and
performing image processing to identify an obstacle shown in the subsequent acquired image in a case in which the subsequent acquired image has been determined to not show the identified obstacle.

### Claim 8

A non-transitory storage medium storing a program executable by a computer to perform image processing, the image processing comprising:
receiving, from a plurality of vehicles, image information relating to acquired images, which are acquired by the plurality of vehicles, in which it has been determined that there is a possibility that an obstacle is shown in the acquired images;
determining whether or not an identified obstacle, which has been identified in a previous acquired image associated with previous image information, is shown in a subsequent acquired image associated with subsequent image information received from the plurality of vehicles; and
performing image processing to identify an obstacle shown in the subsequent acquired image, in a case in which the subsequent acquired image has been determined to not show the identified obstacle.
