# US 2022/0036098 A1 · Vehicle sensor data sharing

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2022/0036098 A1
- Document ID: US20220036098A1
- Status: Published application
- Kind: A1
- Application number: 16/944,891
- Filed: 2020-07-31
- Published: 2022-02-03
- Earliest claimed: 2020-07-31
- Assignees: Toyota Motor Engineering & Manufacturing North America, Inc.
- Applicants: Toyota Motor Engineering & Manufacturing North America, Inc.
- Inventors: Bin Cheng; Hongsheng Lu; Rui Guo
- Web page: https://patentgrep.com/patent/US20220036098A1

## CPC

- G06V 10/82: using neural networks
- G06V 20/58: Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads
- G06F 18/25: Fusion techniques
- G06T 5/50: using two or more images, e.g. averaging or subtraction
- G06V 10/803: {of input or preprocessed data}
- G06V 20/56: exterior to a vehicle by using sensors mounted on the vehicle
- G06T 2207/20221: Image fusion; Image merging
- G06T 2207/30204: Marker
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

Two vehicles—an ego vehicle and an other vehicle—can share sensor data in a streamlined manner. One or more sensors can be configured to acquire first environment data of an external environment of the ego vehicle. A data summary based on second environment data of an external environment of the other vehicle can be received. Whether there is a common region of sensor coverage between the ego vehicle and the other vehicle can be determined. In response to there being a common region, the first environment data that is located within the common region can be identified and the resolution level of the identified first environment data can be reduced. The first environment data that has the reduced resolution level and a remainder of the first environment data excluding the identified first environment data can be transmitted to the other vehicle.

## Claims

### Claim 1

A method for sharing sensor data, the method comprising:
acquiring, using one or more sensors of an ego vehicle, first environment data of at least a portion of an external environment of the ego vehicle, the first environment data being at an acquired resolution level;
receiving, from an other vehicle, a data summary based on second environment data of at least a portion of an external environment of the other vehicle;
determining whether there is a common region of sensor coverage of the external environment based on the first environment data and the data summary;
responsive to determining that there is a common region of sensor coverage of the external environment, identifying the first environment data that is located within the common region, the first environment data that is located within the common region being a first portion of the first environment data;
reducing a resolution level of the first portion to a reduced resolution level, the reduced resolution level being lower than the acquired resolution level; and
transmitting, to the other vehicle, the first portion at the reduced resolution level and a second portion of the first environment data, the second portion being a remainder of the first environment data excluding the first portion.

### Claim 2 (depends on 1)

The method of claim 1, wherein transmitting, to the other vehicle, the first portion at the reduced resolution level and the second portion includes transmitting, to the other vehicle, the second portion at the acquired resolution level.

### Claim 3 (depends on 1)

The method of claim 1, wherein reducing the resolution level of the first portion to the reduced resolution level includes downsampling the first portion to the reduced resolution level.

### Claim 4 (depends on 3)

The method of claim 3, wherein reducing the resolution level of the first portion to the reduced resolution level includes compressing the first portion.

### Claim 5 (depends on 1)

The method of claim 1, wherein the data summary includes at least one of:
one or more detected objects; and
information about one or more sensors of the other vehicle.

### Claim 6 (depends on 5)

The method of claim 5, wherein determining whether there is a common region of the sensor coverage of the external environment includes estimating an area of spatial-temporal correlation between the one or more sensors of the ego vehicle and the one or more sensors of the other vehicle.

### Claim 7

A method for sharing sensor data, the method comprising:
acquiring, using one or more sensors of an ego vehicle, first environment data of at least a portion of an external environment of the ego vehicle;
transmitting, by the ego vehicle, a data summary based on the first environment data;
receiving, by the ego vehicle and from an other vehicle, a first portion of second environment data and a second portion of the second environment data, the second environment data being of at least a portion of an external environment of the other vehicle, a resolution level of the first portion being lower than a resolution level of the second portion, the second portion being a remainder of the second environment data excluding the first portion; and
fusing the first portion, the second portion, and the first environment data.

### Claim 8 (depends on 7)

The method of claim 7, wherein the first portion is compressed and further comprising decompressing the first portion.

### Claim 9 (depends on 7)

The method of claim 7, wherein the second portion is compressed and further comprising decompressing the second portion.

### Claim 10 (depends on 7)

The method of claim 7, wherein fusing the first portion, the second portion, and the first environment data includes aligning markers in the first portion and the first environment data.

### Claim 11 (depends on 7)

The method of claim 7, wherein the data summary includes at least one of:
one or more detected objects; and
information about one or more sensors of the ego vehicle.

### Claim 12

A system for sharing sensor data, the system comprising:
one or more sensors, the one or more sensors being configured to acquire first environment data of at least a portion of an external environment of an ego vehicle, the first environment data being at an acquired resolution level;
one or more processors, the one or more processors being programmed to initiate executable operations comprising:
receiving, from an other vehicle, a data summary based on second environment data of at least a portion of an external environment of the other vehicle;
determining whether there is a common region of sensor coverage of the external environment based on the first environment data and the data summary;
responsive to determining that there is a common region of sensor coverage of the external environment, identifying the first environment data that is located within the common region, the first environment data that is located within the common region being a first portion of the first environment data;
reducing a resolution level of the first portion to a reduced resolution level, the reduced resolution level being lower than the acquired resolution level; and
transmitting, to the other vehicle, the first portion at the reduced resolution level and a second portion of the first environment data, the second portion being a remainder of the first environment data excluding the first portion.

### Claim 13 (depends on 12)

The system of claim 12, wherein transmitting, to the other vehicle, the first portion at the reduced resolution level and the second portion includes transmitting, to the other vehicle, the second portion at the acquired resolution level.

### Claim 14 (depends on 12)

The system of claim 12, wherein reducing the resolution level of the first portion to the reduced resolution level includes downsampling the first portion to the reduced resolution level.

### Claim 15 (depends on 12)

The system of claim 12, wherein reducing the resolution level of the first portion to the reduced resolution level includes compressing the first portion.

### Claim 16 (depends on 12)

The system of claim 12, wherein determining whether there is a common region of the sensor coverage of the external environment includes estimating an area of spatial-temporal correlation between the one or more sensors of the ego vehicle and the one or more sensors of the other vehicle.

### Claim 17

A system for sharing sensor data, the system comprising:
one or more sensors, the one or more sensors being configured to acquire first environment data of at least a portion of an external environment of an ego vehicle;
one or more processors, the one or more processors being programmed to initiate executable operations comprising:
transmitting, by the ego vehicle, a data summary based on the first environment data;
receiving, by the ego vehicle and from an other vehicle, a first portion of second environment data and a second portion of the second environment data, the second environment data being of at least a portion of an external environment of the other vehicle, a resolution level of the first portion being lower than a resolution level of the second portion, the second portion being a remainder of the second environment data excluding the first portion; and
fusing the first portion, the second portion, and the first environment data.

### Claim 18 (depends on 17)

The system of claim 17, wherein the first portion is compressed and further comprising decompressing the first portion.

### Claim 19 (depends on 17)

The system of claim 17, wherein the second portion is compressed and further comprising decompressing the second portion.

### Claim 20 (depends on 17)

The system of claim 17, wherein fusing the first portion, the second portion, and the first environment data includes aligning markers in the first portion and the first environment data.
