# US 2021/0173393 A1 · System and method for coordinating landmark based collaborative sensor calibration

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0173393 A1
- Document ID: US20210173393A1
- Status: Published application
- Kind: A1
- Application number: 16/707,731
- Filed: 2019-12-09
- Published: 2021-06-10
- Earliest claimed: 2019-12-09
- Assignees: PlusAI, Inc.
- Applicants: Plusai Corp
- Inventors: Ankur Agarwal
- Web page: https://patentgrep.com/patent/US20210173393A1

## CPC

- G05D 1/0055: {with safety arrangements}
- G06T 7/85: {Stereo camera calibration}
- B60W 50/00: Details of control systems for road vehicle drive control not related to the control of a particular sub-unit {, e.g. process diagnostic or vehicle driver interfaces}
- G01S 7/40: Means for monitoring or calibrating
- G01S 7/4972: {Alignment of sensor}
- G01S 13/86: Combinations of radar systems with non-radar systems, e.g. sonar, direction finder
- G01S 13/931: of land vehicles
- G01S 17/86: Combinations of lidar systems with systems other than lidar, radar or sonar, e.g. with direction finders
- G01S 17/931: of land vehicles
- G05D 1/0088: {characterized by the autonomous decision making process, e.g. artificial intelligence, predefined behaviours (using knowledge based models G06N5/00)}
- G05D 1/0293: {Convoy travelling}
- G08G 1/127: to a central station {; Indicators in a central station}
- G08G 1/166: {for active traffic, e.g. moving vehicles, pedestrians, bikes}
- G08G 1/205: {Indicating the location of the monitored vehicles as destination, e.g. accidents, stolen, rental}
- B60W 2050/0083: {Setting, resetting, calibration}
- G06T 2207/10021: Stereoscopic video; Stereoscopic image sequence
- G06T 2207/10028: Range image; Depth image; 3D point clouds
- G06T 2207/30261: Obstacle
- G05D: SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- B60W: CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- G01S: RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G08G: TRAFFIC CONTROL SYSTEMS (guiding railway traffic, ensuring the safety of railway traffic B61L; arrangement of road signs or traffic signals E01F9/00; radar or analogous systems, sonar systems, lidar systems specially adapted for traffic control G01S13/91, G01S15/88, G01S17/88; {radar or analogous systems, sonar systems, lidar systems specially adapted for anti-collision purposes G01S13/93, G01S15/93, G01S17/93})

## Abstract

The present teaching relates to method, system, medium, and implementations for sensor calibration. A request is received from an ego vehicle in motion on a route for assistance in collaborative calibration of a sensor deployed on the ego vehicle. The request specifies a position of the ego vehicle and a configuration of the sensor with respect to the ego vehicle. A collaborative means along the route is identified based on the ego vehicle's position, the configuration of the sensor, the route, and the position associated with the collaborative means. A calibration assistance package is generated in response to the request and sent to the ego vehicle. The calibration assistance package includes information about the collaborative means that can be used to identify the collaborative means while in motion along the route for calibrating the sensor while the ego vehicle is in the vicinity of the collaborative means.

## Claims

### Claim 1

A method implemented on at least one machine including at least one processor, memory, and communication platform capable of connecting to a network for sensor calibration, the method comprising:
receiving a request, from an ego vehicle in motion on a route, for assistance in collaborative calibration of a sensor deployed on the ego vehicle, wherein the request includes at least one of a first position of the ego vehicle and a first configuration of the sensor with respect to the ego vehicle;
identifying a collaborative means along the route based on the first position, the first configuration, the route, and a second position associated with the collaborative means;
generating a calibration assistance package in response to the request, wherein the calibration assistance package includes information associated with the collaborative means that can be used by the ego vehicle to facilitate the calibration of the sensor;
sending the calibration assistance package to the ego vehicle so that the information associated with the collaborative means is to be used by the ego vehicle to identify the collaborative means while in motion along the route for calibrating the sensor while the ego vehicle is in the vicinity of the collaborative means.

### Claim 2 (depends on 1)

The method of claim 1, wherein the collaborative means is an object visible from the sensor when the ego vehicle is in the vicinity.

### Claim 3 (depends on 2)

The method of claim 2, wherein the object includes one of a billboard, a building, and a structure located on a side of the route.

### Claim 4 (depends on 3)

The method of claim 3, wherein the side is determined based on the first configuration of the sensor which specifies a position of the sensor with respect to the ego vehicle.

### Claim 5 (depends on 2)

The method of claim 2, wherein the calibration assistance package includes further information defining the vicinity which corresponds to an operable range between the ego vehicle and the collaborative means.

### Claim 6 (depends on 2)

The method of claim 2, wherein the collaborative means includes a target present thereon and positioned in such a way that it is visible by the sensor when the ego vehicle is within the vicinity.

### Claim 7 (depends on 6)

The method of claim 6, wherein the target includes features that are to be identified by the ego vehicle from information captured by the sensor from the target and are used to calibrate the sensor.

### Claim 8

Machine readable and non-transitory medium having information recorded thereon for sensor calibration, wherein the information, when read by the machine, causes the machine to perform:
receiving a request, from an ego vehicle in motion on a route, for assistance in collaborative calibration of a sensor deployed on the ego vehicle, wherein the request includes at least one of a first position of the ego vehicle and a first configuration of the sensor with respect to the ego vehicle;
identifying a collaborative means along the route based on the first position, the first configuration, the route, and a second position associated with the collaborative means;
generating a calibration assistance package in response to the request, wherein the calibration assistance package includes information associated with the collaborative means that can be used by the ego vehicle to facilitate the calibration of the sensor;
sending the calibration assistance package to the ego vehicle so that the information associated with the collaborative means is to be used by the ego vehicle to identify the collaborative means while in motion along the route for calibrating the sensor while the ego vehicle is in the vicinity of the collaborative means.

### Claim 9 (depends on 8)

The medium of claim 8, wherein the collaborative means is an object visible from the sensor when the ego vehicle is in the vicinity.

### Claim 10 (depends on 9)

The medium of claim 9, wherein the object includes one of a billboard, a building, and a structure located on a side of the route.

### Claim 11 (depends on 10)

The medium of claim 10, wherein the side is determined based on the first configuration of the sensor which specifies a position of the sensor with respect to the ego vehicle.

### Claim 12 (depends on 9)

The medium of claim 9, wherein the calibration assistance package includes further information defining the vicinity which corresponds to an operable range between the ego vehicle and the collaborative means.

### Claim 13 (depends on 9)

The medium of claim 9, wherein the collaborative means includes a target present thereon and positioned in such a way that it is visible by the sensor when the ego vehicle is within the vicinity.

### Claim 14 (depends on 13)

The medium of claim 13, wherein the target includes features that are to be identified by the ego vehicle from information captured by the sensor from the target and are used to calibrate the sensor.

### Claim 15

A system for sensor calibration, comprising:
a calibration assistant selector configured for receiving a request, from an ego vehicle in motion on a route, for assistance in collaborative calibration of a sensor deployed on the ego vehicle, wherein the request includes at least one of a first position of the ego vehicle and a first configuration of the sensor with respect to the ego vehicle;
a landmark assistant selector configured for identifying a collaborative means along the route based on the first position, the first configuration, the route, and a second position associated with the collaborative means;
an assistant package generator configured for generating a calibration assistance package in response to the request, wherein the calibration assistance package includes information associated with the collaborative means that can be used by the ego vehicle to facilitate the calibration of the sensor; and
a vehicle communication unit configured for sending the calibration assistance package to the ego vehicle so that the information associated with the collaborative means is to be used by the ego vehicle to identify the collaborative means while in motion along the route for calibrating the sensor while the ego vehicle is in the vicinity of the collaborative means.

### Claim 16 (depends on 15)

The system of claim 15, wherein the collaborative means is an object visible from the sensor when the ego vehicle is in the vicinity.

### Claim 17 (depends on 16)

The system of claim 16, wherein the object includes one of a billboard, a building, and a structure located on a side of the route.

### Claim 18 (depends on 17)

The system of claim 17, wherein the side is determined based on the first configuration of the sensor which specifies a position of the sensor with respect to the ego vehicle.

### Claim 19 (depends on 16)

The system of claim 16, wherein the calibration assistance package includes further information defining the vicinity which corresponds to an operable range between the ego vehicle and the collaborative means.

### Claim 20 (depends on 16)

The system of claim 16, wherein the collaborative means includes a target present thereon and positioned in such a way that it is visible by the sensor when the ego vehicle is within the vicinity.

### Claim 21 (depends on 20)

The system of claim 20, wherein the target includes features that are to be identified by the ego vehicle from information captured by the sensor from the target and are used to calibrate the sensor.
