# US 2021/0239793 A1 · High precision multi-sensor extrinsic calibration via production line and mobile station

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0239793 A1
- Document ID: US20210239793A1
- Status: Published application
- Kind: A1
- Application number: 16/780,122
- Filed: 2020-02-03
- Published: 2021-08-05
- Earliest claimed: 2020-02-03
- Assignees: NIO USA, Inc.
- Applicants: NIO USA, Inc.
- Inventors: Hiu Hong Yu; Zhenxiang Jian; Tong Lin; Xu Chen; Zhongkui Wang; Antonio Antonellis Rufo; Waylon Chen
- Web page: https://patentgrep.com/patent/US20210239793A1

## CPC

- G01S 7/40: Means for monitoring or calibrating
- G01S 7/4026: {Antenna boresight}
- G01S 7/4086: {in a calibrating environment, e.g. anechoic chamber}
- G01S 7/4972: {Alignment of sensor}
- G01S 13/865: {Combination of radar systems with lidar systems}
- G01S 13/867: {Combination of radar systems with cameras}
- G01S 13/931: of land vehicles
- G01S 17/86: Combinations of lidar systems with systems other than lidar, radar or sonar, e.g. with direction finders
- G01S 17/89: for mapping or imaging
- G01S 17/931: of land vehicles
- G01S: RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES

## Abstract

A calibration system for multi-sensor extrinsic calibration in a vehicle includes one or more calibration targets provided around an external environment within a threshold distance of the vehicle. Each of the one or more calibration targets includes a combination of sensor targets configured to be measured by and used for calibrating a pair of sensors selected from the group consisting of a first sensor, a second sensor or a third sensor. The system also includes a vehicle placement section configured to accommodate the vehicle on the vehicle placement section for detection of the one or more calibration targets.

## Claims

### Claim 1

A method for providing multi-sensor extrinsic calibration in a vehicle, the method comprising:
providing the vehicle within an extrinsic calibration station with one or more calibration targets;
receiving, by a processor of a control system of the vehicle, sensor data from a first sensor and sensor data from a second sensor of the vehicle, the sensor data comprising a first representation of the one or more calibration targets and a second representation of the one or more calibration targets;
detecting, by the processor, the one or more calibration targets based on the received inputs from the first and second sensors;
constructing, by the processor, a first plurality of reconstructed calibration targets in a three-dimensional space around the vehicle based on the one or more calibration targets detected based on the input from the first sensor and a second plurality of reconstructed calibration targets in the three-dimensional space around the vehicle based on the one or more calibration targets detected based on the input from the second sensor;
matching, by the processor, one or more reconstructed calibration targets in the first plurality of reconstructed calibration targets with one or more reconstructed calibration targets in the second plurality of reconstructed calibration targets;
computing, by the processor, a six-degree of freedom rigid body transformation of the first sensor and the second sensor based on the matched one or more reconstructed targets; and
computing, by the processor, a projection of the first sensor to the second sensor based on the computed six-degree of freedom rigid body transformation of the first sensor and the second sensor based on the matched one or more reconstructed calibration targets.

### Claim 2 (depends on 1)

The method of claim 1, wherein providing the vehicle within an extrinsic calibration station with the one or more calibration targets includes securing the vehicle to be stationary and rotating the one or more calibration targets into one or more predetermined locations relative to the vehicle such that the one or more calibration targets are provided around an external environment within a threshold distance of the vehicle.

### Claim 3 (depends on 2)

The method of claim 2, wherein the one or more calibration targets are provided at a fixed location with respect to a reference point of the vehicle.

### Claim 4 (depends on 1)

The method of claim 1, wherein providing the vehicle within an extrinsic calibration station with the one or more calibration targets includes aligning the vehicle on a platform and rotating the vehicle into one or more predetermined locations relative to fixed locations of the one or more calibration targets provided around an external environment within a threshold distance of the vehicle.

### Claim 5 (depends on 4)

The method of claim 4, wherein a vehicle aligned system is integrated onto the platform.

### Claim 6 (depends on 4)

The method of claim 4, wherein the one or more calibration targets vary in height and orientation.

### Claim 7 (depends on 1)

The method of claim 1, wherein the first sensor includes a LiDAR sensor, a camera sensor or a RADAR sensor and the second sensor includes a remainder of the LiDAR sensor, camera sensor or RADAR sensor not selected as the first sensor.

### Claim 8

A calibration station for multi-sensor extrinsic calibration in a vehicle, comprising:
one or more calibration targets provided around an external environment within a threshold distance of the vehicle; and
a vehicle placement section to accommodate the vehicle on the vehicle placement section,
wherein a processor of a control system of the vehicle
receives sensor data from a first sensor and sensor data from a second sensor of the vehicle, the sensor data comprising a first representation of the one or more calibration targets and a second representation of the one or more calibration targets;
detects the one or more calibration targets based on the received inputs from the first and second sensors;
constructs a first plurality of reconstructed calibration targets in a three-dimensional space around the vehicle based on the one or more calibration targets detected based on the input from the first sensor and a second plurality of reconstructed calibration targets in the three-dimensional space around the vehicle based on the one or more calibration targets detected based on the input from the second sensor;
matches one or more reconstructed calibration targets in the first plurality of reconstructed calibration targets with one or more reconstructed calibration targets in the second plurality of reconstructed calibration targets;
computes a six-degree of freedom rigid body transformation of the first sensor and the second sensor based on the matched one or more reconstructed targets; and
computes a projection of the first sensor to the second sensor based on the computed six-degree of freedom rigid body transformation of the first sensor and the second sensor based on the matched one or more reconstructed calibration targets.

### Claim 9 (depends on 8)

The calibration station of claim 8, wherein the vehicle placement section secures the vehicle to be stationary within the station and rotates the one or more calibration targets into one or more predetermined locations relative to the vehicle.

### Claim 10 (depends on 8)

The calibration station of claim 8, wherein the one or more calibration targets are provided at a fixed location with respect to a reference point of the vehicle.

### Claim 11 (depends on 8)

The calibration station of claim 8, wherein the vehicle placement section is provided to align the vehicle on a platform and the platform causes the vehicle to rotate into one or more predetermined locations relative to fixed locations of the one or more calibration targets.

### Claim 12 (depends on 11)

The calibration station of claim 11, wherein the vehicle placement section is integrated onto the platform.

### Claim 13 (depends on 8)

The calibration station of claim 8, wherein the one or more calibration targets vary in height and orientation.

### Claim 14 (depends on 8)

The calibration station of claim 8, wherein the first sensor includes a LiDAR sensor, a camera sensor or a RADAR sensor and the second sensor includes a remainder of the LiDAR sensor, camera sensor or RADAR sensor not selected as the first sensor.

### Claim 15

A calibration system for multi-sensor extrinsic calibration in a vehicle, comprising:
one or more calibration targets provided around an external environment within a threshold distance of the vehicle,
wherein each of the one or more calibration targets includes a combination of sensor targets configured to be measured by and used for calibrating a pair of sensors selected from the group consisting essentially of a first sensor, a second sensor, a third sensor, and combinations thereof; and
a vehicle placement section to accommodate the vehicle for detection of the one or more calibration targets.

### Claim 16 (depends on 15)

The calibration system of claim 15, wherein the vehicle placement section secures the vehicle to be stationary and rotates the one or more calibration targets into one or more predetermined locations relative to the vehicle.

### Claim 17 (depends on 15)

The calibration system of claim 15, wherein the one or more calibration targets are provided at a fixed location with respect to a reference point of the vehicle.

### Claim 18 (depends on 15)

The calibration system of claim 15, wherein the vehicle placement section is provided to align the vehicle on a platform and the platform causes the vehicle to rotate into one or more predetermined locations relative to fixed locations of the one or more calibration targets.

### Claim 19 (depends on 19)

The calibration system of claim 19, wherein the vehicle placement section is integrated onto the platform.

### Claim 20 (depends on 15)

The calibration system of claim 15, wherein the one or more calibration targets vary in height and orientation.
