# US 2026/0063775 A1 · Automatic calibration method between camera and lidar, and computer program recorded on record-medium to execute the same

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2026/0063775 A1
- Document ID: US20260063775A1
- Status: Published application
- Kind: A1
- Application number: 19/289,930
- Filed: 2025-08-04
- Published: 2026-03-05
- Earliest claimed: 2024-09-03
- Assignees: Mobiltech
- Applicants: Mobiltech
- Inventors: Jae Seung KIM; Gil Hyeon GIM; Sang Hun HAN; Seung Jin PACK
- Web page: https://patentgrep.com/patent/US20260063775A1

## CPC

- G01S 7/497: Means for monitoring or calibrating
- G01S 7/4972: {Alignment of sensor}
- G01S 17/86: Combinations of lidar systems with systems other than lidar, radar or sonar, e.g. with direction finders
- G01S 17/89: for mapping or imaging
- G01S 17/894: Three-dimensional [3D] imaging with simultaneous measurement of time-of-flight at a two-dimensional [2D] array of receiver pixels, e.g. time-of-flight cameras or flash lidar
- G06T 7/11: Region-based segmentation
- G06T 7/77: using statistical methods
- G06T 7/80: Analysis of captured images to determine intrinsic or extrinsic camera parameters, i.e. camera calibration
- G06T 2207/10028: Range image; Depth image; 3D point clouds
- G06T 2207/30208: Marker matrix
- G01S: RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

The present invention proposes a method for automatically performing calibration between a camera and a LiDAR using a calibration board. The method may include: detecting flat regions corresponding to the calibration board from each of two or more point cloud data acquired by a LiDAR; identifying regions corresponding to the calibration board from each of two or more images captured by a camera at the time the respective point cloud data was acquired, and matching the identified regions with the flat regions for estimating initial positions of the calibration board in three-dimensional coordinates; registering coordinates of the initial positions of the calibration board with coordinates of the flat regions; and determining a pose of the camera based on the registered coordinates.

## Claims

### Claim 1

A method of performing calibration, the method comprising:
detecting, with respect to a calibration board, a flat region corresponding to the calibration board from each of two or more point cloud data obtained by LiDAR;
identifying a region corresponding to the calibration board from each of two or more images captured by a camera at respective acquisition time points of the point cloud data;
estimating an initial position of the calibration board in three-dimensional coordinates by matching the region corresponding to the calibration board with the flat region;
registering coordinates of the initial position of the calibration board with coordinates of the flat region; and
determining a pose of the camera based on the registered coordinates;
wherein estimating the initial position of the calibration board comprises:
rotating the region corresponding to the calibration board in three-dimensional space by aligning the region corresponding to the calibration board with the flat region;
calculating a center of gravity of the flat region by using a state in which the region corresponding to the calibration board is rotated to maximally overlap with the flat region; and
estimating the initial position of the calibration board by using the calculated center of gravity;
wherein registering the coordinates comprises:
registering the coordinates of the initial position of the calibration board with the coordinates of the flat region by using an Iterative Closest Point (ICP) algorithm; and
registering, selectively, four coordinates corresponding to corners of the calibration board with four coordinates corresponding to corners of the flat region among the coordinates of the initial position of the calibration board;
wherein determining the pose of the camera comprises:
calculating a rotation matrix and a translation matrix of the camera by using only the four registered coordinates.

### Claim 2 (depends on 1)

The method of claim 1,
wherein the LiDAR acquires the point cloud data, with respect to the calibration board whose position changes sequentially over time, while the LiDAR remains in a fixed position;
wherein the camera captures the images, with respect to the calibration board whose position changes sequentially over time, while the camera remains in a fixed position;
wherein the point cloud data and the images construct a single data set based on a time point at which point cloud data is acquired by the LiDAR and images are captured by the camera.

### Claim 3 (depends on 2)

The method of claim 2, wherein detecting the flat region comprises:
selecting each of the two or more point cloud data from two or more datasets constructed at different time points among a plurality of consecutively configured datasets in time series.

### Claim 4 (depends on 3)

The method of claim 3, wherein detecting the flat region comprises:
selecting only the point cloud data acquired simultaneously with the image in which the calibration board does not exhibit motion blur.

### Claim 5 (depends on 1)

The method of claim 1, wherein detecting the flat region comprises:
detecting each flat region by performing a Boolean operation between the two or more point cloud data.

### Claim 6 (depends on 5)

The method of claim 5, wherein detecting the flat region comprises:
detecting only coordinates corresponding to the flat region by performing Random Sample Consensus (RANSAC) on a result of the Boolean operation.

### Claim 7 (depends on 1)

The method of claim 1, wherein estimating the initial position of the calibration board comprises:
rotating the region corresponding to the calibration board by varying roll, pitch, and yaw angles from 1 degree to 360 degrees so that the region overlaps maximally with the flat region.

### Claim 8 (depends on 1)

The method of claim 1, wherein registering the coordinates comprises:
calculating an error rate between the four coordinates corresponding to corners of the calibration board and the four coordinates corresponding to corners of the flat region during registration using only the four corner coordinates; and
registering the coordinates of the initial position of the calibration board with the coordinates of the flat region when the error rate exceeds a predefined threshold.

### Claim 9

A map generation device for performing calibration, the map generation device comprising:
a memory;
a transceiver; and
a processor configured to execute instructions stored in the memory,
wherein the processor is configured to:
detect, with respect to a calibration board, a flat region corresponding to the calibration board from each of two or more point cloud data obtained by LiDAR;
identify a region corresponding to the calibration board from each of two or more images captured by a camera at respective acquisition time points of the point cloud data;
estimate an initial position of the calibration board in three-dimensional coordinates by matching the region corresponding to the calibration board with the flat region;
register coordinates of the initial position of the calibration board with coordinates of the flat region; and
determine a pose of the camera based on the registered coordinates;
wherein estimating the initial position of the calibration board comprises:
rotate the region corresponding to the calibration board in three-dimensional space by aligning the region corresponding to the calibration board with the flat region;
calculate a center of gravity of the flat region by using a state in which the region corresponding to the calibration board is rotated to maximally overlap with the flat region; and
estimate the initial position of the calibration board by using the calculated center of gravity;
wherein registering the coordinates comprises:
register the coordinates of the initial position of the calibration board with the coordinates of the flat region by using an Iterative Closest Point (ICP) algorithm; and
register, selectively, four coordinates corresponding to corners of the calibration board with four coordinates corresponding to corners of the flat region among the coordinates of the initial position of the calibration board;
wherein determining the pose of the camera comprises:
calculating a rotation matrix and a translation matrix of the camera by using only the four registered coordinates.

### Claim 10 (depends on 9)

The map generation device of claim 9,
wherein the LiDAR acquires the point cloud data, with respect to the calibration board whose position changes sequentially over time, while the LiDAR remains in a fixed position;
wherein the camera captures the images, with respect to the calibration board whose position changes sequentially over time, while the camera remains in a fixed position;
wherein the point cloud data and the images construct a single data set based on a time point at which point cloud data is acquired by the LiDAR and images are captured by the camera.
