# US 2022/0276359 A1 · Method for determining extrinsic calibration parameters for a measuring system

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2022/0276359 A1
- Document ID: US20220276359A1
- Status: Published application
- Kind: A1
- Application number: 17/597,686
- Filed: 2020-07-03
- Published: 2022-09-01
- Earliest claimed: 2019-07-16
- Assignees: Yellowscan; Universite de Montpellie; Centre National De La Recherche Scientifique
- Applicants: Centre National de la Recherche Scientifique; YellowScan; Université de Montpellier
- Inventors: Quentin Pentex; Tristan Allouis; Christophe Fiorio; Olivier Strauss
- Web page: https://patentgrep.com/patent/US20220276359A1

## CPC

- G01S 7/497: Means for monitoring or calibrating
- G01S 17/86: Combinations of lidar systems with systems other than lidar, radar or sonar, e.g. with direction finders
- G01S 17/88: Lidar systems specially adapted for specific applications
- G01S 17/89: for mapping or imaging
- G06T 7/55: from multiple images
- G06T 7/80: Analysis of captured images to determine intrinsic or extrinsic camera parameters, i.e. camera calibration
- H04N 17/002: {for television cameras}
- G06T 2207/10028: Range image; Depth image; 3D point clouds
- G01S: RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

A method for calibrating a measuring system, the system comprising an image capture device, a laser scanner, and a positioning unit, wherein the method comprises preparing at least two images supplied by the image capture device and preparing a 3D point cloud; identifying at least one homologous point in the images and performing an optimization sequence for determining at least one calibration parameter of the measuring system. The sequence comprises at least one iteration of the following steps: *for each image, identifying, in the 3D point cloud, at least one close point projecting in a neighborhood of the homologous point of the image; *performing a measurement of the distance separating the close points respectively associated with the images; *and adjusting the calibration parameter according to the measurement performed.

## Claims

### Claim 1

A method for calibrating a measuring system including an image capture device, a laser scanner, and a positioning unit, the method comprising:
preparing at least two images provided by the image capture device, the images representing at least one common scene captured from different points of view, and preparing a 3D point cloud of the common scene created using the data provided by the laser scanner and by the positioning unit;
identifying at least one homologous point in the images, the homologous point corresponding to the same point of the common scene; and
performing an optimization sequence for determining at least one calibration parameter, the optimization sequence comprising at least one iteration of the following steps:
for each image, identifying, in the 3D point cloud, at least one close point that projects into a neighborhood of the homologous point of the image;
establishing a measurement of the distance separating the close points associated with the homologous point of the images; and
adjusting the calibration parameter according to the established measurement.

### Claim 2 (depends on 1)

The method of claim 1, wherein an estimated value of the calibration parameter is used during a first iteration of the optimization sequence.

### Claim 3 (depends on 1)

The method of claim 1, wherein the calibration parameter is a calibration parameter of the scanner device provided with respect to the positioning unit and for which the calibration parameter to be determined is a rotation matrix and/or a translation vector connecting a frame of reference associated with the image capture device to a frame of reference associated with the positioning unit.

### Claim 4 (depends on 1)

The method of claim 1, wherein the calibration parameter is a rotation matrix and/or a translation vector connecting a frame of reference associated with the image capture device to a frame of reference associated with the laser scanner.

### Claim 5 (depends on 1)

The method of claim 1, wherein the two images were are acquired while the measuring system completes a trajectory comprising an outward portion and a return portion that correspond to one another.

### Claim 6 (depends on 1)

The method of claim 1, wherein the preparation of the images comprises determining the location and the attitude of the measuring system at a capture moment of each image.

### Claim 7 (depends on 1)

The method of claim 1, wherein the step of identifying at least one homologous point comprises determining characteristic points and characteristic point descriptors.

### Claim 8 (depends on 1)

The method of claim 1, wherein the optimization sequence uses a simplex method, a gradient method, or a stochastic method.

### Claim 9 (depends on 1)

The method of claim 1, wherein the at least one close point that projects into the neighborhood of the homologous point is identified by selecting, from the 3D point cloud, the point projecting closest to the homologous point.

### Claim 10 (depends on 1)

The method of claim 1, wherein the at least one close point that projects into the neighborhood of the homologous point is identified by selecting, from the 3D point cloud, the points projecting in a perimeter of R pixels around the homologous point.

### Claim 11 (depends on 1)

The method of claim 1, wherein the measurement of the distance is established using a barycenter calculation of the close points associated with each image.

### Claim 12 (depends on 1)

The method of claim 1, wherein the measurement of the distance is established using a calculation of the Hausdorff distance between the close points of the images.

### Claim 13 (depends on 2)

The method of claim 2, wherein the calibration parameter is a calibration parameter of the scanner device provided with respect to the positioning unit and for which the calibration parameter to be determined is a rotation matrix and/or a translation vector connecting a frame of reference associated with the image capture device to a frame of reference associated with the positioning unit.

### Claim 14 (depends on 2)

The method of claim 2, wherein the calibration parameter is a rotation matrix and/or a translation vector connecting a frame of reference associated with the image capture device to a frame of reference associated with the laser scanner.

### Claim 15 (depends on 2)

The method of claim 2, wherein the two images are acquired while the measuring system completes a trajectory comprising an outward portion and a return portion that correspond to one another.

### Claim 16 (depends on 15)

The method of claim 15, wherein the preparation of the images comprises determining the location and the attitude of the measuring system at a capture moment of each image.

### Claim 17 (depends on 16)

The method of claim 16, wherein the step of identifying at least one homologous point comprises determining characteristic points and characteristic point descriptors.

### Claim 18 (depends on 17)

The method of claim 17, wherein the optimization sequence uses a simplex method, a gradient method, or a stochastic method.

### Claim 19 (depends on 18)

The method of claim 18, wherein the measurement of the distance is established using a barycenter calculation of the close points associated with each image.

### Claim 20 (depends on 18)

The method of claim 18, wherein the measurement of the distance is established using a calculation of the Hausdorff distance between the close points of the images.
