# US 2020/0402244 A1 · Method and apparatus for registering three-dimensional point clouds

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2020/0402244 A1
- Document ID: US20200402244A1
- Status: Published application
- Kind: A1
- Application number: 16/445,786
- Filed: 2019-06-19
- Published: 2020-12-24
- Earliest claimed: 2019-06-19
- Assignees: Faro Technologies, Inc.
- Applicants: FARO Technologies, Inc.
- Inventors: Daniel Flohr
- Web page: https://patentgrep.com/patent/US20200402244A1

## CPC

- G01S 7/4808: {Evaluating distance, position or velocity data}
- G06T 7/33: using feature-based methods
- G01C 11/14: with optical projection (G01C11/26 takes precedence)
- G01S 17/86: Combinations of lidar systems with systems other than lidar, radar or sonar, e.g. with direction finders
- G01S 17/87: Combinations of systems using electromagnetic waves other than radio waves
- G01S 17/89: for mapping or imaging
- H04N 13/156: Mixing image signals
- H04N 13/254: in combination with electromagnetic radiation sources for illuminating objects
- G06T 2207/10028: Range image; Depth image; 3D point clouds
- G01S: RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G01C: MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY (measuring liquid level G01F; radio navigation, determining distance or velocity by use of propagation effects, e.g. Doppler effects, propagation time, of radio waves, analogous arrangements using other waves G01S)
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

A method of registering three-dimensional (3D) point clouds may include obtaining a first 3D point cloud acquired at a first location; obtaining a second 3D point cloud acquired at a second location; calculating a first normal vector for each point of the first 3D point cloud to create a plurality of normal vectors; calculating, for each point of the first 3D point cloud, a normal deviation amount of the corresponding normal vector to other normal vectors in a predetermined neighborhood of the point; selecting, from the first 3D point cloud, a first registration region based on whether the normal deviation amount of each point meets a deviation threshold; and registering the first 3D point cloud and the second 3D point cloud to create the composite 3D point cloud, the registration utilizing the first registration region in place of the first 3D point cloud.

## Claims

### Claim 1

A method of registering three-dimensional (3D) point clouds of an area to create a composite 3D point cloud of the area, the method comprising:
obtaining a first 3D point cloud comprising a plurality of first points, the first 3D point cloud being acquired a first location;
obtaining a second 3D point cloud comprising a plurality of second points, the second 3D point cloud being acquired at a second location different form the first location;
calculating a first normal vector for each first point of the plurality of first points to create a plurality of first normal vectors;
for each first point of the plurality of first points, calculating a first normal vector deviation amount of the corresponding first normal vector compared to other first normal vectors in a predetermined neighborhood of the first point;
selecting, from the plurality of first points, a first registration region based on whether the first normal vector deviation amount of each first point of the plurality of first point satisfies a predetermined condition; and
registering the first 3D point cloud and the second 3D point cloud to create the composite 3D point cloud based on the first registration region.

### Claim 2 (depends on 1)

The method of claim 1, wherein the predetermined condition is a first deviation threshold.

### Claim 3

A method of registering three-dimensional (3D) point clouds of an area to create a composite 3D point cloud of the area, the method comprising
obtaining a first 3D point cloud comprising a plurality of first points, the first 3D point cloud being acquired a first location;
obtaining a second 3D point cloud comprising a plurality of second points, the second 3D point cloud being acquired at a second location different form the first location;
calculating a first normal vector for each first point of the plurality of first points to create a plurality of first normal vectors;
for each first point of the plurality of first points, calculating a first normal deviation amount of the corresponding first normal vector compared to other first normal vectors in a predetermined neighborhood of the first point;
selecting, from the plurality of first points, a first registration region based on whether the first normal deviation amount of each first point of the plurality of first point satisfies a predetermined condition;
registering the first 3D point cloud and the second 3D point cloud to create the composite 3D point cloud based on the first registration region;
wherein the predetermined condition is a first deviation threshold; and
wherein the selecting a first registration region comprises:
for each first point of the plurality of first points, comparing the first normal deviation amount of the first point to the first deviation threshold;
in response to the first normal deviation amount exceeding the first deviation threshold, adding the corresponding first point to a first exclusion set; and
subtracting the first exclusion set from the first 3D point cloud to create the first registration region.

### Claim 4

A method of registering three-dimensional (3D) point clouds of an area to create a composite 3D point cloud of the area, the method comprising:
obtaining a first 3D point cloud comprising a plurality of first points, the first 3D point cloud being acquired a first location;
obtaining a second 3D point cloud comprising a plurality of second points, the second 3D point cloud being acquired at a second location different form the first location;
calculating a first normal vector for each first point of the plurality of first points to create a plurality of first normal vectors;
for each first point of the plurality of first points, calculating a first normal deviation amount of the corresponding first normal vector compared to other first normal vectors in a predetermined neighborhood of the first point;
selecting, from the plurality of first points, a first registration region based on whether the first normal deviation amount of each first point of the plurality of first point satisfies a predetermined condition;
registering the first 3D point cloud and the second 3D point cloud to create the composite 3D point cloud based on the first registration region;
wherein the predetermined condition is a first deviation threshold; and
wherein the selecting a first registration region comprises:
for each first point of the plurality of first points, comparing the first normal deviation amount of the first point to the first deviation threshold; and
in response to the first normal deviation amount being below the first deviation threshold, adding the corresponding first point to the first registration region.

### Claim 5 (depends on 1)

The method of claim 1, wherein the predetermined neighborhood comprises a predetermined number of nearest neighboring first points among the plurality of first points.

### Claim 6

A method of registering three-dimensional (3D) point clouds of an area to create a composite 3D point cloud of the area, the method comprising:
obtaining a first 3D point cloud comprising a plurality of first points, the first 3D point cloud being acquired a first location;
obtaining a second 3D point cloud comprising a plurality of second points, the second 3D point cloud being acquired at a second location different form the first location;
calculating a first normal vector for each first point of the plurality of first points to create a plurality of first normal vectors;
for each first point of the plurality of first points, calculating a first normal deviation amount of the corresponding first normal vector compared to other first normal vectors in a predetermined neighborhood of the first point;
selecting, from the plurality of first points, a first registration region based on whether the first normal deviation amount of each first point of the plurality of first point satisfies a predetermined condition;
registering the first 3D point cloud and the second 3D point cloud to create the composite 3D point cloud based on the first registration region;
wherein the predetermined neighborhood comprises a predetermined number of nearest neighboring first points among the plurality of first points; and
wherein the predetermined neighborhood comprises the 20 closest first points of the plurality of first points.

### Claim 7 (depends on 1)

The method of claim 1, further comprising:
calculating a second normal vector for each second point of the plurality of second points to create a plurality of second normal vectors;
for each second point of the plurality of second points, calculating a second normal deviation amount of the corresponding second normal vector compared to other second normal vectors in a predetermined neighborhood of the second point;
selecting, from the plurality of second points, a second registration region based on whether the second normal deviation amount of each second point of the plurality of second point meets a second deviation threshold; and
wherein, in the registering the first 3D point cloud and the second 3D point cloud to create the composite 3D point cloud; the registration is based on the first registration region and the second registration region.

### Claim 8 (depends on 1)

The method of claim 1, wherein
the obtaining the first 3D point cloud comprises:
providing a 3D scanner at the first location in the area; and
scanning the area with the 3D scanner to generate the first 3D point cloud;
the obtaining the second 3D point cloud comprises:
moving the 3D scanner to the second location; and
scanning the area with the 3D scanner to generate the second 3D point cloud.

### Claim 9 (depends on 8)

The method of claim 8, wherein the 3D scanner comprises a light source, a beam steering mechanism, and a light receiver;
the scanning the area with the 3D scanner to generate the first 3D point cloud comprises:
emitting a plurality of light beams from the light source and receiving with the light receiver a plurality of reflected light beams from an object surface within a scan area, the direction of each of the plurality of light beams being determined by a beam steering unit; and
determining, with a processor system, 3D coordinates of a first collection of points on the object surface within a scan area based at least in part on the plurality of light beams and the plurality of reflected light beams to define the first 3D point cloud; and
the scanning the area with the 3D scanner to generate the second 3D point cloud comprises:
emitting a plurality of light beams from the light source and receiving with the light receiver a plurality of reflected light beams from an object surface within a scan area, the direction of each of the plurality of light beams being determined by the beam steering unit;
determining, with the processor system, 3D coordinates of a first collection of points on the object surface within a scan area based at least in part on the plurality of light beams and the plurality of reflected light beams to define the second 3D point cloud.

### Claim 10 (depends on 9)

The method of claim 9, wherein the 3D scanner further comprises a photogrammetry camera;
the scanning the area with the 3D scanner to generate the first 3D point cloud further comprises:
acquiring at least two images of within the field of view of the photogrammetry camera as the 3D scanner is rotated about a first axis, the field of view of each of the photogrammetry camera being at least partially within a shadow area, the shadow area being outside of the scan area;
determining, with the processor system, 3D coordinates of a second collection of points on the object surface based at least in part on the at least two images;
merging the 3D coordinates of the first collection of points and the 3D coordinates of the second collection of points to define the first 3D point cloud; and
the scanning the area with the 3D scanner to generate the second 3D point cloud further comprises:
acquiring at least two images of within the field of view of the photogrammetry camera as the 3D scanner is rotated about the first axis, the field of view of each of the photogrammetry camera being at least partially within a shadow area, the shadow area being outside of the scan area;
determining, with the processor system, 3D coordinates of a second collection of points on the object surface based at least in part on the at least two images; and
merging the 3D coordinates of the first collection of points and the 3D coordinates of the second collection of points to define the second 3D point cloud.

### Claim 11 (depends on 1)

The method of claim 1, wherein
the obtaining the first 3D point cloud comprises retrieving a previously-generated first 3D point cloud from a storage; and
the obtaining the second 3D point cloud comprises retrieving a previously-generated second 3D point cloud from the storage.

### Claim 12

A three-dimensional measuring system comprising:
a housing that is rotatable about a first axis;
a light source disposed within the housing and operable to emit light beams;
a beam steering mechanism coupled to the housing and configured to direct the emitted light beams onto an object surface within a scan area in the environment;
a light receiver disposed within the housing to receive light reflected from the object surface through the beam steering mechanism;
a processor system operably coupled to the light source, the beam steering mechanism, and the light receiver, the processor system being responsive to nontransitory executable computer instructions to determine 3D coordinates of a first collection of points on the object surface based at least in part on the emitting of the light beams and the receiving by the light receiver of the reflected light to define a 3D point cloud;
wherein the processor system is further responsive to nontransitory executable computer instructions to perform:
calculating a normal vector for each point of 3D point cloud to create a plurality of normal vectors;
calculating, for each point of the 3D point cloud, a normal deviation amount of the corresponding normal vector compared to other normal vectors in a predetermined neighborhood of the point; and
selecting, from the 3D point cloud, a registration region based on whether the normal deviation amount of each point of the 3D point cloud meets a deviation threshold.

### Claim 13

A three-dimensional measuring system comprising:
a housing that is rotatable about a first axis;
a light source disposed within the housing and operable to emit light beams;
a beam steering mechanism coupled to the housing and configured to direct the emitted light beams onto an object surface within a scan area in the environment;
a light receiver disposed within the housing to receive light reflected from the object surface through the beam steering mechanism;
a processor system operably coupled to the light source, the beam steering mechanism, and the light receiver, the processor system being responsive to nontransitory executable computer instructions to determine 3D coordinates of a first collection of points on the object surface based at least in part on the emitting of the light beams and the receiving by the light receiver of the reflected light to define a 3D point cloud;
wherein the processor system is further responsive to nontransitory executable computer instructions to perform:
calculating a normal vector for each point of 3D point cloud to create a plurality of normal vectors;
calculating, for each point of the 3D point cloud, a normal deviation amount of the corresponding normal vector compared to other normal vectors in a predetermined neighborhood of the point;
selecting, from the 3D point cloud, a registration region based on whether the normal deviation amount of each point of the 3D point cloud meets a deviation threshold;
a photogrammetry camera operably coupled to the housing, the photogrammetry camera having a lens and an image sensor that define a field of view, the photogrammetry camera being oriented to acquire an image within the field of view that is at least partially within a shadow area and at least partially within the scan area, the shadow area being separate from the scan area; and
wherein the processor system is operably connected to the photogrammetry camera, the processor system being responsive to nontransitory executable computer instructions to determine 3D coordinates of a second collection of points in the shadow area based on at least two images acquired by the photogrammetry camera; and to merge the 3D coordinates of the first collection of points and the 3D coordinates of the second collection of points to define the 3D point cloud.

### Claim 14

A non-transitory computer-readable medium storing thereon computer-executable instructions that, when executed by a computer, cause the computer to perform:
obtaining a first 3D point cloud comprising a plurality of first points, the first 3D point cloud being acquired at a first location;
obtaining a second 3D point cloud comprising a plurality of second points, the second 3D point cloud being acquired at a second location different form the first location;
calculating a first normal vector for each first point of the plurality of first points to create a plurality of first normal vectors;
for each first point of the plurality of first points, calculating a first normal deviation amount of the corresponding first normal vector compared to other first normal vectors in a predetermined neighborhood of the first point;
selecting, from the plurality of first points, a first registration region based on whether the first normal deviation amount of each first point of the plurality of first point satisfies a predetermined condition; and
registering the first 3D point cloud and the second 3D point cloud to create the composite 3D point cloud based on the first registration region.

### Claim 15

A method of registering three-dimensional (3D) point clouds of an area to create a composite 3D point cloud of the area, the method comprising:
obtaining a first 3D point cloud comprising a plurality of first points;
obtaining a second 3D point cloud comprising a plurality of second points;
registering the first 3D point cloud and the second 3D point cloud to create the composite 3D point cloud based a first registration region that is a subset of the first 3D point cloud and a second registration region that is a subset of the second 3D cloud; and
wherein the first registration region and the second registration region are selected based on a measurable characteristic of each first point of the plurality of first points and of each first point of the plurality of second points.

### Claim 16 (depends on 15)

The method of claim 15, wherein the measurable characteristic is based on a normal vector of each point of the plurality of first points and the plurality of second points.

### Claim 17 (depends on 15)

The method of claim 15, wherein the measurable characteristic is based on a curvature of each point of the plurality of the first points and the plurality of the second points.
