# US 2021/0172732 A1 · Projecting apparatus and projecting calibration method

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0172732 A1
- Document ID: US20210172732A1
- Status: Published application
- Kind: A1
- Application number: 16/828,902
- Filed: 2020-03-24
- Published: 2021-06-10
- Earliest claimed: 2019-12-09
- Assignees: Industrial Technology Research Institute
- Applicants: Industrial Technology Research Institute
- Inventors: Kai-Shiang GAN; Po-Lung CHEN; Chun-Yuan CHEN; Chien-Chun KUO
- Web page: https://patentgrep.com/patent/US20210172732A1

## CPC

- G01B 11/2504: {Calibration devices}
- G01B 11/2518: {Projection by scanning of the object}
- G06T 7/521: from laser ranging, e.g. using interferometry; from the projection of structured light
- G06T 17/20: Finite element generation, e.g. wire-frame surface description, {tesselation}
- G06T 2200/08: involving all processing steps from image acquisition to 3D model generation
- G06T 2207/10028: Range image; Depth image; 3D point clouds
- G01B: MEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

A projecting apparatus includes a projecting device, an image-capturing device and a processing device. The projecting device projects a reversible structured light code onto a surface. The image-capturing device captures the reversible structured light code projected onto the surface and obtains image data. The processing device is coupled to the projecting device and the image-capturing device. The processing device receives the image data, generates three-dimensional point cloud information by performing decoding on the image data, and obtains scanning shift information corresponding to the projecting device according to the three-dimensional point cloud information and three-dimensional information corresponding to the surface.

## Claims

### Claim 1

A projecting apparatus, comprising:
a projecting device, configured to project a reversible structured light code onto a surface;
an image-capturing device, configured to capture the reversible structured light code projected onto the surface and obtain image data; and
a processing device, coupled to the projecting device and the image-capturing device, and configured to receive the image data, generate three-dimensional point cloud information by performing decoding on the image data, and obtain scanning shift information corresponding to the projecting device according to the three-dimensional point cloud information and three-dimensional information corresponding to the surface.

### Claim 2 (depends on 1)

The projecting apparatus as claimed in claim 1, wherein the processing device is further configured to obtain depth error information by performing computation according to the three-dimensional point cloud information and three-dimensional information corresponding to the surface, obtain projecting error information by performing computation according to the depth error information, the three-dimensional point cloud information and a plurality of pieces of compensation depth information, and obtain the scanning shift information by performing computation according to the projecting error information and a projection distance.

### Claim 3 (depends on 2)

The projecting apparatus as claimed in claim 2, wherein the scanning shift information is computed based on the following equation:
θ
(
x
,
y
)
=
tan
-
1

d
(
x
,
y
)
h
,
wherein θ(x,y) is the scanning shift information, d(x,y) is the projecting error information, and h is the projection distance.

### Claim 4 (depends on 2)

The projecting apparatus as claimed in claim 2, wherein the processing device is further configured to obtain the pieces of compensation depth information by performing computation according to a plurality of pixel shift quantities.

### Claim 5 (depends on 4)

The projecting apparatus as claimed in claim 4, wherein the processing device is further configured to compute a plurality of compensation depth differences between the three-dimensional point cloud information and the pieces of compensation depth information, select one of the pixel shift quantities corresponding to a smallest difference of the differences between the depth error information and the compensation depth differences, and compute the projecting error information according to the selected pixel shift quantity.

### Claim 6 (depends on 5)

The projecting apparatus as claimed in claim 5, wherein the projecting error information is computed based on the following equation:
Δd(x,y)=(i,j)×Pd,
wherein Δd(x,y) is the projecting error information, (i,j) are the pixel shift quantities, and Pd is a transformation ratio between a pixel and a length.

### Claim 7 (depends on 1)

The projecting apparatus as claimed in claim 1, wherein the reversible structured light code is a gray stripe light code.

### Claim 8 (depends on 1)

The projecting apparatus as claimed in claim 1, wherein the projecting device is a micro electro mechanical systems scanning mirror projector.

### Claim 9 (depends on 1)

The projecting apparatus as claimed in claim 1, wherein the surface is a surface of a standard part.

### Claim 10 (depends on 1)

The projecting apparatus as claimed in claim 1, wherein the processing device further calibrates the projecting device according to the scanning shift information.

### Claim 11

A projecting calibration method, comprising:
projecting a reversible structured light code onto a surface by a projecting device;
capturing the reversible structured light code projected onto the surface and obtaining image data by an image-capturing device; and
receiving the image data, generating three-dimensional point cloud information by performing decoding on the image data, and obtaining scanning shift information corresponding to the projecting device according to the three-dimensional point cloud information and three-dimensional information corresponding to the surface by a processing device.

### Claim 12 (depends on 11)

The projecting calibration method as claimed in claim 11, wherein the step of receiving the image data, generating the three-dimensional point cloud information by performing decoding on the image data, and obtaining the scanning shift information corresponding to the projecting device according to the three-dimensional point cloud information and three-dimensional information corresponding to the surface by the processing device further comprises:
obtaining depth error information by performing computation according to the three-dimensional point cloud information and three-dimensional information corresponding to the surface;
obtaining projecting error information by performing computation according to the depth error information, the three-dimensional point cloud information and a plurality of pieces of compensation depth information; and
obtaining the scanning shift information by performing computation according to the projecting error information and a projection distance.

### Claim 13 (depends on 12)

The projecting calibration method as claimed in claim 12, wherein the scanning shift information is computed based on the following equation:
θ
(
x
,
y
)
=
tan
-
1

d
(
x
,
y
)
h
wherein θ(x,y) is the scanning shift information, d(x,y) is the projecting error information, and h is the projection distance.

### Claim 14 (depends on 12)

The projecting calibration method as claimed in claim 12, wherein the step of receiving the image data, generating the three-dimensional point cloud information by performing decoding on the image data, and obtaining the scanning shift information corresponding to the projecting device according to the three-dimensional point cloud information and three-dimensional information corresponding to the surface by the processing device further comprises:
obtaining the pieces of compensation depth information by performing computation according to a plurality of pixel shift quantities by the processing device.

### Claim 15 (depends on 13)

The projecting calibration method as claimed in claim 13, wherein the step of obtaining projecting error information by performing computation according to the depth error information, the three-dimensional point cloud information and the pieces of compensation depth information comprises:
computing a plurality of compensation depth differences between the three-dimensional point cloud information and the pieces of compensation depth information by the processing device; and
selecting one of the pixel shift quantities corresponding to a smallest difference of the differences between the depth error information and the compensation depth differences by the processing device, and computing the projecting error information according to the selected pixel shift quantity by the processing device.

### Claim 16 (depends on 15)

The projecting calibration method as claimed in claim 15, wherein the projecting error information is computed based on the following equation:
Δd(x,y)=(i,j)×Pd,
wherein Δd(x,y) is the projecting error information, (i,j) are the pixel shift quantities, and Pd is a transformation ratio between a pixel and a length.

### Claim 17 (depends on 11)

The projecting calibration method as claimed in claim 11, wherein the reversible structured light code is a gray stripe light code.

### Claim 18 (depends on 11)

The projecting calibration method as claimed in claim 11, wherein the projecting device is a micro electro mechanical systems scanning mirror projector.

### Claim 19 (depends on 11)

The projecting calibration method as claimed in claim 11, wherein the surface is a surface of a standard part.

### Claim 20 (depends on 11)

The projecting calibration method as claimed in claim 11, further comprising:
calibrating the projecting device according to the scanning shift information.
