# US 2017/0287157 A1 · Three-dimensional shape measuring apparatus, three-dimensional shape measuring method, and storage medium

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2017/0287157 A1
- Document ID: US20170287157A1
- Status: Published application
- Kind: A1
- Application number: 15/470,286
- Filed: 2017-03-27
- Published: 2017-10-05
- Earliest claimed: 2016-03-30
- Assignees: Canon Kabushiki Kaisha
- Applicants: Canon Kabushiki Kaisha
- Inventors: Takamasa Seto
- Web page: https://patentgrep.com/patent/US20170287157A1

## CPC

- G01B 11/2509: {Color coding}
- G01B 11/2513: {with several lines being projected in more than one direction, e.g. grids, patterns}
- G06T 7/521: from laser ranging, e.g. using interferometry; from the projection of structured light
- G06T 7/593: from stereo images
- G06T 7/60: Analysis of geometric attributes
- G06V 10/147: Details of sensors, e.g. sensor lenses (fingerprint or palmprint sensors G06V40/13; vascular sensors G06V40/145; eye sensors G06V40/19)
- G06T 2207/10152: Varying illumination
- G06V 10/141: Control of illumination
- G06V 10/145: Illumination specially adapted for pattern recognition, e.g. using gratings
- G01B: MEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

A projection unit configured to project a stripe pattern whose luminance changes periodically and a reference position pattern indicating a position of one period of a plurality of periods of the stripe pattern as a reference position; an image capturing unit configured to capture images of a measurement-target object; a control unit configured to control the projection unit and the image capturing unit, to acquire a captured image of the stripe pattern by performing control so that the image capturing unit captures images of the measurement-target object under a plurality of exposure conditions, and to acquire a captured image of the reference position pattern by performing control so that the image capturing unit captures images of the measurement-target object under exposure condition; and a shape calculation unit configured to calculate a three-dimensional shape object based on a captured image of the stripe pattern and the reference position pattern are included.

## Claims

### Claim 1

A three-dimensional shape measuring apparatus comprising:
a projection unit configured to project a stripe pattern whose luminance changes periodically and a reference position pattern indicating a position of at least one period of a plurality of periods of the stripe pattern as a reference position onto a measurement-target object;
an image capturing unit configured to capture images of the measurement-target object from a plurality of directions;
a control unit configured to control the projection unit and the image capturing unit, to acquire a captured image of the stripe pattern by performing control so that the image capturing unit captures images of the measurement-target object from the plurality of directions under a plurality of exposure conditions at a time at which the stripe pattern is projected, and to acquire a captured image of the reference position pattern by performing control so that the image capturing unit captures images of the measurement-target object from the plurality of directions under one exposure condition at a time at which the reference position pattern is projected; and
a shape calculation unit configured to calculate a three-dimensional shape of the measurement-target object based on a captured image of the stripe pattern and a captured image of the reference position pattern.

### Claim 2 (depends on 1)

The three-dimensional shape measuring apparatus according to claim 1, wherein
the reference position pattern is created so that an edge portion whose edge intensity is higher than or equal to a predetermined value is provided in parallel to a stripe of the stripe pattern within the at least one period of the stripe pattern.

### Claim 3 (depends on 2)

The three-dimensional shape measuring apparatus according to claim 2, wherein
the edge portion of the reference position pattern exists at a position other than a switch portion at which a period of a stripe of the stripe pattern switches.

### Claim 4 (depends on 1)

The three-dimensional shape measuring apparatus according to claim 1, wherein
the shape calculation unit includes:
a phase image generation unit configured to generate a phase image based on a captured image of the stripe pattern for each direction of the plurality of directions;
a unit configured to generate a period identification image indicating a period identification number of each pixel position of the phase image based on the phase image and a captured image of the reference position pattern for each of the directions; and
a phase unwrapping unit configured to generate an unwrapped phase image by performing phase unwrapping of the phase image by using the period identification image for each of the directions, and
calculates a three-dimensional shape of the measurement-target object based on the unwrapped phase image.

### Claim 5 (depends on 4)

The three-dimensional shape measuring apparatus according to claim 4, wherein
the unit configured to generate a period identification image extracts the reference position based on a captured image of the reference position pattern for each of the directions and generates the period identification image so that a period identification number of the phase image corresponding to the extracted reference position becomes a predetermined number common between the plurality of directions.

### Claim 6 (depends on 5)

The three-dimensional shape measuring apparatus according to claim 5, wherein
the unit configured to generate a period identification image includes a binarization processing unit configured to generate a binarized image based on a captured image of the reference position pattern for each of the directions and extracts the reference position from the binarized image.

### Claim 7 (depends on 4)

The three-dimensional shape measuring apparatus according to claim 4, wherein
by control of the control unit, the projection unit shifts a phase a plurality of times and projects the stripe pattern onto the measurement-target object and for each piece of projection of the plurality of times of projection of the stripe pattern, the image capturing unit captures images of the measurement-target object from the plurality of directions under the plurality of exposure conditions.

### Claim 8 (depends on 7)

The three-dimensional shape measuring apparatus according to claim 7, wherein
the shape calculation unit further includes a combination unit configured to generate a combined image of quality higher than quality of a plurality of images by combining the plurality of images captured under the plurality of exposure conditions for each of the directions and for each piece of projection of the projection of the stripe pattern, and
the phase image generation unit generates the phase image based on the combined image.

### Claim 9 (depends on 4)

The three-dimensional shape measuring apparatus according to claim 4, wherein
the shape calculation unit further includes:
a corresponding point search unit configured to search for a corresponding point at which a phase value of the unwrapped phase image is the same in the plurality of directions based on the unwrapped phase image; and
a triangulation unit configured to calculate a three-dimensional shape of the measurement-target object by using the principle of triangulation based on the corresponding point searched for by the corresponding point search unit.

### Claim 10 (depends on 1)

The three-dimensional shape measuring apparatus according to claim 1, wherein
the stripe pattern is a pattern in a form of a stripe whose luminance changes sinusoidally.

### Claim 11

A three-dimensional shape measuring method comprising:
a step of projecting a stripe pattern whose luminance changes periodically onto a measurement-target object;
a step of acquiring a captured image of the stripe pattern by capturing images of the measurement-target object from a plurality of directions under a plurality of exposure conditions at a time at which the stripe pattern is projected;
a step of projecting a reference position pattern indicating a position of at least one period of a plurality of periods of the stripe pattern as a reference position onto the measurement-target object;
a step of acquiring a captured image of the reference position pattern by capturing images of the measurement-target object from the plurality of directions under one exposure condition at a time at which the reference position pattern is projected; and
a step of calculating a three-dimensional shape of the measurement-target object based on a captured image of the stripe pattern and a captured image of the reference position pattern.

### Claim 12

A non-transitory computer readable storage medium storing a program for causing a computer to function as a three-dimensional shape measuring apparatus, the three-dimensional shape measuring apparatus comprising:
a projection unit configured to project a stripe pattern whose luminance changes periodically and a reference position pattern indicating a position of at least one period of a plurality of periods of the stripe pattern as a reference position onto a measurement-target object;
an image capturing unit configured to capture images of the measurement-target object from a plurality of directions;
a control unit configured to control the projection unit and the image capturing unit, to acquire a captured image of the stripe pattern by performing control so that the image capturing unit captures images of the measurement-target object from the plurality of directions under a plurality of exposure conditions at a time at which the stripe pattern is projected, and to acquire a captured image of the reference position pattern by performing control so that the image capturing unit captures images of the measurement-target object from the plurality of directions under one exposure condition at a time at which the reference position pattern is projected; and
a shape calculation unit configured to calculate a three-dimensional shape of the measurement-target object based on a captured image of the stripe pattern and a captured image of the reference position pattern.
