# US 2017/0254637 A1 · Triangulation device, triangulation method, and recording medium recording program therefor

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2017/0254637 A1
- Document ID: US20170254637A1
- Status: Published application
- Kind: A1
- Application number: 15/510,737
- Filed: 2015-09-18
- Published: 2017-09-07
- Earliest claimed: 2014-09-18
- Assignees: NEC Corporation
- Applicants: NEC Corporation
- Inventors: Gaku NAKANO
- Web page: https://patentgrep.com/patent/US20170254637A1

## CPC

- G01B 11/002: {for measuring two or more coordinates}
- G01B 11/00: Measuring arrangements characterised by the use of optical techniques
- G01C 3/08: Use of electric radiation detectors
- G01C 3/14: with binocular observation at a single point, e.g. stereoscopic type (G01C3/20 takes precedence)
- G06T 7/593: from stereo images
- G06T 7/73: using feature-based methods
- G06T 2200/04: involving 3D image data
- G06T 2207/10012: Stereo images
- G01B: MEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS
- G01C: MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY (measuring liquid level G01F; radio navigation, determining distance or velocity by use of propagation effects, e.g. Doppler effects, propagation time, of radio waves, analogous arrangements using other waves G01S)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

A triangulation device for computing a three-dimensional position of a measurement target point using a stereo method, the triangulation device includes: optimum image coordinate estimation unit configured to, based on coordinates of corresponding points corresponding to the measurement target point in two images each of which including an image of the measurement target point, and intrinsic parameters and extrinsic parameters of optical instruments generating the two images, calculate correction vectors by which coordinates of the corrected corresponding points satisfy an epipolar equation composed of the intrinsic parameters and the extrinsic parameters, using a characteristic polynomial including a correction amount of coordinates of the corresponding points or a reciprocal of the correction amount as a variable, and compute coordinates of the corrected corresponding points based on calculated correction vectors; and three-dimensional coordinate calculation unit configured to calculate three-dimensional coordinates of the measurement target point based on coordinates of the corrected corresponding points, the intrinsic parameters and the extrinsic parameters.

## Claims

### Claim 1

A triangulation device for computing a three-dimensional position of a measurement target point using a stereo method, the triangulation device comprising:
an optimum image coordinate estimation unit configured to,
based on coordinates of corresponding points corresponding to the measurement target point in two images each of which including an image of the measurement target point, and intrinsic parameters and extrinsic parameters of optical instruments generating the two images, calculate correction vectors by which coordinates of the corrected corresponding points satisfy an epipolar equation composed of the intrinsic parameters and the extrinsic parameters, using a characteristic polynomial including a correction amount of coordinates of the corresponding points or a reciprocal of the correction amount as a variable, and
compute coordinates of the corrected corresponding points based on calculated correction vectors; and
a three-dimensional coordinate calculation unit configured to calculate three-dimensional coordinates of the measurement target point based on coordinates of the corrected corresponding points, the intrinsic parameters and the extrinsic parameters.

### Claim 2 (depends on 1)

The triangulation device according to claim 1, wherein
the optimum image coordinate estimation unit includes:
a characteristic polynomial calculation unit configured to
receive coordinates of the corresponding points, the intrinsic parameters and the extrinsic parameters,
calculate a predetermined constraint matrix indicating a constraint to be satisfied by correction vectors and including a correction amount of coordinates of the corresponding points or a reciprocal of the correction amount as an eigenvalue, and
solve a characteristic equation of the constraint matrix to compute a minimum correction amount; and
a correction vector calculation unit configured to
calculate an eigenvector of the constraint matrix corresponding to the minimum correction amount, with coordinates of the corresponding points, the constraint matrix and the minimum correction amount as inputs,
perform predetermined scaling on the eigenvector to calculate correction vectors, and
calculate coordinates of the corrected corresponding points based on the correction vectors.

### Claim 3 (depends on 1)

The triangulation device according to claim 1, wherein a correction amount of the corresponding points indicates a Lagrange multiplier in a constrained nonlinear optimization problem including magnitude of correction vectors as an objective function and an epipolar equation with scale indeterminacy as a constraint.

### Claim 4 (depends on 1)

The triangulation device according to claim 1, wherein the stereo method is a passive stereo method in which two images of the measurement target point are captured by cameras from different positions, respectively.

### Claim 5 (depends on 1)

The triangulation device according to claim 1, wherein the stereo method is an active stereo method in which an image of the measurement target point is projected by a projector from a certain position, and an image of the measurement target point is captured by a camera from another position.

### Claim 6

A triangulation method comprising, by a triangulation device:
receiving coordinates of corresponding points corresponding to a measurement target point in images capturing a measurement target from two different positions, and intrinsic parameters and extrinsic parameters of optical instruments capturing the two images;
calculating correction vectors by which coordinates of the corrected corresponding points satisfy an epipolar equation composed of the intrinsic parameters and the extrinsic parameters, based on a characteristic polynomial including a correction amount of coordinates of the corresponding points or a reciprocal of the correction amount as a variable;
computing coordinates of the corrected corresponding points based on the calculated correction vectors; and
receiving coordinates of the corrected corresponding points, the intrinsic parameters and the extrinsic parameters, and calculating three-dimensional coordinates of the measurement target point.

### Claim 7 (depends on 6)

The triangulation method according to claim 6, wherein the triangulation device receives coordinates of the corresponding points, the intrinsic parameters and the extrinsic parameters,
calculates a predetermined constraint matrix indicating a constraint to be satisfied by correction vectors and including a correction amount of coordinates of the corresponding points or a reciprocal of the correction amount as an eigenvalue,
solves a characteristic equation of the constraint matrix to compute a minimum correction amount,
calculates an eigenvector of the constraint matrix corresponding to the minimum correction amount, based on coordinates of the corresponding points, the constraint matrix, and the minimum correction amount,
performs predetermined scaling on the eigenvector to calculate correction vectors, and
calculates coordinates of the corrected corresponding points based on the correction vectors.

### Claim 8 (depends on 6)

The triangulation method according to claim 6, wherein a correction amount of the corresponding points indicates a Lagrange multiplier in a constrained nonlinear optimization problem including magnitude of correction vectors as an objective function and an epipolar equation with scale indeterminacy as a constraint.

### Claim 9

A non-transitory computer-readable recording medium storing a program causing a computer to function as:
optimum image coordinate estimation unit configured to
receive coordinates of corresponding points corresponding to the measurement target point in two images each of which including an image of the measurement target point, and intrinsic parameters and extrinsic parameters of optical instruments generating the two images,
calculate correction vectors by which coordinates of the corrected corresponding points satisfy an epipolar equation composed of the intrinsic parameters and the extrinsic parameters, based on a characteristic polynomial including a correction amount of coordinates of the corresponding points or a reciprocal of the correction amount as a variable, and
compute coordinates of the corrected corresponding points based on calculated correction vectors; and
three-dimensional coordinate calculation unit configured to
calculate three-dimensional coordinates of the measurement target point based on coordinates of the corrected corresponding points, the intrinsic parameters and the extrinsic parameters.

### Claim 10 (depends on 9)

The non-transitory computer-readable recording medium storing the program according to claim 9, wherein the optimum image coordinate estimation unit includes:
characteristic polynomial calculation unit configured to
calculate a predetermined constraint matrix indicating a constraint to be satisfied by correction vectors and including a correction amount of coordinates of the corresponding points or a reciprocal of the correction amount as an eigenvalue, based on coordinates of the corresponding points, the intrinsic parameters and the extrinsic parameters, and
solve a characteristic equation of the constraint matrix to compute a minimum correction amount; and
correction vector calculation unit configured to
calculate an eigenvector of the constraint matrix corresponding to the minimum correction amount, based on coordinates of the corresponding points, the constraint matrix, and the minimum correction amount,
perform predetermined scaling on the eigenvector to calculate correction vectors, and
calculate coordinates of the corrected corresponding points based on the correction vectors.
