# US 2021/0341605 A1 · Position coordinates estimation device, position coordinates estimation method, and program

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0341605 A1
- Document ID: US20210341605A1
- Status: Published application
- Kind: A1
- Application number: 17/268,942
- Filed: 2019-08-07
- Published: 2021-11-04
- Earliest claimed: 2018-08-23
- Assignees: Nippon Telegraph and Telephone Corporation
- Applicants: Nippon Telegraph and Telephone Corporation
- Inventors: Manabu YOSHIDA; Yuki YOKOHATA; Kouhei MORI; Atsuhiko MAEDA; Takahiro HATA; Ippei SHAKE
- Web page: https://patentgrep.com/patent/US20210341605A1

## CPC

- G01B 11/002: {for measuring two or more coordinates}
- G01S 17/06: Systems determining position data of a target
- G01C 21/3602: {Input other than that of destination using image analysis, e.g. detection of road signs, lanes, buildings, real preceding vehicles using a camera}
- G01S 17/89: for mapping or imaging
- G06T 5/50: using two or more images, e.g. averaging or subtraction
- G06T 7/593: from stereo images
- G06T 7/70: Determining position or orientation of objects or cameras (camera calibration G06T7/80)
- G06T 2207/10012: Stereo images
- G06T 2207/20221: Image fusion; Image merging
- G01B: MEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS
- G01S: RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01C: MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY (measuring liquid level G01F; radio navigation, determining distance or velocity by use of propagation effects, e.g. Doppler effects, propagation time, of radio waves, analogous arrangements using other waves G01S)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

A technique of estimating, based on a camera image captured from a mobile object, the position coordinates of an ambient object or the mobile object itself is offered. A plurality of camera images that are captured at different geographical locations and contain at least one identical stationary object are acquired; position coordinates of the imaging locations of the corresponding camera images are acquired; and the position coordinates of the stationary object are estimated based on the position coordinates of the imaging locations and gaze vectors oriented from a camera to the stationary object in each of the camera images. Alternatively, a camera image that contains at least two stationary objects having position coordinates that are known is acquired; and the position coordinates of a location at which the camera image is captured are estimated based on the position coordinates of each of the stationary objects and a gaze vector oriented from the camera to each of the stationary objects in the camera image.

## Claims

### Claim at position 1

-8. (canceled)

### Claim 9

A position coordinates estimation device comprising:
a camera image acquisition unit configured to acquire a plurality of camera images that are captured at different geographical locations and contain at least one identical stationary object;
an image pair formation unit configured to selectively combine two of the camera images and form an image pair;
a position coordinates acquisition unit configured to acquire position coordinates of the geographical locations at which the corresponding camera images in the image pair are captured; and
a position coordinates estimation unit configured to estimate the position coordinates of the stationary object based on the position coordinates of the geographical locations and gaze vectors, which are obtained by converting, to a map coordinate system, gaze vectors oriented from a camera to the stationary object on a coordinate system associated with the camera images, in each of the camera images of the image pair.

### Claim 10 (depends on 9)

The position coordinates estimation device according to claim 9, wherein the position coordinates estimation unit estimates the position coordinates of the stationary object, based on the position coordinates of the geographical locations and the gaze vectors oriented from the camera to the stationary object, in each of the camera images of the image pair.

### Claim 11 (depends on 10)

The position coordinates estimation device according to claim 10, wherein
the position coordinates acquisition unit acquires the position coordinates of the geographical locations, based on information received from a GPS satellite, and
the image pair formation unit acquires information indicating a level of accuracy of the acquired position coordinates of the geographical locations, based on the information received from the GPS satellite, and forms the image pair by selectively combining camera images that correspond to geographical locations the position coordinates of which demonstrate levels of accuracy that exceed a predetermined threshold value.

### Claim 12 (depends on 10)

The position coordinates estimation device according to claim 10, wherein
the image pair formation unit forms a plurality of image pairs, and
the position coordinates estimation unit calculates candidate values for the position coordinates of the stationary object from each of the image pairs, and estimates the position coordinates of the stationary object based on the calculated candidate values.

### Claim 13

A position coordinates estimation method implemented by a position coordinates estimation device, the method comprising:
acquiring a plurality of camera images that are captured at different geographical locations and contain at least one identical stationary object;
selectively combining two of the camera images and forming an image pair;
acquiring position coordinates of the geographical locations at which the corresponding camera images in the image pair are captured; and
estimating the position coordinates of the stationary object based on the position coordinates of the geographical locations and gaze vectors, which are obtained by converting, to a map coordinate system, gaze vectors oriented from a camera to the stationary object on a coordinate system associated with the camera images, in each of the camera images of the image pair.

### Claim 14

A non-transitory computer readable medium storing a computer program which is executed by a computer to provide the steps of:
acquiring a plurality of camera images that are captured at different geographical locations and contain at least one identical stationary object;
selectively combining two of the camera images and forming an image pair;
acquiring position coordinates of the geographical locations at which the corresponding camera images in the image pair are captured; and
estimating the position coordinates of the stationary object based on the position coordinates of the geographical locations and gaze vectors, which are obtained by converting, to a map coordinate system, gaze vectors oriented from a camera to the stationary object on a coordinate system associated with the camera images, in each of the camera images of the image pair.
