# US 2022/0284599 A1 · Position estimating method, position estimating system, and position estimating apparatus

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2022/0284599 A1
- Document ID: US20220284599A1
- Status: Published application
- Kind: A1
- Application number: 17/637,172
- Filed: 2019-09-04
- Published: 2022-09-08
- Earliest claimed: 2019-09-04
- Assignees: NEC Corporation
- Applicants: NEC Corporation
- Inventors: Shinya YASUDA
- Web page: https://patentgrep.com/patent/US20220284599A1

## CPC

- G06T 7/285: using a sequence of stereo image pairs
- G06T 7/593: from stereo images
- G06T 3/40: Scaling of whole images or parts thereof, e.g. expanding or contracting
- G06T 7/0004: {Industrial image inspection}
- G06T 7/70: Determining position or orientation of objects or cameras (camera calibration G06T7/80)
- H04N 13/239: using two two-dimensional [2D] image sensors having a relative position equal to or related to the interocular distance (H04N13/243 takes precedence)
- H04N 13/25: using two or more image sensors with different characteristics other than in their location or field of view, e.g. having different resolutions or colour pickup characteristics; using image signals from one sensor to control the characteristics of another sensor
- G06T 2207/10012: Stereo images
- G06T 2207/10028: Range image; Depth image; 3D point clouds
- G06T 2207/20068: Projection on vertical or horizontal image axis
- H04N 2013/0085: {Motion estimation from stereoscopic image signals}
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

In order to appropriately estimated a position of a moving object on the basis of a captured image, a position estimating apparatus 100 includes an obtaining section 110 configured to obtain an image coordinates representing an image position of a moving object 300 in an image captured by an imaging apparatus 200, and a converting section 130 configured to convert the image coordinates for the moving object 300 to real space coordinates for the moving object 300, based on information obtained from a correspondence between real space coordinate information indicating a predetermined point in a real space and image coordinate information representing the predetermined point.

## Claims

### Claim 1

A position estimating method comprising:
obtaining an image coordinate representing an image position of a moving object in an image captured by an imaging apparatus; and
converting the image coordinate for the moving object to a real space coordinate for the moving object, based on information obtained from a correspondence between real space coordinate information indicating a predetermined point in a real space and image coordinate information representing the predetermined point.

### Claim 2 (depends on 1)

The position estimating method according to claim 1, wherein the information obtained from the correspondence includes projective transformation parameters for projective transformation from the captured image into a plane image in which the moving object is present.

### Claim 3 (depends on 2)

The position estimating method according to claim 2, wherein the information obtained from the correspondence further includes scale transformation parameters for transforming a scale for the moving object on the image subjected to the projective transformation into a scale for the moving object in the real space.

### Claim 4 (depends on 3)

The position estimating method according to claim 3, wherein the scale transformation parameters include a parameter for adjusting a shift amount for the moving object on the image subjected to the projective transformation to a shift amount for the moving object in the real space.

### Claim 5 (depends on 3)

The position estimating method according to claim 3, wherein the scale transformation parameters further include a parameter for adjusting an image size for the moving object on the image subjected to the projective transformation into a size for the moving object in the real space.

### Claim 6 (depends on 3)

The position estimating method according to claim 3, wherein the scale transformation parameters include a parameter for transforming a scale for the moving object on the image subjected to the projective transformation into a scale for the moving object in the real space for two coordinate axes defining a plane on which the moving object moves.

### Claim 7 (depends on 1)

The position estimating method according to claim 1, wherein the real space coordinate information indicating the predetermined point is information of real space coordinates for a plurality of points through which the moving object moves along a predetermined moving path.

### Claim 8 (depends on 7)

The position estimating method according to claim 7, wherein the predetermined moving path is a path present in a region where a plurality of imaging apparatuses are configured to capture the moving object.

### Claim 9 (depends on 8)

The position estimating method according to claim 8, wherein the information obtained from the correspondence further includes a parameter for adjusting a difference in a position of the moving object on images captured by the plurality of imaging apparatuses.

### Claim 10 (depends on 1)

The position estimating method according to claim 1, wherein the real space coordinate information indicating the predetermined point is information of a plurality of real space coordinates based on position detection of the moving object by a position detecting apparatus.

### Claim 11 (depends on 10)

The position estimating method according to claim 10, wherein the position detecting apparatus is a stereo camera included in the imaging apparatus.

### Claim 12

A position estimating system comprising:
a control apparatus configured to control moving of a moving object;
an imaging apparatus configured to capture an image of the moving object; and
a position estimating apparatus configured to estimate position information for the moving object, wherein
the position estimating apparatus includes
a memory storing instructions; and
one or more processors configured to execute the instructions to:
obtain an image coordinate representing an image position of a moving object in an image captured by the imaging apparatus, and
convert the image coordinate for the moving object to a real space coordinate for the moving object, based on information obtained from a correspondence between real space coordinate information indicating a predetermined point in a real space and image coordinate information representing the predetermined point.

### Claim 13 (depends on 12)

The position estimating system according to claim 12, wherein the control apparatus is configured to specify a path along which the moving object moves based on the real space coordinate for the moving object.

### Claim 14 (depends on 13)

The position estimating system according to claim 13, wherein the control apparatus is configured to indicate to the moving object an instruction to move along the specified path.

### Claim 15 (depends on 12)

The position estimating system according to claim 12, wherein the imaging apparatus is equipped with a stereo camera including a base camera and a reference camera.

### Claim 16 (depends on 15)

The position estimating system according to claim 15, wherein the captured image is an image captured by the reference camera.

### Claim 17 (depends on 15)

The position estimating system according to claim 15, wherein the imaging apparatus is configured to transmit a range image obtained by the stereo camera to the position estimating apparatus.

### Claim 18

A position estimating apparatus comprising:
a memory storing instructions; and
one or more processors configured to execute the instructions to:
obtain an image coordinate representing an image position of a moving object in an image captured by an imaging apparatus; and
convert the image coordinate for the moving object to a real space coordinate for the moving object, based on information obtained from a correspondence between real space coordinate information indicating a predetermined point in a real space and image coordinate information representing the predetermined point.
