# US 2025/0095187 A1 · Terminal device, position posture estimation method, and program

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0095187 A1
- Document ID: US20250095187A1
- Status: Published application
- Kind: A1
- Application number: 18/727,510
- Filed: 2023-01-05
- Published: 2025-03-20
- Earliest claimed: 2022-01-20
- Assignees: Sony Group Corporation
- Applicants: Sony Group Corporation
- Inventors: SHO KAGAMI; JUN GOMITA; MASAYA KANEKO
- Web page: https://patentgrep.com/patent/US20250095187A1

## CPC

- G06T 7/70: Determining position or orientation of objects or cameras (camera calibration G06T7/80)
- G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)}
- G06F 3/012: {Head tracking input arrangements}
- G06F 3/14: Digital output to display device {; Cooperation and interconnection of the display device with other functional units}
- G06T 7/73: using feature-based methods
- G06T 19/00: Manipulating three-dimensional [3D] models or images for computer graphics
- G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)}
- G06T 2207/30244: Camera pose
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

The present disclosure relates to a terminal device, a position posture estimation method, and a program that enable environment-independent display of AR content. A position estimation unit estimates an absolute position posture of an own device on the basis of a correspondence between a three-dimensional position included in object data of an object of interest to which a user pays attention and a position, on a camera image of the user, of the object of interest appearing in the camera image. The technology according to the present disclosure is applicable to, for example, an AR device that displays AR content on images of a real space.

## Claims

### Claim 1

A terminal device comprising
a position estimation unit configured to estimate an absolute position posture of an own device on a basis of a correspondence between a three-dimensional position included in object data of an object of interest to which a user pays attention and a position, on a camera image of the user, of the object of interest appearing in the camera image.

### Claim 2 (depends on 1)

The terminal device according to claim 1, wherein
the position estimation unit estimates a three-dimensional position and a posture of the own device as the absolute position posture.

### Claim 3 (depends on 2)

The terminal device according to claim 2, further comprising
an associating unit configured to associate the three-dimensional position of the object of interest with the position on the camera image of the object of interest.

### Claim 4 (depends on 3)

The terminal device according to claim 3, wherein
the associating unit associates the three-dimensional position of the object of interest with the position on the camera image of the object of interest on a basis of a feature of the object of interest included in the object data and the feature of the object of interest appearing in the camera image.

### Claim 5 (depends on 3)

The terminal device according to claim 3, wherein
the associating unit associates the three-dimensional position of the object of interest with the position on the camera image of the object of interest by recognizing, in the camera image, a sensor used to acquire the object data, the sensor being attached to the object of interest.

### Claim 6 (depends on 1)

The terminal device according to claim 1, further comprising
a delay compensation unit configured to correct the absolute position posture in accordance with an acquisition time at which the object data is acquired.

### Claim 7 (depends on 6)

The terminal device according to claim 6, further comprising
a relative position posture estimation unit configured to estimate an amount of change in relative position posture of the own device from the acquisition time on a basis of the camera image, wherein
the delay compensation unit corrects the absolute position posture on a basis of the amount of change in relative position posture that has been estimated.

### Claim 8 (depends on 6)

The terminal device according to claim 6, wherein
the delay compensation unit corrects the absolute position posture by further using a position, on the camera image, of the object of interest appearing in the camera image, the position being corrected in accordance with the acquisition time.

### Claim 9 (depends on 1)

The terminal device according to claim 1, further comprising
a display control unit configured to control display of content at a display position corresponding to the object of interest on a display area on a basis of the absolute position posture that has been estimated.

### Claim 10 (depends on 9)

The terminal device according to claim 9, wherein
the display control unit controls display of the content in the display area that transmits a real space including the object of interest.

### Claim 11 (depends on 10)

The terminal device according to claim 10,
configured as AR glasses.

### Claim 12 (depends on 9)

The terminal device according to claim 9, wherein
the display control unit controls display of the content superimposed on the camera image including the object of interest displayed in the display area.

### Claim 13 (depends on 12)

The terminal device according to claim 12,
configured as a smartphone.

### Claim 14 (depends on 9)

The terminal device according to claim 9, further comprising
a reception unit configured to receive the object data of the object of interest distributed together with the content from a server, the server being configured to generate the content.

### Claim 15 (depends on 9)

The terminal device according to claim 9, wherein
the object of interest includes a competitor, an animal, a machine, and equipment related to a sports competition, each joint of the competitor or the animal, and a part of the machine or the equipment, and
the content includes display information indicating a record of the sports competition, reproduction of a motion of the object of interest, and a trajectory of the object of interest.

### Claim 16

A position posture estimation method comprising
by a terminal device,
estimating an absolute position posture of an own device on a basis of a correspondence between a three-dimensional position included in object data of an object of interest to which a user pays attention and a position, on a camera image of the user, of the object of interest appearing in the camera image.

### Claim 17

A program for causing a computer to perform processing, the processing comprising
estimating an absolute position posture of a terminal device on a basis of a correspondence between a three-dimensional position included in object data of an object of interest to which a user pays attention and a position, on a camera image of the user, of the object of interest appearing in the camera image.
