# US 2025/0147576 A1 · Information processing apparatus, information processing method, and information processing program

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0147576 A1
- Document ID: US20250147576A1
- Status: Published application
- Kind: A1
- Application number: 18/838,242
- Filed: 2023-02-08
- Published: 2025-05-08
- Earliest claimed: 2022-03-16
- Assignees: Sony Group Corporation
- Applicants: Sony Group Corporation
- Inventors: Naofumi FUKASAWA; Yasutaka FUKUMOTO; Tetsuro SATO
- Web page: https://patentgrep.com/patent/US20250147576A1

## CPC

- G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)}
- A61B 5/0077: {Devices for viewing the surface of the body, e.g. camera, magnifying lens}
- A61B 5/1116: {Determining posture transitions}
- A61B 5/1128: {using image analysis (A61B5/1127 takes precedence)}
- G06T 7/251: {involving models}
- G06T 7/277: involving stochastic approaches, e.g. using Kalman filters
- G06T 7/292: Multi-camera tracking
- G06T 7/75: {involving models}
- G06T 7/77: using statistical methods
- G06T 11/00: Two-dimensional [2D] image generation
- A61B 2562/0219: Inertial sensors, e.g. accelerometers, gyroscopes, tilt switches
- G06T 2207/10016: Video; Image sequence
- G06T 2207/20076: Probabilistic image processing
- G06T 2207/30196: Human being; Person
- G06T 2207/30241: Trajectory
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

An information processing apparatus (100) according to an embodiment of the present disclosure includes: a first acquisition unit configured to acquire, from an inertial sensor attached to a moving body, inertial information associated with a movement of the moving body; a second acquisition unit configured to acquire first image information obtained by imaging the moving body from a first camera; and a calculation unit configured to calculate third posture information on the basis of first posture information of the moving body obtained on the basis of the inertial information acquired by the first acquisition unit and second posture information of the moving body obtained on the basis of the first image information acquired by the second acquisition unit.

## Claims

### Claim 1

An information processing apparatus comprising:
a first acquisition unit configured to acquire, from an inertial sensor attached to a moving body, inertial information associated with a movement of the moving body;
a second acquisition unit configured to acquire first image information obtained by imaging the moving body from a first camera; and
a calculation unit configured to calculate third posture information on a basis of first posture information of the moving body obtained on a basis of the inertial information acquired by the first acquisition unit and second posture information of the moving body obtained on a basis of the first image information acquired by the second acquisition unit.

### Claim 2 (depends on 1)

The information processing apparatus according to claim 1, wherein
the calculation unit
calculates the third posture information by correcting the first posture information on a basis of the second posture information.

### Claim 3 (depends on 2)

The information processing apparatus according to claim 2, wherein
the calculation unit
estimates a degree of reliability regarding the second posture information, and performs the correction according to the degree of reliability.

### Claim 4 (depends on 3)

The information processing apparatus according to claim 3, wherein
the calculation unit
estimates the degree of reliability according to reliability of environment information when the first camera images the moving body or of the second posture information of the moving body obtained from the first image information.

### Claim 5 (depends on 1)

The information processing apparatus according to claim 1, further comprising:
a display control unit configured to perform display control of an object coupled to the movement of the moving body on a basis of the third posture information.

### Claim 6 (depends on 5)

The information processing apparatus according to claim 5, wherein
the display control unit
displays the object by superimposing the object on the first image information.

### Claim 7 (depends on 5)

The information processing apparatus according to claim 5, wherein
the second acquisition unit
acquires second image information including a background image from a second camera different from the first camera.

### Claim 8 (depends on 7)

The information processing apparatus according to claim 7, wherein
the display control unit
displays the object by superimposing the object on the background image included in the second image information.

### Claim 9 (depends on 5)

The information processing apparatus according to claim 5, wherein,
in a case of detecting contact of at least a part of the moving body with a target object on a basis of the first image information, the display control unit performs display control of the object in response to the detection.

### Claim 10 (depends on 1)

The information processing apparatus according to claim 1, wherein
the calculation unit
performs preprocessing of calculating a predetermined parameter such that size and joint information of the moving body obtained from the inertial information matches size and joint information of the moving body obtained from the first image information, and calculates the third posture information on a basis of the preprocessing.

### Claim 11 (depends on 10)

The information processing apparatus according to claim 10, wherein
the calculation unit
recalculates the predetermined parameter in the preprocessing on a basis of position and posture information of the first camera estimated on a basis of the first image information, and calculates the third posture information on a basis of a result of the recalculation.

### Claim 12 (depends on 7)

The information processing apparatus according to claim 7, wherein
the display control unit
detects expression information of the moving body on a basis of the first image information or the second image information, and performs display control of the object on a basis of a detection result.

### Claim 13 (depends on 7)

The information processing apparatus according to claim 7, wherein
the display control unit
detects finger information of the moving body on a basis of the first image information or the second image information, and performs display control of the object on a basis of a detection result.

### Claim 14 (depends on 1)

The information processing apparatus according to claim 1, wherein
the first acquisition unit
acquires, from the inertial sensors attached to a plurality of the moving bodies that is different, a plurality of pieces of the inertial information associated with the movements of the respective moving bodies,
the second acquisition unit
acquires third image information obtained by simultaneously imaging the plurality of different moving bodies, and
the calculation unit
determines a degree of similarity between the first posture information of each of the plurality of different moving bodies obtained on a basis of the inertial information and the second posture information of each of the plurality of different moving bodies obtained from the third image information, specifies the second posture information corresponding to the first posture information of the plurality of different moving bodies on a basis of the determined degree of similarity, and then calculates the third posture information of each of the plurality of different moving bodies.

### Claim 15 (depends on 1)

The information processing apparatus according to claim 1, further comprising:
a communication unit configured to provide the third posture information to another apparatus that performs display control of an object coupled to the movement of the moving body on a basis of the third posture information.

### Claim 16

An information processing method comprising:
by a computer,
acquiring, from an inertial sensor attached to a moving body, inertial information associated with a movement of the moving body;
acquiring first image information obtained by imaging the moving body from a first camera; and
calculating third posture information on a basis of first posture information of the moving body obtained on a basis of the inertial information and second posture information of the moving body obtained on a basis of the first image information.

### Claim 17

An information processing program for causing a computer to function as an information processing apparatus including:
a first acquisition unit configured to acquire, from an inertial sensor attached to a moving body, inertial information associated with a movement of the moving body;
a second acquisition unit configured to acquire first image information obtained by imaging the moving body from a first camera; and
a calculation unit configured to calculate third posture information on a basis of first posture information of the moving body obtained on a basis of the inertial information acquired by the first acquisition unit and second posture information of the moving body obtained on a basis of the first image information acquired by the second acquisition unit.
