# US 2020/0394841 A1 · Information processing apparatus, information processing method, and storage medium

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2020/0394841 A1
- Document ID: US20200394841A1
- Status: Published application
- Kind: A1
- Application number: 16/097,731
- Filed: 2017-02-27
- Published: 2020-12-17
- Earliest claimed: 2016-05-26
- Assignees: Sony Corporation
- Applicants: Sony Corporation
- Inventors: Akihiko KAINO; Shunichi HOMMA; Masaki FUKUCHI
- Web page: https://patentgrep.com/patent/US20200394841A1

## CPC

- G06T 19/00: Manipulating three-dimensional [3D] models or images for computer graphics
- G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)}
- G06T 7/50: Depth or shape recovery
- G06T 2200/24: involving graphical user interfaces [GUIs]
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

There is provided an information processing apparatus to bring a three-dimensional model generated in accordance with observation information, closer to a real object. The information processing apparatus includes: a control section configured to allocate, to a second three-dimensional model being at least a partial three-dimensional model included in a first three-dimensional model, a definite shaped model having a predetermined shape corresponding to a shape of the second three-dimensional model.

## Claims

### Claim 1

An information processing apparatus comprising:
a control section configured to allocate, to a second three-dimensional model being at least a partial three-dimensional model included in a first three-dimensional model, a definite shaped model having a predetermined shape corresponding to a shape of the second three-dimensional model.

### Claim 2 (depends on 1)

The information processing apparatus according to claim 1, comprising
a storage section configured to store a plurality of the definite shaped models,
wherein the control section selects, from among the plurality of definite shaped models stored in the storage section, the definite shaped model to be allocated.

### Claim 3 (depends on 2)

The information processing apparatus according to claim 2, herein the control section performs selection in accordance with a degree of similarity between the second three-dimensional model and the definite shaped model.

### Claim 4 (depends on 3)

The information processing apparatus according to claim 3, wherein the degree of similarity is evaluated by a distance between a feature point included in the second three-dimensional model, and a vertex included in the definite shaped model.

### Claim 5 (depends on 3)

The information processing apparatus according to claim 3, wherein the degree of similarity is evaluated by a degree of coincidence of normal lines between a feature point included in the second three-dimensional model, and a vertex included in the definite shaped model.

### Claim 6 (depends on 3)

The information processing apparatus according to claim 3, wherein the degree of similarity is evaluated by a degree of coincidence of directions of gravitational force between the second three-dimensional model and the definite shaped model.

### Claim 7 (depends on 2)

The information processing apparatus according to claim 2, wherein the control section performs selection in accordance with a user manipulation.

### Claim 8 (depends on 2)

The information processing apparatus according to claim 2, wherein the control section deletes, from the first three-dimensional model, a three-dimensional model having a predetermined relationship with the allocated definite shaped model.

### Claim 9 (depends on 1)

The information processing apparatus according to claim 1, wherein the control section generates display control information for causing a virtual object corresponding to the allocated definite shaped model included in the first three-dimensional model, to be displayed.

### Claim 10 (depends on 9)

The information processing apparatus according to claim 9, wherein the display control information includes information for causing the virtual object corresponding to a portion of the first three-dimensional model to which the definite shaped model is unallocated, to be displayed.

### Claim 11 (depends on 9)

The information processing apparatus according to claim 9, wherein the display control information includes information for causing information prompting a user to perform additional observation for making the first three-dimensional model more detailed, to be displayed.

### Claim 12 (depends on 9)

The information processing apparatus according to claim 9,
wherein the first three-dimensional model is a three-dimensional model of a surrounding real space of a user, and
the display control information includes information for causing a virtual object prompting a user to avoid approaching the allocated definite shaped model included in the first three-dimensional model, to be displayed.

### Claim 13 (depends on 9)

The information processing apparatus according to claim 9,
wherein the first three-dimensional model is a three-dimensional model of a surrounding real space of a user, and
the display control information includes information for causing information for giving a user a warning against approach to the allocated definite shaped model included in the first three-dimensional model, to be displayed.

### Claim 14 (depends on 1)

The information processing apparatus according to claim 1, wherein the definite shaped model includes relative coordinates of a plurality of vertices, and information indicating a surface including the plurality of vertices.

### Claim 15 (depends on 14)

The information processing apparatus according to claim 14, wherein the definite shaped model includes at least any of information indicating texture of the surface, information indicating material, information indicating a normal line direction of the surface, or information indicating a grounding surface.

### Claim 16 (depends on 1)

The information processing apparatus according claim 1, wherein the three-dimensional model is a point cloud.

### Claim 17 (depends on 1)

The information processing apparatus according to claim 1, wherein the three-dimensional model is a polygon.

### Claim 18 (depends on 1)

The information processing apparatus according to claim 1, wherein the definite shaped model is a polygon,

### Claim 19

An information processing method comprising:
allocating, by a processor, to a second three-dimensional model being at least a partial three-dimensional model included in a first three-dimensional model, a definite shaped model having a predetermined shape corresponding to a shape of the second three-dimensional model.

### Claim 20

A storage medium having a program stored therein, the program causing a computer to function as:
a control section configured to allocate, to a second three-dimensional model being at least a partial three-dimensional model included in a first three-dimensional model, a definite shaped model having a predetermined shape corresponding to a shape of the second three-dimensional model.
