# US 2023/0148185 A1 · Information processing apparatus, information processing method, and recording medium

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2023/0148185 A1
- Document ID: US20230148185A1
- Status: Published application
- Kind: A1
- Application number: 18/003,373
- Filed: 2021-06-18
- Published: 2023-05-11
- Earliest claimed: 2020-07-02
- Assignees: Sony Group Corporation
- Applicants: Sony Group Corporation
- Inventors: RYO FUKAZAWA; HIROTAKE ICHIKAWA
- Web page: https://patentgrep.com/patent/US20230148185A1

## CPC

- G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)}
- G02B 27/0172: {characterised by optical features}
- G06F 3/0346: with detection of the device orientation or free movement in a three-dimensional [3D] space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
- G06F 3/0481: based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
- G06T 19/20: Editing of three-dimensional [3D] images, e.g. changing shapes or colours, aligning objects or positioning parts
- G06T 2219/2016: Rotation, translation, scaling
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

The present technology relates to an information processing apparatus, an information processing method, and a recording medium which can more appropriately arrange a virtual object. By providing the information processing apparatus including a control unit that restricts a size of an environment map data in which a virtual object is arranged, on the basis of a detection result by a sensor of a real space associated with the environment map data, it is possible to more appropriately arrange a virtual object. For example, the present technology can be applied to an AR HMD.

## Claims

### Claim 1

An information processing apparatus comprising:
a control unit that restricts a size of an environment map data in which a virtual object is arranged, on a basis of a detection result by a sensor of a real space associated with the environment map data.

### Claim 2 (depends on 1)

The information processing apparatus according to claim 1,
wherein the detection result includes a position of a dynamic object detected by the sensor, and
the control unit restricts a range of the environment map data on a basis of the position of the dynamic object.

### Claim 3 (depends on 2)

The information processing apparatus according to claim 2,
wherein the dynamic object includes a mobile terminal provided with the sensor, and
the control unit excludes the range of the environment map data which does not include a self-position of the mobile terminal.

### Claim 4 (depends on 3)

The information processing apparatus according to claim 3,
wherein the environment map data is generated on a basis of an image captured by the mobile terminal, and
a range of the self-position of the mobile terminal detected by the sensor is narrower than the range of the environment map data.

### Claim 5 (depends on 2)

The information processing apparatus according to claim 2,
wherein the control unit restricts the range of the environment map data on a basis of an area in the real space estimated on a basis of the position of the dynamic object.

### Claim 6 (depends on 5)

The information processing apparatus according to claim 5,
wherein the dynamic object is an imaging object included in an image captured by a mobile terminal provided with the sensor, and
the control unit excludes a position of the imaging object and a movement route of the imaging object from the range of the environment map data.

### Claim 7 (depends on 2)

The information processing apparatus according to claim 2,
wherein the environment map data is data indicating a three-dimensional structure,
the dynamic object is a person object, and
the control unit restricts the range of the environment map data in a vertical direction on a basis of a visual field range at a position of the person object.

### Claim 8 (depends on 2)

The information processing apparatus according to claim 2,
wherein the dynamic object is a person object, and
the control unit restricts the range of the environment map data on a basis of a movement route according to a position of the person object.

### Claim 9 (depends on 2)

The information processing apparatus according to claim 2,
wherein the dynamic object is a moving object that includes a person object including a player or a non-player, or a moving subject excluding a person.

### Claim 10 (depends on 7)

The information processing apparatus according to claim 7,
wherein the detection result includes a moving speed of the person object detected by the sensor, and
the control unit restricts the range of the environment map data on a basis of the moving speed of the person object.

### Claim 11 (depends on 10)

The information processing apparatus according to claim 10,
wherein the control unit determines whether or not the moving speed is equal to or greater than a first threshold, and
in a case where it is determined that the moving speed is equal to or greater than the first threshold, the control unit restricts the range of the environment map data in the vertical direction at the position of the person object.

### Claim 12 (depends on 7)

The information processing apparatus according to claim 7,
wherein the detection result includes a stay time of the person object detected by the sensor, and
the control unit restricts the range of the environment map data on a basis of the stay time of the person object.

### Claim 13 (depends on 12)

The information processing apparatus according to claim 12,
wherein the control unit determines whether or not the stay time is less than a second threshold, and
in a case where it is determined that the stay time is less than the second threshold, the control unit restricts the range of the environment map data in the vertical direction at the position of the person object.

### Claim 14 (depends on 1)

The information processing apparatus according to claim 1,
wherein the detection result is obtained at a time of activation or before activation of an application.

### Claim 15 (depends on 14)

The information processing apparatus according to claim 14,
wherein the application is an AR application, and
the control unit performs control such that the virtual object arranged in the environment map data is displayed on a transmissive display.

### Claim 16 (depends on 14)

The information processing apparatus according to claim 14, further comprising:
a storage unit that records the detection result.

### Claim 17 (depends on 1)

The information processing apparatus according to claim 1,
wherein the information processing apparatus is configured as a mobile terminal provided with the sensor.

### Claim 18 (depends on 17)

The information processing apparatus according to claim 17,
wherein the mobile terminal is a head mounted display capable of executing an AR application.

### Claim 19

An information processing method comprising:
restricting a size of an environment map data in which a virtual object is arranged, on a basis of a detection result by a sensor of a real space associated with the environment map data
by an information processing apparatus.

### Claim 20

A recording medium in which a program is recorded, the program causing a computer to function as:
a control unit that restricts a size of an environment map data in which a virtual object is arranged, on a basis of a detection result by a sensor of a real space associated with the environment map data.
