# US 2022/0030206 A1 · Information processing apparatus, information processing method, program, and projection system

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2022/0030206 A1
- Document ID: US20220030206A1
- Status: Published application
- Kind: A1
- Application number: 17/309,396
- Filed: 2019-11-12
- Published: 2022-01-27
- Earliest claimed: 2019-11-12
- Assignees: Sony Group Corporation
- Applicants: Sony Group Corporation
- Inventors: TAKUYA IKEDA; KENTARO IDA
- Web page: https://patentgrep.com/patent/US20220030206A1

## CPC

- H04N 9/3185: {Geometric adjustment, e.g. keystone or convergence (optical or mechanical adjustment of convergence H04N9/317; using scanning means H04N3/22; optical or mechanical adjustments of projectors not peculiar to the presence of an electronic spatial light modulator G03B21/14)}
- G03B 21/00: Projectors or projection-type viewers; Accessories therefor (devices for changing pictures G03B23/00)
- G09G 5/00: Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators (image data processing or generation, in general G06T)
- G09G 5/36: characterised by the display of a graphic pattern, e.g. using an all-points-addressable [APA] memory
- G09G 5/38: with means for controlling the display position
- H04N 9/3173: {wherein the projection device is specially adapted for enhanced portability}
- H04N 9/3182: {Colour adjustment, e.g. white balance, shading or gamut (white balance per se H04N9/73; control of amplitude of colour signals H04N9/68; colour control circuits for displays in general G09G5/02, G09G3/2003, G09G3/3607)}
- H04N 9/3194: {including sensor feedback}
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G03B: APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR (optical parts of such apparatus G02B; photosensitive materials or processes for photographic purposes G03C; apparatus for processing exposed photographic materials G03D)
- G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00)

## Abstract

[Object] An information processing apparatus according to the present technology includes a control unit. The control unit estimates a self-position of a projection apparatus in a real space in accordance with a movement of the projection apparatus and performs projection control of the projection apparatus on the basis of at least the estimated self-position.

## Claims

### Claim 1

An information processing apparatus, comprising
a control unit that estimates a self-position of a projection apparatus in a real space in accordance with a movement of the projection apparatus and performs projection control of the projection apparatus on a basis of at least the estimated self-position.

### Claim 2 (depends on 1)

The information processing apparatus according to claim 1, wherein
the control unit acquires space information of the real space and performs the projection control on a basis of the space information and the estimated self-position.

### Claim 3 (depends on 2)

The information processing apparatus according to claim 2, wherein
the control unit estimates the self-position of the projection apparatus on a basis of the space information.

### Claim 4 (depends on 3)

The information processing apparatus according to claim 3, wherein
the control unit calculates a feature quantity of the real space on a basis of the space information and estimates the self-position of the projection apparatus on a basis of the feature quantity.

### Claim 5 (depends on 4)

The information processing apparatus according to claim 4, wherein
the control unit performs the projection control on a basis of the feature quantity and the estimated self-position.

### Claim 6 (depends on 2)

The information processing apparatus according to claim 2, wherein
the control unit identifies a type of the real space on a basis of the space information.

### Claim 7 (depends on 6)

The information processing apparatus according to claim 6, wherein
the control unit calculates the feature quantity of the real space on a basis of the space information and identifies the real space on a basis of the feature quantity.

### Claim 8 (depends on 7)

The information processing apparatus according to claim 7, wherein
the control unit calculates a reprojection error on a basis of the feature quantity and identifies the real space in a case where the reprojection error is equal to or less than a predetermined threshold.

### Claim 9 (depends on 6)

The information processing apparatus according to claim 6, wherein
the control unit newly acquires the space information of the real space by scanning the real space by the projection apparatus in a case where the type of the real space can be identified.

### Claim 10 (depends on 9)

The information processing apparatus according to claim 9, wherein
the control unit estimates the self-position of the projection apparatus on a basis of the newly acquired space information.

### Claim 11 (depends on 10)

The information processing apparatus according to claim 10, wherein
the control unit performs the projection control on a basis of the newly acquired space information and the estimated self-position.

### Claim 12 (depends on 4)

The information processing apparatus according to claim 4, wherein
the control unit acquires shape data regarding a three-dimensional shape of the real space and calculates the feature quantity on a basis of at least the shape data.

### Claim 13 (depends on 12)

The information processing apparatus according to claim 12, wherein
the control unit calculates a two-dimensional feature quantity, a three-dimensional feature quantity, or a space size of the real space as the feature quantity.

### Claim 14 (depends on 6)

The information processing apparatus according to claim 6, wherein
the control unit performs a standby mode to identify the type of the real space and estimate the self-position of the projection apparatus.

### Claim 15 (depends on 1)

The information processing apparatus according to claim 1, wherein
the control unit includes generates a geometrically corrected video as the projection control.

### Claim 16 (depends on 15)

The information processing apparatus according to claim 15, wherein
the control unit causes the projection apparatus to project the geometrically corrected video to a position specified by a user.

### Claim 17

An information processing method, comprising:
by an information processing apparatus
estimating a self-position of a projection apparatus in a real space in accordance with a movement of the projection apparatus; and
performing projection control of the projection apparatus on a basis of at least the estimated self-position.

### Claim 18

A program that causes an information processing apparatus to execute:
a step of estimating a self-position of a projection apparatus in a real space in accordance with a movement of the projection apparatus; and
a step of performing projection control of the projection apparatus on a basis of at least the estimated self-position.

### Claim 19 (depends on 18)

A computer-readable recording medium recording the program according to claim 18.

### Claim 20

A projection system, comprising:
a projection apparatus that projects a video to a projection target; and
an information processing apparatus including a control unit that estimates a self-position of a projection apparatus in a real space in accordance with a movement of the projection apparatus and performs projection control of the projection apparatus on a basis of at least the estimated self-position.
