# US 2022/0036076 A1 · Information processing apparatus, information processing method, and recording medium

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2022/0036076 A1
- Document ID: US20220036076A1
- Status: Published application
- Kind: A1
- Application number: 17/278,512
- Filed: 2019-09-06
- Published: 2022-02-03
- Earliest claimed: 2018-10-01
- Assignees: Sony Corporation
- Applicants: Sony Corporation
- Inventors: MIKI TOKITAKE; HIROAKI TORIUMI; KATSUJI MIYAZAWA; SHOJI WATANABE; TETSUO IKEDA; YOSHIHITO ICHIYAMA
- Web page: https://patentgrep.com/patent/US20220036076A1

## CPC

- G06V 20/20: in augmented reality scenes
- G03B 21/26: Projecting separately subsidiary matter simultaneously with main image
- G06F 3/0425: {using a single imaging device like a video camera for tracking the absolute position of a single or a plurality of objects with respect to an imaged reference surface, e.g. video camera imaging a display or a projection screen, a table or a wall surface, on which a computer generated image is displayed or projected (tracking a projected light spot to determine a position on a display surface G06F3/0386)}
- G06F 3/0484: for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
- G06F 3/0487: using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
- G06V 10/764: using classification, e.g. of video objects
- G06V 20/64: Three-dimensional [3D] objects
- G09G 5/00: Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators (image data processing or generation, in general G06T)
- G09G 5/38: with means for controlling the display position
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G03B: APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR (optical parts of such apparatus G02B; photosensitive materials or processes for photographic purposes G03C; apparatus for processing exposed photographic materials G03D)
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00)

## Abstract

There is provided an information processing apparatus including a projection control unit (150) that causes visual information to be projected onto a projection surface. The visual information corresponds to content that is provided to the projection surface and disposed on a first object. The content is identified on the basis of a recognition result of the first object and a recognition result of a second object. The second object is provided along with the first object.

## Claims

### Claim 1

An information processing apparatus comprising
a projection control unit that causes visual information to be projected onto a projection surface, the visual information corresponding to content that is provided to the projection surface and disposed on a first object, the content being identified on a basis of a recognition result of the first object and a recognition result of a second object, the second object being provided along with the first object.

### Claim 2 (depends on 1)

The information processing apparatus according to claim 1, wherein the second object is associated with each of pieces of the content.

### Claim 3 (depends on 1)

The information processing apparatus according to claim 1, wherein
the first object and the second object are continuously recognized, and
the projection control unit causes the visual information to be dynamically projected onto the projection surface on the basis of the recognition result of the first object and the recognition result of the second object.

### Claim 4 (depends on 1)

The information processing apparatus according to claim 1, wherein
the recognition result of the first object includes size of the first object, and
the projection control unit causes the visual information corresponding to the content to be projected onto the projection surface in accordance with the size of the first object.

### Claim 5 (depends on 4)

The information processing apparatus according to claim 4, wherein the projection control unit causes the visual information corresponding the content to be projected onto the projection surface in a case where the size of the first object is not included in a predetermined range, the content being identified on a basis of the recognition result of the second object.

### Claim 6 (depends on 1)

The information processing apparatus according to claim 1, wherein
the recognition results include a position of the first object and a position of the second object, and
the projection control unit causes the visual information corresponding to the content to be projected onto the projection surface on a basis of the position of the first object and the position of the second object.

### Claim 7 (depends on 6)

The information processing apparatus according to claim 6, wherein the projection control unit causes the visual information corresponding to the content to be projected onto the projection surface on a basis of the position of the first object in a case where the position of the second object is not included in a predetermined range, the position of the second object being based on the position of the first object.

### Claim 8 (depends on 1)

The information processing apparatus according to claim 1, further comprising a recognition unit that recognizes the first object and the second object, wherein
the projection control unit causes the visual information corresponding to the identified content to be projected onto the projection surface on the basis of the recognition result of the first object and the recognition result of the second object by the recognition unit.

### Claim 9 (depends on 8)

The information processing apparatus according to claim 8, wherein
the recognition unit recognizes a state change in the content, and
the projection control unit causes the visual information to be projected onto the projection surface in accordance with the state change.

### Claim 10 (depends on 9)

The information processing apparatus according to claim 9, wherein
the state change includes a mass change in the content, and
the projection control unit causes the visual information corresponding to the mass change to be projected onto the projection surface.

### Claim 11 (depends on 1)

The information processing apparatus according to claim 1, wherein the visual information is associated with each of pieces of the content.

### Claim 12 (depends on 1)

The information processing apparatus according to claim 1, wherein the projection control unit causes the visual information to be projected onto the first object.

### Claim 13 (depends on 1)

The information processing apparatus according to claim 1, wherein the projection control unit causes the visual information to be projected onto the projection surface on a basis of a recognition result of another object.

### Claim 14 (depends on 13)

The information processing apparatus according to claim 13, wherein
the projection control unit causes the visual information to be projected onto the projection surface on a basis of an interaction of the other object with the first object or the second object, and
the interaction includes the other object coming closer to or coming into contact with the first object or the second object.

### Claim 15 (depends on 1)

The information processing apparatus according to claim 1, wherein the projection control unit causes the visual information to be projected onto the projection surface on a basis of time elapsed since a projection of the visual information corresponding to the identified content is started.

### Claim 16 (depends on 1)

The information processing apparatus according to claim 1, wherein, in a case where a plurality of pieces of the content is identified, the projection control unit causes the visual information corresponding to the plurality of pieces of content to be projected onto the projection surface.

### Claim 17 (depends on 1)

The information processing apparatus according to claim 1, wherein
the content includes a food product, and
the second object is provided along with the food product.

### Claim 18 (depends on 17)

The information processing apparatus according to claim 17, wherein the projection control unit causes a projection of the visual information onto the projection surface to be started at a timing at which the food product is provided.

### Claim 19

An information processing method comprising
causing, by a processor, visual information to be projected onto a projection surface, the visual information corresponding to content that is provided to the projection surface and disposed on a first object, the content being identified on a basis of a recognition result of the first object and a recognition result of a second object, the second object being provided along with the first object.

### Claim 20

A computer-readable recording medium having a program recorded thereon, the program causing a computer to achieve
a projection control function of causing visual information to be projected onto a projection surface, the visual information corresponding to content that is provided to the projection surface and disposed on a first object, the content being identified on a basis of a recognition result of the first object and a recognition result of a second object, the second object being provided along with the first object.
