# US 2022/0036779 A1 · Information processing apparatus, information processing method, and recording medium

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2022/0036779 A1
- Document ID: US20220036779A1
- Status: Published application
- Kind: A1
- Application number: 17/278,817
- Filed: 2019-09-02
- Published: 2022-02-03
- Earliest claimed: 2018-10-04
- Assignees: Sony Corporation
- Applicants: Sony Corporation
- Inventors: Mitsuru NISHIBE; Atsushi ISHIHARA
- Web page: https://patentgrep.com/patent/US20220036779A1

## CPC

- G06F 3/013: {Eye tracking input arrangements (G06F3/015 takes precedence)}
- G09G 3/002: {to project the image of a two-dimensional display, such as an array of light emitting or modulating elements or a CRT}
- G06F 3/012: {Head tracking input arrangements}
- G06F 3/04815: Interaction with a metaphor-based environment or interaction object displayed as three-dimensional [3D], e.g. changing the user viewpoint with respect to the environment or object
- G06T 7/20: Analysis of motion (motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51)
- G09G 5/32: with means for controlling the display position {(see provisionally G09G5/42)}
- G02B 27/017: {Head mounted}
- G09G 5/10: Intensity circuits
- G09G 2320/0261: in the context of movement of objects on the screen or movement of the observer relative to the screen
- G09G 2340/0464: Positioning
- G09G 2354/00: Aspects of interface with display user
- G09G 2360/144: the light being ambient light
- G09G 2360/145: the light originating from the display screen
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS

## Abstract

An information processing apparatus including an acquisition unit configured to acquire first information regarding relative movement between a viewpoint and display information, and second information regarding a light emission period for presentation of the display information to a display region, and a control unit configured to cause the display information to be presented in the display region on the basis of the first information and the second information, in which the control unit corrects a presentation position of the display information in the display region according to the relative movement between the viewpoint and the display information in the light emission period.

## Claims

### Claim 1

An information processing apparatus comprising:
an acquisition unit configured to acquire first information regarding relative movement between a viewpoint and display information, and second information regarding a light emission period for presentation of the display information to a display region; and
a control unit configured to cause the display information to be presented in the display region on a basis of the first information and the second information, wherein
the control unit corrects a presentation position of the display information in the display region according to the relative movement between the viewpoint and the display information in the light emission period.

### Claim 2 (depends on 1)

The information processing apparatus according to claim 1, wherein the control unit corrects the presentation position of the display information in the display region on a basis of a center of the light emission period according to the second information.

### Claim 3 (depends on 2)

The information processing apparatus according to claim 2, wherein the control unit calculates a prediction time between timing set as a base point for predicting a deviation of the presentation position perceived by a user and the center of the light emission period, and corrects the presentation position of the display information in the display region on a basis of a change in a relative position between the viewpoint and the display information in the prediction time.

### Claim 4 (depends on 3)

The information processing apparatus according to claim 3, wherein the control unit controls a correction amount of the presentation position of the display information in the display region according to the prediction time.

### Claim 5 (depends on 3)

The information processing apparatus according to claim 3, wherein the control unit calculates the prediction time on a basis of at least either a delay regarding the correction of the presentation position of the display information according to at least either a position or an orientation of the viewpoint, or a delay regarding drawing of the display information.

### Claim 6 (depends on 1)

The information processing apparatus according to claim 1, wherein the control unit corrects the presentation position of the display information in the display region along a change direction of a relative position between the viewpoint and the display information.

### Claim 7 (depends on 1)

The information processing apparatus according to claim 1, wherein the control unit corrects a correction amount of the presentation position of the display information in the display region according to a change amount of a relative position between the viewpoint and the display information.

### Claim 8 (depends on 1)

The information processing apparatus according to claim 1, wherein the light emission period is controlled according to brightness of external light.

### Claim 9 (depends on 8)

The information processing apparatus according to claim 8, wherein the light emission period is controlled according to an adjustment amount of an influence of external light.

### Claim 10 (depends on 1)

The information processing apparatus according to claim 1, wherein the light emission period is controlled according to a light emission output for presentation of the display information to the display region.

### Claim 11 (depends on 1)

The information processing apparatus according to claim 1, wherein the first information is information according to a change in at least either of a position or an orientation of the viewpoint.

### Claim 12 (depends on 1)

The information processing apparatus according to claim 1, wherein the first information is information according to movement of an object displayed as the display information.

### Claim 13 (depends on 1)

The information processing apparatus according to claim 1, wherein the display region is a display region of a transmission-type output unit.

### Claim 14 (depends on 13)

The information processing apparatus according to claim 13, further comprising:
a support unit configured to support the display region of the output unit so as to be located in front of user's eyes in a state where the information processing apparatus is mounted on a user's head.

### Claim 15 (depends on 1)

The information processing apparatus according to claim 1, wherein the control unit causes the display information to be superimposed on an object in a real space on a basis of the first information.

### Claim 16 (depends on 1)

The information processing apparatus according to claim 1, wherein the control unit corrects, for each of partial regions included in the display region, the presentation position of the display information in the partial region on a basis of the relative movement between the viewpoint and the display information in the light emission period regarding the presentation of the display information to the partial region.

### Claim 17

An information processing method comprising:
by a computer,
acquiring first information regarding relative movement between a viewpoint and display information, and second information regarding a light emission period for presentation of the display information to a display region; and
causing the display information to be presented in the display region on a basis of the first information and the second information, wherein
a presentation position of the display information in the display region is corrected according to the relative movement between the viewpoint and the display information in the light emission period.

### Claim 18

A recording medium in which a program is recorded, the program for causing a computer to execute:
acquiring first information regarding relative movement between a viewpoint and display information, and second information regarding a light emission period for presentation of the display information to a display region; and
causing the display information to be presented in the display region on a basis of the first information and the second information, wherein
a presentation position of the display information in the display region is corrected according to the relative movement between the viewpoint and the display information in the light emission period.

### Claim 19

An information processing apparatus comprising:
a display control unit configured to control a display unit having optical transparency of a head-mounted display device such that a virtual object is located on the display unit at a predetermined absolute coordinate in a real space as viewed from a user who wears the display device, and
an illuminance information acquisition unit configured to acquire information regarding illuminance of external light from an illuminance sensor, wherein
the display control unit controls the display unit such that a light emission period becomes longer as the illuminance of the external light is higher,
in a case where the virtual object moves toward one direction in a display region of the display unit, the display control unit
displays the virtual object at a first position in the display region as viewed from the user in a case where the illuminance of the external light is first illuminance, and
displays the virtual object at a second position on a side of the one direction with respect to the first position in the display region as viewed from the user in a case where the illuminance of the external light is second illuminance higher than the first illuminance.

### Claim 20 (depends on 19)

The information processing apparatus according to claim 19, further comprising:
a recognition processing unit configured to acquire information regarding relative movement between a viewpoint of the user and the virtual object, wherein
the display control unit corrects a presentation position of the virtual object on the display unit according to relative movement between the viewpoint in the light emission period and the virtual object.
