# US 2020/0264432 A1 · Image generation apparatus and image generation method

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2020/0264432 A1
- Document ID: US20200264432A1
- Status: Published application
- Kind: A1
- Application number: 16/867,716
- Filed: 2020-05-06
- Published: 2020-08-20
- Earliest claimed: 2013-11-11
- Assignees: Sony Interactive Entertainment Inc.; Sony Interactive Entertainment Europe Limited
- Applicants: Sony Interactive Entertainment Inc.; Sony Interactive Entertainment Europe Limited
- Inventors: Tomohiro Oto; Simon Mark Benson; Ian Henry Bickerstaff
- Web page: https://patentgrep.com/patent/US20200264432A1

## CPC

- G02B 27/017: {Head mounted}
- A63F 13/25: Output arrangements for video game devices
- G06F 3/012: {Head tracking input arrangements}
- G06T 15/20: Perspective computation
- G06T 19/003: {Navigation within 3D models or images}
- G02B 2027/0123: {comprising devices increasing the field of view}
- G02B 2027/014: {comprising information/image processing systems}
- G02B 2027/0187: {slaved to motion of at least a part of the body of the user, e.g. head, eye}
- G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- A63F: CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

Methods and apparatus provide for receiving an image to be displayed on the head-mounted display unit generated in a first frequency by an image generation apparatus using information relating to at least one of a position and a rotation of the head of a user who wears a head-mounted display unit, where the information is acquired at a certain point of time; correcting the image using updated information relating to at least one of the position and the rotation at a different point of time, where the receiving and correcting includes receiving updated information relating to at least one of a position and a rotation in a second frequency corresponding to a frame rate of the head-mounted display unit, and performing multiple times of correction of the image in the first frequency using a plurality of the updated information relating to at least one of the position and the rotation received in the second frequency higher than the first frequency.

## Claims

### Claim 1

An image generation apparatus, comprising:
a processor coupled to a memory storing instructions that when executed by the processor, configure the processor to implement:
an acquisition process to acquire information relating to at least one of a position and a rotation of the head of a user who wears a head-mounted display unit;
an image generation process to generate an image to be displayed on the head-mounted display unit in a first frequency lower than a second frequency corresponding to a frame rate of the head-mounted display unit using information relating to at least one of a position and a rotation acquired at a certain point of time by the acquisition process.

### Claim 2 (depends on 1)

The image generation apparatus according to claim 1, wherein the image generation apparatus is a server.

### Claim 3

A head-mounted display unit, comprising:
a processor coupled to a memory storing instructions that when executed by the processor, configure the processor to implement:
a correction processing process to receive an image to be displayed on the head-mounted display unit generated in a first frequency by an image generation apparatus using information relating to at least one of a position and a rotation of the head of a user who wears a head-mounted display unit acquired at a certain point of time and correct the image generated by the image generation apparatus using updated information relating to at least one of the position and the rotation at a different point of time, wherein:
the correction processing process receives updated information relating to at least one of a position and a rotation in a second frequency corresponding to a frame rate of the head-mounted display unit and performs multiple times of correction of the image generated by the image generation apparatus in the first frequency using a plurality of the updated information relating to at least one of the position and the rotation received in the second frequency higher than the first frequency.

### Claim 4 (depends on 3)

The head-mounted display unit according to claim 3, wherein the correction processing process receives n (where n is an integer equal to or greater than 2) pieces of the updated information relating to at least one of the position and the rotation in the second frequency higher than the first frequency and performs n times of correction of the same image generated by the image generation apparatus in the first frequency using the n pieces of the updated information relating to at least one of the position and the rotation.

### Claim 5 (depends on 3)

The head-mounted display unit according to claim 3, wherein the correction processing process receives n (where n is an integer equal to or greater than 2) pieces of the updated information relating to at least one of the position and the rotation in the second frequency higher than the first frequency and performs the first correction of the image generated by the image generation apparatus in the first frequency using the first piece of the updated information relating to at least one of the position and the rotation and then performs the i-th (where i=2, . . . , n) correction of the image corrected by the (i−1)-th correction using the i-th piece of the updated information relating to at least one of the position and the rotation.

### Claim 6 (depends on 3)

The head-mounted display unit according to claim 3, wherein the correction processing process, when the correction of the image causes a missing portion, fills up the missing portion with a color of pixels on an outermost periphery of the image.

### Claim 7 (depends on 3)

The head-mounted display unit according to claim 3, wherein the correction processing process, when the correction of the image causes a missing portion, fills up the missing portion with a predetermined single color.

### Claim 8 (depends on 3)

The head-mounted display unit according to claim 3, wherein the image generation apparatus renders a region greater than the outermost periphery of the image in advance so that the correction of the image causes no missing portion.

### Claim 9 (depends on 3)

The head-mounted display unit according to claim 3, wherein the correction processing process performs the correction of the image controlling a movement amount between different time points so that the correction of the image causes no missing portion.

### Claim 10 (depends on 9)

The head-mounted display unit according to claim 9, wherein the correction processing process limits the movement amount to a predetermined limit value and when the movement amount exceeds the predetermined limit value, performs the correction of the image assuming that the movement amount is the predetermined limit value.

### Claim 11 (depends on 9)

The head-mounted display unit according to claim 9, wherein the correction processing process, when the movement amount exceeds a predetermined limit value, does not perform the correction of the image but performs an error process.

### Claim 12 (depends on 9)

The head-mounted display unit according to claim 9, wherein the correction processing process sets a first limit value and a second limit value greater than the first limit value and when the movement amount exceeds the first limit value but is equal to or smaller than the second limit value, performs the correction of the image assuming that the movement amount is the first limit value, and when the movement amount exceeds the second limit value, does not perform the correction of the image but performs an error process.

### Claim 13

An image correction method, comprising:
receiving an image to be displayed on the head-mounted display unit generated in a first frequency by an image generation apparatus using information relating to at least one of a position and a rotation of the head of a user who wears a head-mounted display unit, where the information is acquired at a certain point of time; and
correcting the image using updated information relating to at least one of the position and the rotation at a different point of time,
wherein the receiving and correcting includes receiving updated information relating to at least one of a position and a rotation in a second frequency corresponding to a frame rate of the head-mounted display unit, and performing multiple times of correction of the image in the first frequency using a plurality of the updated information relating to at least one of the position and the rotation received in the second frequency higher than the first frequency.

### Claim 14

A non-transitory computer-readable medium that stores therein a program causing a computer to execute an image generation method, the method comprising:
receiving an image to be displayed on the head-mounted display unit generated in a first frequency by an image generation apparatus using information relating to at least one of a position and a rotation of the head of a user who wears a head-mounted display unit, where the information is acquired at a certain point of time; and
correcting the image using updated information relating to at least one of the position and the rotation at a different point of time,
wherein the receiving and correcting includes receiving updated information relating to at least one of a position and a rotation in a second frequency corresponding to a frame rate of the head-mounted display unit, and performing multiple times of correction of the image in the first frequency using a plurality of the updated information relating to at least one of the position and the rotation received in the second frequency higher than the first frequency.

### Claim 15

A system comprising an image generation apparatus and a head-mounted display unit, wherein the image generation apparatus comprises:
a processor coupled to a memory storing instructions that when executed by the processor, configure the processor to implement:
an acquisition process to acquire information relating to at least one of a position and a rotation of the head of a user who wears a head-mounted display unit;
an image generation process to generate an image to be displayed on the head-mounted display unit in a first frequency lower than a second frequency corresponding to a frame rate of the head-mounted display unit using information relating to at least one of a position and a rotation acquired at a certain point of time by the acquisition process, and
wherein the head-mounted display unit comprises:
a processor coupled to a memory storing instructions that when executed by the processor, configure the processor to implement:
a correction processing process to receive an image to be displayed on the head-mounted display unit generated in a first frequency by an image generation apparatus using information relating to at least one of a position and a rotation of the head of a user who wears a head-mounted display unit acquired at a certain point of time and correct the image generated by the image generation apparatus using updated information relating to at least one of the position and the rotation at a different point of time, wherein:
the correction processing process receives updated information relating to at least one of a position and a rotation in a second frequency corresponding to a frame rate of the head-mounted display unit and performs multiple times of correction of the image generated by the image generation apparatus in the first frequency using a plurality of the updated information relating to at least one of the position and the rotation received in the second frequency higher than the first frequency.
