# US 2019/0377188 A1 · Image generation device, image extraction device, image generation method, and image extraction method

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0377188 A1
- Document ID: US20190377188A1
- Status: Published application
- Kind: A1
- Application number: 16/516,818
- Filed: 2019-07-19
- Published: 2019-12-12
- Earliest claimed: 2014-10-24
- Assignees: Sony Interactive Entertainment Inc.
- Applicants: Sony Interactive Entertainment Inc.
- Inventors: Sachiyo Aoki
- Web page: https://patentgrep.com/patent/US20190377188A1

## CPC

- G02B 27/0172: {characterised by optical features}
- G02B 27/0068: {having means for controlling the degree of correction, e.g. using phase modulators, movable elements (controlling the phase of light using moving or deformable elements G02B26/06)}
- G02B 27/017: {Head mounted}
- G06T 5/80: Geometric correction
- H04N 7/007: {Systems with supplementary picture signal insertion during a portion of the active part of a television signal, e.g. during top and bottom lines in a HDTV letter-box system}
- H04N 7/0806: {the signals being two or more video signals (H04N7/0803, H04N7/081 take precedence)}
- H04N 13/111: Transformation of image signals corresponding to virtual viewpoints, e.g. spatial image interpolation
- H04N 13/156: Mixing image signals
- H04N 13/344: with head-mounted left-right displays
- G02B 2027/011: {comprising device for correcting geometrical aberrations, distortion}
- G02B 2027/0123: {comprising devices increasing the field of view}
- G02B 2027/014: {comprising information/image processing systems}
- H04N 5/64: Constructional details of receivers, e.g. cabinets or dust covers (furniture aspects {of television cabinets} A47B81/06)
- G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

Methods and apparatus provide for: receiving an embedded image having different information embedded in an unused area of a rectangular image format for transmitting a primary image obtained by correcting beforehand an original image in a manner canceling out the distortion thereof that appears when viewed through lenses of a head-mounted display; outputting directly to a panel of the head-mounted display the embedded image received by the receiving section; and recomposing the different information by extracting the data thereof from the unused area for the embedded image.

## Claims

### Claim 1

An information extraction device comprising:
a receiving section configured to receive an embedded image having different information embedded in an unused area of a rectangular image format for transmitting a primary image obtained by correcting beforehand an original image in a manner canceling out the distortion thereof that appears when viewed through lenses of a head-mounted display;
a display outputting section configured to output directly to a panel of the head-mounted display the embedded image received by the receiving section; and
a different information recomposing section configured to recompose the different information by extracting the data thereof from the unused area for the embedded image.

### Claim 2 (depends on 1)

The information extraction device of claim 1, wherein the different information includes at least one of: audio data, information indicative of a content of the primary image, data for controlling a way the primary image is to be displayed, data for controlling a way the different information is to be displayed, data for device control of the head-mounted display, information for brightening a screen, information for turning or deforming the different information in keeping with characteristics of the head-mounted display, command data for adjusting a focus of the head-mounted display, and correction amounts reflecting a real-time attitude information about the head-mounted display.

### Claim 3 (depends on 1)

The information extraction device of claim 1, wherein:
a lens distortion correcting section of an image generation device generates the primary image;
a different information embedding section of the image generation device generates the embedded image;
a transmitting section of the image generation device transfers the embedded image to the head-mounted display; and
the different information is output to the panel of the head-mounted display either in place of, or along with, the primary image.

### Claim 4 (depends on 1)

The information extraction device of claim 1, wherein, while holding the embedded image in a memory, the different information recomposing section further writes the recomposed different image back to the memory.

### Claim 5 (depends on 4)

The information extraction device according to claim 4, wherein the display outputting section outputs the different information recomposed in the memory to the panel of the head-mounted display either in place of, or along with, the primary image.

### Claim 6 (depends on 5)

The information extraction device according to claim 5, wherein the different information is an image captured of the outside world of a user wearing the head-mounted display.

### Claim 7 (depends on 4)

The information extraction device according to claim 4, wherein the display outputting section outputs the different information recomposed in the memory to an external display connected to the head-mounted display.

### Claim 8 (depends on 7)

The information extraction device according to claim 7, wherein the different information is the original image yet to be corrected in a manner canceling out the distortion thereof.

### Claim 9

An information extraction method, comprising:
receiving an embedded image having different information embedded in an unused area of a rectangular image format for transmitting a primary image obtained by correcting beforehand an original image in a manner canceling out the distortion thereof that appears when viewed through lenses of a head-mounted display;
outputting directly to a panel of the head-mounted display the embedded image received by the receiving section; and
recomposing the different information by extracting the data thereof from the unused area for the embedded image.

### Claim 10 (depends on 9)

The information extraction method of claim 9, wherein the different information includes at least one of: audio data, information indicative of a content of the primary image, data for controlling a way the primary image is to be displayed, data for controlling a way the different information is to be displayed, data for device control of the head-mounted display, information for brightening a screen, information for turning or deforming the different information in keeping with characteristics of the head-mounted display, command data for adjusting a focus of the head-mounted display, and correction amounts reflecting a real-time attitude information about the head-mounted display.

### Claim 11 (depends on 9)

The information extraction method of claim 9, further comprising:
generating the primary image;
generating the embedded image; and
transferring the embedded image to the head-mounted display,
wherein the different information is output to the panel of the head-mounted display either in place of, or along with, the primary image.

### Claim 12 (depends on 9)

The information extraction method of claim 9, wherein, while holding the embedded image in a memory, writing the recomposed different image back to the memory.

### Claim 13 (depends on 12)

The information extraction method according to claim 12, further comprising outputting the different information recomposed in the memory to the panel of the head-mounted display either in place of, or along with, the primary image.

### Claim 14 (depends on 13)

The information extraction method according to claim 13, wherein the different information is an image captured of the outside world of a user wearing the head-mounted display.

### Claim 15 (depends on 12)

The information extraction method according to claim 12, further comprising outputting the different information recomposed in the memory to an external display connected to the head-mounted display.

### Claim 16 (depends on 15)

The information extraction method according to claim 15, wherein the different information is the original image yet to be corrected in a manner canceling out the distortion thereof.
