# US 2015/0177829 A1 · Image processing device and image processing method, display device and display method, computer program, and image display system

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2015/0177829 A1
- Document ID: US20150177829A1
- Status: Published application
- Kind: A1
- Application number: 14/568,559
- Filed: 2014-12-12
- Published: 2015-06-25
- Earliest claimed: 2013-12-25
- Assignees: Sony Corporation
- Applicants: Sony Corporation
- Inventors: Mariko Sakuta; Yoichi Hirota
- Web page: https://patentgrep.com/patent/US20150177829A1

## CPC

- G06F 3/012: {Head tracking input arrangements}
- G02B 27/017: {Head mounted}
- G06F 1/163: {Wearable computers, e.g. on a belt}
- G06F 3/0346: with detection of the device orientation or free movement in a three-dimensional [3D] space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
- G06F 3/0488: using a touch-screen or digitiser, e.g. input of commands through traced gestures
- G02B 2027/014: {comprising information/image processing systems}
- G02B 2027/0147: {comprising a device modifying the resolution of the displayed image}
- G02B 2027/0187: {slaved to motion of at least a part of the body of the user, e.g. head, eye}
- G06F 2203/0381: Multimodal input, i.e. interface arrangements enabling the user to issue commands by simultaneous use of input devices of different nature, e.g. voice plus gesture on digitizer
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS

## Abstract

An image processing device includes an orientation information acquisition unit which acquires orientation information of a head portion of a user that observes a display image of a display device; an angle of view switching unit which switches an angle of view of the display image; a rendering process unit which generates the display image based on the orientation information and the angle of view; and a transmission unit which transmits the generated image to the display device.

## Claims

### Claim 1

An image processing device comprising:
an orientation information acquisition unit which acquires orientation information of a head portion of a user that observes a display image of a display device;
an angle of view switching unit which switches an angle of view of the display image;
a rendering process unit which generates the display image based on the orientation information and the angle of view; and
a transmission unit which transmits the generated image to the display device.

### Claim 2 (depends on 1)

The image processing device according to claim 1,
wherein the display device is used fixed to a head portion or a face portion of the user.

### Claim 3 (depends on 1)

The image processing device according to claim 1,
wherein the orientation information acquisition unit receives the orientation information from an orientation detection device which detects an orientation of the head portion of the user.

### Claim 4 (depends on 1)

The image processing device according to claim 1,
wherein the rendering process unit generates the display image by cutting out a region corresponding to the angle of view from a position corresponding to the orientation information of an original image.

### Claim 5 (depends on 1)

The image processing device according to claim 1, further comprising:
a user operation unit which the user operates;
wherein the angle of view switching unit switches the angle of view according to an operation performed by the user in relation to the user operation unit.

### Claim 6 (depends on 5)

The image processing device according to claim 5,
wherein the user operation unit includes a touch panel, and
wherein the angle of view switching unit switches the angle of view according to a touch operation performed by the user in relation to the touch panel.

### Claim 7 (depends on 6)

The image processing device according to claim 6,
wherein the angle of view switching unit switches alternately to one of a first angle of view and a second angle of view every time the user touches the touch panel.

### Claim 8 (depends on 7)

The image processing device according to claim 7,
wherein the angle of view switching unit sets the first angle of view and the second angle of view to fixed values.

### Claim 9 (depends on 7)

The image processing device according to claim 7,
wherein the angle of view switching unit determines the first angle of view based on a resolution of the display device, and determines the second angle of view based on the resolution of the display device and the resolution of an original image to be processed by the rendering process unit.

### Claim 10 (depends on 1)

The image processing device according to claim 1,
wherein the angle of view switching unit determines an angle of view based on feature values of an original image.

### Claim 11 (depends on 10)

The image processing device according to claim 10,
wherein the angle of view switching unit determines the smallest angle of view at which a total number of objects exceeds a predetermined value.

### Claim 12 (depends on 10)

The image processing device according to claim 10,
wherein the angle of view switching unit determines the smallest angle of view at which a weighted sum value of objects exceeds a predetermined value.

### Claim 13

An image processing method comprising:
acquiring orientation information of a head portion of a user that observes a display image of a display device;
switching an angle of view of the display image;
generating the display image based on the orientation information and the angle of view; and
transmitting the generated image to the display device.

### Claim 14

A display device comprising:
a display unit;
an orientation information acquisition unit which acquires orientation information of a head portion of a user that observes a display image of the display unit;
an angle of view switching unit which switches an angle of view of the display image; and
a rendering process unit which generates the display image based on the orientation information and the angle of view.

### Claim 15 (depends on 14)

The display device according to claim 14, further comprising:
a user operation unit which the user operates;
wherein the angle of view switching unit switches the angle of view according to an operation performed by the user in relation to the user operation unit.

### Claim 16 (depends on 15)

The display device according to claim 15,
wherein the angle of view switching unit switches alternately to one of a first angle of view and a second angle of view every time a user operation is performed.

### Claim 17

A display method comprising:
acquiring orientation information of a head portion of a user that observes a display image of a display unit;
switching an angle of view of the display image; and
generating the display image based on the orientation information and the angle of view.

### Claim 18

A computer program denoted in a computer readable format for causing a computer to function as:
an orientation information acquisition unit which acquires orientation information of a head portion of a user that observes a display image of a display device;
an angle of view switching unit which switches an angle of view of the display image;
a rendering process unit which generates the display image based on the orientation information and the angle of view; and
a transmission unit which transmits the generated image to the display device.

### Claim 19

A computer program denoted in a computer readable format for causing a computer to function as:
a display unit;
an orientation information acquisition unit which acquires orientation information of a head portion of a user that observes a display image of the display unit;
an angle of view switching unit which switches an angle of view of the display image; and
a rendering process unit which generates the display image based on the orientation information and the angle of view.

### Claim 20

An image display system comprising:
a display device which displays an image;
a head portion action tracking device which measures an orientation of a head portion of a user that observes a display image of the display device; and
a rendering device which switches an angle of view at which the display device displays an image, and generates an image based on the orientation information and the angle of view.
