# US 2017/0255256 A1 · Head-mounted display controlled by sightline, method for controlling same, and computer program for controlling same

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2017/0255256 A1
- Document ID: US20170255256A1
- Status: Published application
- Kind: A1
- Application number: 15/511,608
- Filed: 2015-09-17
- Published: 2017-09-07
- Earliest claimed: 2014-09-18
- Assignees: FXGear Inc.
- Applicants: Fxgear Inc.
- Inventors: Sung Wu KIM; Kwang Jin CHOI
- Web page: https://patentgrep.com/patent/US20170255256A1

## CPC

- G06F 3/012: {Head tracking input arrangements}
- G06F 3/013: {Eye tracking input arrangements (G06F3/015 takes precedence)}
- G09G 3/2092: {Details of a display terminals using a flat panel, the details relating to the control arrangement of the display terminal and to the interfaces thereto (suitable for both CRT and flat panel G09G5/003; specific for a CRT G09G1/165)}
- G09G 5/003: {Details of a display terminal, the details relating to the control arrangement of the display terminal and to the interfaces thereto (specific for a CRT G09G1/165; for a flat panel G09G3/2092)}
- G02B 2027/0187: {slaved to motion of at least a part of the body of the user, e.g. head, eye}
- G09G 2320/0261: in the context of movement of objects on the screen or movement of the observer relative to the screen
- G09G 2320/068: for control of viewing angle adjustment
- G09G 2354/00: Aspects of interface with display user
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00)
- G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS

## Abstract

A head-mounted display (HMD) may comprise: a sensor unit configured to measure the movement of a user wearing the HMD; a display unit configured to display an image; and a control unit configured to calculate the user's sightline direction from a measurement value from the sensor unit and, when the user's sightline direction satisfies a preset condition, control elements of the image other than the viewpoint using the user's sightline as a input signal. When the user's sightline direction satisfies the preset condition, the HMD controls the image, which is displayed on the HMD, using the user's sightline as an input signal, thereby performing event processing and the like without any separate controller.

## Claims

### Claim 1

A head-mounted display, comprising:
a sensor unit configured to measure a motion of a user wearing the head-mounted display;
a display unit configured to display an image; and
a control unit configured to compute a line of sight direction of the user from a measurement value of the sensor unit, and control an element other than viewpoint of the image using the line of sight of the user as an input signal when the line of sight direction satisfies a preset condition.

### Claim 2 (depends on 1)

The head-mounted display according to claim 1, wherein the control unit is configured to use the line of sight of the user as the input signal in response to the line of sight direction of the user being maintained constantly for a preset period of time.

### Claim 3 (depends on 1)

The head-mounted display according to claim 1, wherein the control unit is configured to use the line of sight of the user as the input signal in response to the line of sight direction of the user matching a preset direction.

### Claim 4 (depends on 1)

The head-mounted display according to claim 1, wherein the control unit is configured to change at least one of a type, an output region, an output form, and a playback speed of the image displayed on the display unit using the line of sight of the user as the input signal.

### Claim 5 (depends on 1)

The head-mounted display according to claim 1, wherein the control unit is further configured to control the display unit to operate in a first mode and a second mode shifting between, the first mode in which the image displayed on the display unit changes in viewpoint based on the line of sight direction of the user, and the second mode in which the element other than viewpoint of the image is controlled using the line of sight of the user as the input signal.

### Claim 6

A method for controlling a head-mounted display, comprising:
displaying an image on the head-mounted display;
computing a line of sight direction of a user wearing the head-mounted display; and
controlling an element other than viewpoint of the image displayed on the head-mounted display using the line of sight of the user as an input signal when the line of sight direction of the user satisfies a preset condition.

### Claim 7 (depends on 6)

The method for controlling a head-mounted display according to claim 6, wherein the controlling of an element other than viewpoint of the image comprises determining the line of sight of the user as the input signal in response to the line of sight direction of the user being maintained constantly for a preset period of time.

### Claim 8 (depends on 6)

The method for controlling a head-mounted display according to claim 6, wherein the controlling of an element other than viewpoint of the image comprises determining the line of sight of the user as the input signal in response to the line of sight direction of the user matching a preset direction.

### Claim 9 (depends on 6)

The method for controlling a head-mounted display according to claim 6, wherein the controlling of an element other than viewpoint of the image comprises changing at least one of a type, an output region, an output form, and a playback speed of the image displayed on the head-mounted display using the line of sight of the user as the input signal.

### Claim 10 (depends on 6)

The method for controlling a head-mounted display according to claim 6, wherein the controlling of an element other than viewpoint of the image comprises controlling the head-mounted display to operate in a first mode and a second mode shifting between, the first mode in which the image displayed on the head-mounted display changes in viewpoint based on the line of sight direction of the user, and the second mode in which the element other than viewpoint of the image is controlled using the line of sight of the user as the input signal.

### Claim 11

A computer program stored in a medium to perform, in combination with a head-mounted display, the steps of:
displaying an image on the head-mounted display;
computing a line of sight direction of a user wearing the head-mounted display; and
controlling an element other than viewpoint of the image displayed on the head-mounted display using the line of sight of the user as an input signal when the line of sight direction of the user satisfies a preset condition.
