# US 2021/0239988 A1 · Display device, control method for display device, and program

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0239988 A1
- Document ID: US20210239988A1
- Status: Published application
- Kind: A1
- Application number: 17/162,128
- Filed: 2021-01-29
- Published: 2021-08-05
- Earliest claimed: 2020-01-30
- Assignees: Seiko Epson Corporation
- Applicants: Seiko Epson Corporation
- Inventors: Shinichi KOBAYASHI
- Web page: https://patentgrep.com/patent/US20210239988A1

## CPC

- G02B 27/0172: {characterised by optical features}
- G02B 27/0093: {with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking}
- G06F 3/012: {Head tracking input arrangements}
- G06F 3/017: {Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883)}
- G06V 20/10: Terrestrial scenes (scenes under surveillance with static cameras G06V20/52; scenes perceived from the exterior of a vehicle G06V20/56; scenes perceived from the interior of a vehicle G06V20/59)
- G06V 20/20: in augmented reality scenes
- G02B 2027/0138: {comprising image capture systems, e.g. camera}
- G02B 2027/0141: {characterised by the informative content of the display}
- G02B 2027/0178: {Eyeglass type (eyeglass details G02C)}
- G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

A specific posture is set as a standard posture of the head of a user wearing a display device, and a movementfrom the standard posture is detected. The detected movement of the head is associated in advance with a first mode and a second mode that are display modes of the image display unit, and the image display unit performs display in the first mode when the detected movement of the head is a movement in a predetermined first direction and exceeds a predetermined first threshold value and performs display in the second mode when the movement is a movement in a second direction that is different from the first direction and exceeds a predetermined second threshold value. An input is received in an input mode associated in advance with the first mode or the second mode.

## Claims

### Claim 1

A head-mounted display device configured to cause an outside scene to be visually recognized, the display device comprising:
an image display unit configured to display an image;
an input unit coupled to the display unit and configured to accept input in at least a plurality of input modes;
a setting unit configured to set, as a standard posture, a specific posture of the head of a user wearing the display device;
a detection unit configured to detect a movement of the head of the user wearing the display device from the standard posture;
a display control unit configured to cause the image display unit to perform display in a first mode when the detected movement of the head is a movement in a predetermined first direction and exceeds a predetermined first threshold value and perform display in a second mode when the movement is a movement in a second direction that is different from the first direction and exceeds a predetermined second threshold value, the movement of the head being associated with the first mode and the second mode different from the first mode, that are display modes of the image display unit; and
an input control unit configured to cause the input unit to accept the input in an input mode associated in advance with the first mode or the second mode of the image display unit among the plurality of input modes when the image display unit performs display in the first mode or the second mode.

### Claim 2 (depends on 1)

The display device according to claim 1, wherein
the display control unit, in the standard posture, controls the image display unit in a mode in which visual recognition of the outside scene is prioritized, and
in the first mode and the second mode, first information and second information associated in advance with the modes are displayed on the image display unit.

### Claim 3 (depends on 2)

The display device according to claim 2, wherein
the first direction is a downward direction from the standard posture, the first threshold value is a threshold value for detecting that at least one of a depression angle, a speed, and an acceleration of the head is greater than or equal to a predetermined value, and the display control unit, in the first mode, causes the image display unit to display information for receiving a data input as the first information, and
the input control unit causes at least one of a numerical value, a character, and selection of an option to be input by input in an input mode using the first information.

### Claim 4 (depends on 2)

The display device according to claim 2, wherein
the second direction is a right direction or a left direction from the standard posture, and the second threshold value is a threshold value for detecting that at least one of an angle, a speed, and an acceleration of the head is greater than or equal to a predetermined value,
the display control unit, in the second mode, causes the image display unit to display predetermined content including at least one of a character, an image, and a video as the second information, and
the input control unit receives an input in an input mode for changing a display mode of the displayed content.

### Claim 5 (depends on 4)

The display device according to claim 4, wherein
the display mode of the content to be changed by the input control unit is at least one of an enlargement/reduction ratio or a display size of the content, a display position of the content, a display range of the content, scrolling of the content, page flipping of the content, and marking on the content.

### Claim 6 (depends on 2)

The display device according to claim 2, wherein
the display control unit causes the image display unit to display association information for associating a movement of the head with the first mode and the second mode when the movement of the head is detected as a movement in an upward direction from the standard posture and at least one of an elevation angle, a speed, and an acceleration of the head is greater than or equal to a predetermined value, and
the input control unit receives an input in an input mode using the association information and associates the movement of the head with the first mode and the second mode.

### Claim 7 (depends on 1)

The display device according to claim 1, wherein
the detection unit is a multi-axis sensor configured to detect an angle and an acceleration in the upward, downward, left, and right directions of the head,
the setting unit sets the standard posture based on a first detection value for the angle from the multi-axis sensor, and
the display control unit sets each of the first threshold value and the second threshold value individually for both the first detection value for the angle from the multi-axis sensor and a second detection value for the acceleration.

### Claim 8 (depends on 7)

The display device according to claim 7, wherein
the first detection value is a detection value with which a direction of a posture of the head with respect to the standard posture is distinguishable from among the upward, downward, left, and right directions, and
the first threshold value and the second threshold value are different threshold values for the first detection value.

### Claim 9 (depends on 1)

The display device according to claim 1, wherein
the display control unit, during the display in the standard posture, the first mode, and the second mode, causes the image display unit to display auxiliary display indicating the corresponding input mode.

### Claim 10 (depends on 1)

The display device according to claim 1, wherein
the input control unit notifies using sound or vibration that the input is enabled in one input mode among the plurality of input modes.

### Claim 11

A control method for a display device including a head-mounted image display unit configured to cause an outside scene to be visually recognized, the control method comprising:
setting, as a standard posture, a specific posture of the head of a user wearing the display device;
detecting a movement of the head of the user wearing the display device from the standard posture;
associating the movement of the head in advance with a first mode and a second mode different from the first mode that are display modes of the image display unit;
causing the image display unit to perform display in the first mode when the detected movement of the head is a movement in a predetermined first direction and exceeds a predetermined first threshold value and perform display in the second mode when the movement is a movement in a second direction that is different from the first direction and exceeds a predetermined second threshold value; and
receiving an input in an input mode associated in advance with the first mode or the second mode of the image display unit among a plurality of input modes when the image display unit performs display in the first mode or the second mode.

### Claim 12

A non-transitory computer-readable storage medium storing a computer-executable program for controlling a display device including a head-mounted image display unit configured to cause an outside scene to be visually recognized, the program achieving;
a setting function to set, as a standard posture, a specific posture of the head of a user wearing the display device;
a detection function to detect a movement of the head of the user wearing the display device from the standard posture;
a display function to cause the image display unit to perform display in a first mode when the detected movement of the head is a movement in a predetermined first direction and exceeds a predetermined first threshold value and perform display in a second mode when the movement is a movement in a second direction that is different from the first direction and exceeds a predetermined second threshold value, the movement of the head being associated with the first mode and the second mode different from the first mode that are display modes of the image display unit; and
an input function to receive an input in an input mode associated in advance with the first mode or the second mode of the image display unit among a plurality of input modes when the image display unit performs display in the first mode or the second mode.
