# US 2017/0255447 A1 · Display device, method of controlling display device, and program > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2017/0255447 A1 - Document ID: US20170255447A1 - Status: Published application - Kind: A1 - Application number: 15/598,961 - Filed: 2017-05-18 - Published: 2017-09-07 - Earliest claimed: 2014-07-31 - Assignees: Seiko Epson Corporation - Applicants: Seiko Epson Corporation - Inventors: Kaori SENDAI; Atsunari TSUDA; Masahide TAKANO - Web page: https://patentgrep.com/patent/US20170255447A1 ## CPC - G06F 3/167: {Audio in a user interface, e.g. using voice commands for navigating, audio feedback} - G02B 27/017: {Head mounted} - G02B 27/0172: {characterised by optical features} - G06F 3/005: {Input arrangements through a video camera} - G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)} - G06F 3/0304: {Detection arrangements using opto-electronic means (constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042)} - G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)} - G02B 2027/0138: {comprising image capture systems, e.g. camera} - G02B 2027/014: {comprising information/image processing systems} - G02B 2027/0141: {characterised by the informative content of the display} - G02B 2027/0178: {Eyeglass type (eyeglass details G02C)} - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL ## Abstract A head mounted display device is used by being mounted on a body of a user and includes an image display unit through which outside scenery is transmitted and which displays an image such that the image is visually recognizable together with the outside scenery. Further, the head mounted display device includes a right headphone and a left headphone outputting a sound. Further, the head mounted display device includes a target detection unit that detects a target of the user in the visual line direction; a distance detection unit that detects a distance between the detected target and the user; and an information output control unit that controls the output of the sound of the right headphone and the left headphone according to the detected distance. ## Claims ### Claim 1 A display device which is used by being mounted on a body of a user, comprising: a display unit through which outside scenery is transmitted and that displays an image such that the image is visually recognizable together with the outside scenery; a sound output unit that outputs a sound; a target detection unit that detects a target of the user in a visual line direction; a distance detection unit that detects a distance between the target detected by the target detection unit and the user; and a sound control unit that controls the output of the sound from the sound output unit according to the distance detected by the distance detection unit, wherein the target detection unit detects a state of the target visually recognized by the user through the display unit based on the captured image of the imaging unit, and the sound control unit allows the sound output unit to output the sound based on the sound data acquired by the data acquisition unit according to the state of the target detected by the target detection unit. ### Claim 2 (depends on 1) The display device according to claim 1, further comprising a data acquisition unit that acquires sound data related to the target, wherein the sound control unit allows the sound output unit to output a sound based on the sound data acquired by the data acquisition unit in a case where the distance detected by the distance detection unit is longer than a predetermined distance. ### Claim 3 (depends on 2) The display device according to claim 2, further comprising an imaging unit that images the visual line direction of the user, wherein the target detection unit detects the target visually recognized by the user through the display unit based on the captured image of the imaging unit. ### Claim 4 (depends on 3) The display device according to claim 3, wherein the target is a person and the state is whether a mouth of the person is opened or closed. ### Claim 5 (depends on 1) The display device according to claim 1, wherein the sound control unit allows the sound output unit to output a voice of a person or a sound that mimics a voice of a person. ### Claim 6 (depends on 1) The display device according to claim 1, wherein the sound control unit converts sound data acquired by the data acquisition unit to sound data including a component of a predetermined frequency bandwidth and allows the sound output unit to output a sound based on the converted sound data. ### Claim 7 (depends on 1) The display device according to claim 1, wherein the sound output unit is a headphone used by being mounted on the user. ### Claim 8 (depends on 1) The display device according to claim 1, further comprising a sound detection unit, wherein the data acquisition unit acquires data of a sound collected by the sound detection unit. ### Claim 9 (depends on 8) The display device according to claim 8, wherein the sound control unit allows the sound detection unit to detect a sound made by the target detected by the target detection unit and allows the sound output unit to output the detected sound or a sound having the content which is the same as the content of the detected sound. ### Claim 10 (depends on 1) The display device according to claim 1, wherein the sound output unit changes a frequency component of the sound data acquired by the data acquisition unit based on the distance detected by the distance detection unit. ### Claim 11 (depends on 1) The display device according to claim 1, wherein the sound control unit adjusts a timing of the outputting of the sound based on a distance to the target. ### Claim 12 (depends on 1) The display device according to claim 1, wherein the sound control unit further controls the output of the sound from the sound output unit according to an age of the user. ### Claim 13 (depends on 1) The display device according to claim 1, wherein the target is a person performing in a program and the display unit further displays words uttered by the person and text related to the program. ### Claim 14 A method of controlling a display device that includes a display unit through which outside scenery is transmitted and which displays an image such that the image is visually recognizable together with the outside scenery and a sound output unit which outputs a sound and that is used by being mounted on a body of a user, comprising: detecting a target of the user in a visual line direction; detecting a distance between the detected target and the user; detecting a state of the target visually recognized by the user through the display unit; and controlling the output of the sound according to the detected distance, including allowing the output of the sound according to the detected state of the target. ### Claim 15 A non-transitory computer readable medium which can be executed by a computer controlling a display device that includes a display unit through which outside scenery is transmitted and which displays an image such that the image is visually recognizable together with the outside scenery and a sound output unit which outputs a sound and that is used by being mounted on a body of a user, the non-transitory computer readable medium causing the computer to function as: a target detection unit that detects a target of the user in a visual line direction; a distance detection unit that detects a distance between the target detected by the target detection unit and the user; and a sound control unit that controls the output of the sound from the sound output unit according to the distance detected by the distance detection unit, wherein the target detection unit detects a state of the target visually recognized by the user through the display unit based on the captured image of the imaging unit, and the sound control unit allows the sound output unit to output the sound based on the sound data acquired by the data acquisition unit according to the state of the target detected by the target detection unit.