# US 12,002,141 B2 · Image display apparatus > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,002,141 B2 - Document ID: US12002141B2 - Status: Granted - Kind: B2 - Application number: 17/766,816 - Filed: 2020-07-21 - Published: 2024-03-14 - Granted: 2024-06-04 - Earliest claimed: 2019-10-15 - Assignees: Sony Group Corporation - Applicants: Sony Group Corporation - Inventors: Takanobu Omata; Kaoru Koike; Yuichi Miyagawa; Hisataka Izawa; Itaru Shimizu - Web page: https://patentgrep.com/patent/US12002141B2 ## CPC - G06F 3/04845: for image manipulation, e.g. dragging, rotation, expansion or change of colour - G06T 15/00: Three-dimensional [3D] image rendering - G02B 30/00: Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images (in microscopes G02B21/22) - G03B 21/14: Details - G06F 1/1601: {Constructional details related to the housing of computer displays, e.g. of CRT monitors, of flat displays (constructional details related to flat displays integrated in a portable computer, e.g. laptop, handheld computer G06F1/1637; constructional details related to television receivers H04N5/64)} - G06F 1/1626: {with a single-body enclosure integrating a flat display, e.g. Personal Digital Assistants [PDAs]} - G06F 1/1637: {Details related to the display arrangement, including those related to the mounting of the display in the housing} - G06F 1/1643: {the display being associated to a digitizer, e.g. laptops that can be used as penpads (details related to the relative motion of the display enclosure with respect to the body enclosure, e.g. to move between laptop and tablet PC configuration G06F1/1615)} - G06F 3/01: Input arrangements or combined input and output arrangements for interaction between user and computer (G06F3/16 takes precedence) - G06F 3/013: {Eye tracking input arrangements (G06F3/015 takes precedence)} - G06F 3/041: Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means - G06F 3/04815: Interaction with a metaphor-based environment or interaction object displayed as three-dimensional [3D], e.g. changing the user viewpoint with respect to the environment or object - G06F 3/0488: using a touch-screen or digitiser, e.g. input of commands through traced gestures - G06F 3/04883: for inputting data by handwriting, e.g. gesture or text - G06F 3/14: Digital output to display device {; Cooperation and interconnection of the display device with other functional units} - G06F 3/16: Sound input; Sound output (speech processing G10L) - G06T 7/70: Determining position or orientation of objects or cameras (camera calibration G06T7/80) - G09G 3/003: {to produce spatial visual effects} - H04N 5/74: Projection arrangements for image reproduction, e.g. using eidophor - H04R 1/40: by combining a number of identical transducers {(specially adapted for hearing aids H04R25/405)} - H04R 3/00: Circuits for transducers (arrangements for producing a reverberation or echo sound G10K15/08; amplifiers H03F) - G09G 2340/0464: Positioning - G09G 2354/00: Aspects of interface with display user - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL - G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS - G03B: APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR (optical parts of such apparatus G02B; photosensitive materials or processes for photographic purposes G03C; apparatus for processing exposed photographic materials G03D) - G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00) - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION - H04R: LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS (producing sounds with frequency not determined by supply frequency G10K) ## Abstract There is provided an image display apparatus that makes it possible to automatically orient a front face of a three-dimensional object represented by a three-dimensional image to a user. There are provided: a display unit that displays the three-dimensional image, by which the three-dimensional object appears to exist in a space partitioned by members configuring an outer surface, to be visually recognizable from a plurality of circumferential directions; a direction estimation section that estimates a direction in which a user exists as seen from the display unit; and a display control section that orients a front face of the three-dimensional object displayed by the display unit in the direction in which the user exists estimated by the direction estimation section. ## Claims ### Claim 1 An image display apparatus, comprising: a display unit that displays a three-dimensional image, by which a three-dimensional object appears to exist in a space partitioned by members configuring an outer surface, to be visually recognizable from a plurality of circumferential directions; a direction estimation section that estimates a direction in which a user exists as seen from the display unit; and a display control section that orients a front face of the three-dimensional object displayed by the display unit in the direction in which the user exists estimated by the direction estimation section. ### Claim 2 (depends on 1) The image display apparatus according to claim 1, comprising an eye position detection section that detects an eye position of a person who exists around the display unit, wherein the direction estimation section outputs a direction in which the eye position is detected, as a result of the estimation of the direction in which the user exists. ### Claim 3 (depends on 2) The image display apparatus according to claim 2, comprising a camera that shoots a circumference of the display unit, wherein the eye position detection section detects the eye position on a basis of a result of the shooting of the circumference of the display unit. ### Claim 4 (depends on 2) The image display apparatus according to claim 2, comprising a ranging sensor that measures distances to a plurality of points on a surface of a body around the display unit, wherein the eye position detection section detects the eye position on a basis of a result of the measurement of the distances. ### Claim 5 (depends on 2) The image display apparatus according to claim 2, comprising: a multiple person determination section that determines whether the eye position detection section has detected eyes of a plurality of persons; and a user setting section that judges, in a case where determination is made that the eyes of the plurality of persons have been detected, a person with a highest degree of interest to the three-dimensional object among the plurality of persons to be the user. ### Claim 6 (depends on 5) The image display apparatus according to claim 5, wherein the user setting section detects a person who is viewing the three-dimensional object for longest time among the plurality of persons to judge the detected person to be the person with the highest degree of interest. ### Claim 7 (depends on 1) The image display apparatus according to claim 1, comprising a finger position detection section that detects a finger position of a person who exists around the display unit, wherein the direction estimation section outputs a direction in which the finger position is detected, as a result of the estimation of the direction in which the user exists. ### Claim 8 (depends on 7) The image display apparatus according to claim 7, comprising a camera that shoots a circumference of the display unit, wherein the finger position detection section detects the finger position on a basis of a result of the shooting of the circumference of the display unit. ### Claim 9 (depends on 7) The image display apparatus according to claim 7, comprising a ranging sensor that measures distances to a plurality of points on a surface of a body around the display unit, wherein the finger position detection section detects the finger position on a basis of a result of the measurement of the distances. ### Claim 10 (depends on 1) The image display apparatus according to claim 1, comprising: a grip determination section that determines whether the display unit is gripped; and a grip position detection section that detects a position of fingers gripping the display unit in a case where determination is made that the display unit is gripped, wherein the direction estimation section estimates the direction in which the user exists on a basis of a result of the detection of the position of the fingers gripping the display unit. ### Claim 11 (depends on 10) The image display apparatus according to claim 10, comprising a touch panel provided on the outer surface of the display unit, wherein the grip position detection section detects the position of the fingers gripping the display unit on a basis of a result of detection on the touch panel. ### Claim 12 (depends on 1) The image display apparatus according to claim 1, comprising a touch panel provided on the outer surface of the display unit, wherein the direction estimation section detects a position, of the touch panel, where a finger operation has been performed, and outputs a normal direction at the detected position as a result of the estimation of the direction in which the user exists. ### Claim 13 (depends on 1) The image display apparatus according to claim 1, comprising a sound generation position detection section that detects a generation position of a sound generated around the display unit, wherein the direction estimation section outputs a direction in which the generation position of the sound is detected, as a result of the estimation of the direction in which the user exists. ### Claim 14 (depends on 13) The image display apparatus according to claim 13, comprising a microphone that acquires a sound around the display unit, wherein the sound generation position detection section detects the generation position of the sound on a basis of a result of the acquisition of the sound. ### Claim 15 (depends on 14) The image display apparatus according to claim 14, wherein the display control section determines whether the sound acquired by the microphone includes a pre-registered sound, and the display control section orients, in a case where determination is made that the pre-registered sound is included, the front face of the three-dimensional object displayed by the display unit in the direction in which the user exists estimated by the direction estimation section. ### Claim 16 (depends on 15) The image display apparatus according to claim 15, comprising: a multiple person determination section that determines whether sounds of a plurality of persons have been acquired by the microphone; and a user setting section that judges, in a case where determination is made that the sounds of the plurality of persons have been acquired, a person with a highest degree of interest to the three-dimensional object among the plurality of persons to be the user. ### Claim 17 (depends on 16) The image display apparatus according to claim 16, wherein the user setting section detects a person who is uttering the pre-registered sound for longest time among the plurality of persons to judge the detected person to be the person with the highest degree of interest. ### Claim 18 (depends on 16) The image display apparatus according to claim 16, wherein the user setting section detects a person who last uttered the pre-registered sound among the plurality of persons to judge the detected person to be the person with the highest degree of interest. ### Claim 19 (depends on 13) The image display apparatus according to claim 13, wherein the display control section determines, after the front face of the three-dimensional object is oriented to the user, whether a word to orient the front face of the three-dimensional object in a predetermined direction is included in a sound uttered by the user, and the display control section orients, in a case where determination is made that the word is included, the front face of the three-dimensional object displayed by the display unit in the predetermined direction as viewed from the user. ### Claim 20 (depends on 1) The image display apparatus according to claim 1, wherein the display control section causes the display unit to change an orientation of the front face of the three-dimensional object by rotating the three-dimensional object. ### Claim 21 (depends on 20) The image display apparatus according to claim 20, wherein the display control section decides a rotational direction of the three-dimensional object to allow a rotational amount of the three-dimensional object to be minimum. ### Claim 22 (depends on 1) The image display apparatus according to claim 1, comprising: a touch panel provided on the outer surface of the display unit; a multiple person determination section that determines whether a plurality of persons is performing a flick operation on the touch panel; and a user setting section that judges, in a case where determination is made that the plurality of persons is performing the flick operation, a person with a highest degree of interest to the three-dimensional object among the plurality of persons to be the user. ### Claim 23 (depends on 22) The image display apparatus according to claim 22, wherein the user setting section detects a person having a fastest speed of the flick operation among the plurality of persons to judge the detected person to be the person with the highest degree of interest. ### Claim 24 (depends on 1) The image display apparatus according to claim 1, comprising a touch panel provided on the outer surface of the display unit, wherein the display control section rotates, in a case where a plurality of persons are performing flick operations on the touch panel, the three-dimensional object at a speed corresponding to a sum of speeds of the flick operations of the respective persons, and the image display apparatus further comprises a user setting section that sets, as the user, a person closest to the front face of the three-dimensional object among the plurality of persons, when the rotation of the three-dimensional object by the flick operations is stopped. ### Claim 25 An image display apparatus, comprising: a display unit that displays a three-dimensional image, by which a three-dimensional object appears to exist in a space partitioned by members configuring an outer surface, to be visually recognizable from a plurality of circumferential directions; a touch panel provided on the outer surface of the display unit; and a display control section that rotates, in a case where a flick operation is performed on the touch panel, the three-dimensional object displayed by the display unit in an orientation of the flick operation.