# US 12,007,574 B2 · Eye detection based smart glasses display device > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,007,574 B2 - Document ID: US12007574B2 - Status: Granted - Kind: B2 - Application number: 17/767,638 - Filed: 2020-10-12 - Published: 2023-08-17 - Granted: 2024-06-11 - Earliest claimed: 2019-10-10 - Assignees: MediThinQ Co., Ltd. - Applicants: MediThinQ Co., Ltd. - Inventors: Sungil In; Seungjoon Im - Web page: https://patentgrep.com/patent/US12007574B2 ## CPC - G02B 27/0093: {with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking} - G02B 27/0179: {Display position adjusting means not related to the information to be displayed} - A61B 8/461: {Displaying means of special interest} - A61B 90/36: {Image-producing devices or illumination devices not otherwise provided for} - G01C 3/02: Details - G02B 27/0172: {characterised by optical features} - G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)} - G06F 3/013: {Eye tracking input arrangements (G06F3/015 takes precedence)} - A61B 8/0866: {involving foetal diagnosis; pre-natal or peri-natal diagnosis of the baby} - A61B 8/462: {characterised by constructional features of the display} - A61B 2017/00216: {with eye tracking or head position tracking control} - A61B 2090/061: {for measuring dimensions, e.g. length} - A61B 2090/365: {augmented reality, i.e. correlating a live optical image with another image} - A61B 2090/502: {Headgear, e.g. helmet, spectacles} - G02B 2027/0134: {of stereoscopic type} - G02B 2027/0138: {comprising image capture systems, e.g. camera} - G02B 2027/014: {comprising information/image processing systems} - G02B 2027/0178: {Eyeglass type (eyeglass details G02C)} - G02B 2027/0187: {slaved to motion of at least a part of the body of the user, e.g. head, eye} - G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS - A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D) - G01C: MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY (measuring liquid level G01F; radio navigation, determining distance or velocity by use of propagation effects, e.g. Doppler effects, propagation time, of radio waves, analogous arrangements using other waves G01S) - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) ## Abstract The present invention provides an eye detection based smart glasses display device including: a plurality of distance measurement units irradiating a laser to an eyeball including a fundus and measuring a first distance from the fundus and a second distance from a surface of the eyeball; an eye detection unit detecting an eye direction based on the first distance and the second distance; an image acquisition unit acquiring an overlay image; a screen synthesis unit recognizing an eye contact object within a predetermined range in the eye direction, and computing a location so as to display the overlay image at a designated location according to the eye contact object; and a display unit displaying the overlay image at the computed location and has a smart glasses type. Accordingly, according to the present invention, a display method and a display device which are capable of naturally displaying related information without disrupting an eye of a doctor. ## Claims ### Claim 1 An eye detection based smart glasses display device comprising: a plurality of distance measurement units irradiating a laser to an eyeball including a fundus and measuring a first distance from the fundus and a second distance from a surface of the eyeball; an eye detection unit detecting an eye direction based on the first distance and the second distance; an image acquisition unit acquiring an overlay image; a screen synthesis unit recognizing an eye contact object within a predetermined range in the eye direction, and computing a location so as to display the overlay image at a designated location according to the eye contact object; and a display unit displaying the overlay image at the computed location and has a smart glasses type, wherein the display unit provides a screen including a circular guide area, and the screen synthesis unit detects the eye direction of a user and acquires an eye correction reference value based on the eye direction detected along the guide area when an eye moves along the circular guide area. ### Claim 2 (depends on 1) The eye detection based smart glasses display device of claim 1, wherein the eye detection unit senses a location of a pupil based on information on whether the distance measured by each of the plurality of distance measurement units being the first distance or the second distance. ### Claim 3 (depends on 1) The eye detection based smart glasses display device of claim 1, wherein the eye detection unit detects the eye direction by sensing a direction which a pupil faces in the eyeball by the first distance measured by some distance measurement units among the plurality of distance measurement units. ### Claim 4 (depends on 1) The eye detection based smart glasses display device of claim 1, wherein at least some of the plurality of distance measurement units are arranged along a support supporting the display unit. ### Claim 5 (depends on 1) The eye detection based smart glasses display device of claim 1, wherein the eye correction reference value includes eccentricity, flatness, or a focal location of an ellipse. ### Claim 6 (depends on 1) The eye detection based smart glasses display device of claim 1, wherein the screen synthesis unit senses light irradiated by the eye contact object and extracts a reference point for displaying the overlay image. ### Claim 7 (depends on 6) The eye detection based smart glasses display device of claim 6, wherein the screen synthesis unit extracts a point spaced apart from the reference point by a predetermined interval as a screen boundary point. ### Claim 8 (depends on 1) The eye detection based smart glasses display device of claim 1, wherein the display unit displays the overlay image in a three-dimensional (3D) stereoscopic shape. ### Claim 9 (depends on 1) The eye detection based smart glasses display device of claim 1, wherein the display unit includes a microdisplay, a lens, a panel, and a splitter. ### Claim 10 An eye detection based smart glasses display method comprising: a distance measuring step of irradiating, by a plurality of distance measurement units, a laser to an eyeball including a fundus and measuring a first distance from the fundus and a second distance from a surface of the eyeball; providing, by a display unit, a screen including a circular guide area; detecting an eye direction of a user and acquiring an eye correction reference value based the eye direction detected along the guide area when an eye of the user moves along the circular guide area; an eye detecting step of detecting the eye direction based on the first distance and the second distance; an image acquiring step of acquiring an overlay image; a display location computing step of recognizing an eye contact object within a predetermined range in the eye direction, and computing a location so as to display the overlay image at a designated location according to the eye contact object; and a display step of displaying, by a display unit having a smart glasses type, the overlay image at the computed location. ### Claim 11 (depends on 10) The eye detection based smart glasses display method of claim 10, wherein in the eye detecting step, a location of a pupil is sensed based on information on whether the distance measured by each of the plurality of distance measurement units being the first distance or the second distance. ### Claim 12 (depends on 11) The eye detection based smart glasses display method of claim 11, wherein in the eye detecting step, the eye direction is detected by sensing a direction which a pupil faces in the eyeball by the first distance measured by some distance measurement units among the plurality of distance measurement units. ### Claim 13 (depends on 10) The eye detection based smart glasses display method of claim 10, further comprising: the eye correction reference value includes eccentricity, flatness, or a focal location of an ellipse. ### Claim 14 (depends on 10) The eye detection based smart glasses display method of claim 10, wherein the display location computing step includes sensing light irradiated by the eye contact object and extracting a reference point for displaying the overlay image. ### Claim 15 (depends on 14) The eye detection based smart glasses display method of claim 14, wherein the display location computing step further includes extracting a point spaced apart from the reference point by a predetermined interval as a screen boundary point. ### Claim 16 (depends on 10) The eye detection based smart glasses display method of claim 10, wherein the display step includes displaying the overlay image in a three-dimensional (3D) stereoscopic shape. ### Claim 17 A non-transitory computer readable recording medium storing instructions, wherein the instructions comprising: irradiating, by a plurality of distance measurement units, a laser to an eyeball including a fundus and measuring a first distance from the fundus and a second distance from a surface of the eyeball; providing, by a display unit, a screen including a circular guide area; detecting an eye direction of a user and acquiring an eye correction reference value based the eye direction detected along the guide area when an eye of the user moves along the circular guide area; detecting the eye direction based on the first distance and the second distance and acquiring an overlay image; recognizing an eye contact object within a predetermined range in the eye direction; computing a location so as to display the overlay image at a designated location according the eye contact object; displaying, by the display unit having a smart glasses type, the overlay image at the computed location.