# US 11,908,356 B2 · Augmented reality display device having contextual adaptive brightness > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 11,908,356 B2 - Document ID: US11908356B2 - Status: Granted - Kind: B2 - Application number: 17/551,730 - Filed: 2021-12-15 - Published: 2023-06-15 - Granted: 2024-02-20 - Earliest claimed: 2021-12-15 - Assignees: Motorola Mobility LLC - Applicants: Motorola Mobility LLC - Inventors: Amit Kumar Agrawal; Alexandre Neves Creto - Web page: https://patentgrep.com/patent/US11908356B2 ## CPC - G09G 3/003: {to produce spatial visual effects} - G02B 27/0093: {with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking} - G02B 27/0172: {characterised by optical features} - G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)} - G06F 3/012: {Head tracking input arrangements} - G06F 3/013: {Eye tracking input arrangements (G06F3/015 takes precedence)} - G06F 3/016: {Input arrangements with force or tactile feedback as computer generated output to the user} - G06V 20/20: in augmented reality scenes - G06V 40/18: Eye characteristics, e.g. of the iris - G02B 2027/0138: {comprising image capture systems, e.g. camera} - G02B 2027/014: {comprising information/image processing systems} - G02B 2027/0178: {Eyeglass type (eyeglass details G02C)} - G09G 3/38: using electrochromic devices - G09G 2320/0626: for control of overall brightness - G09G 2354/00: Aspects of interface with display user - G09G 2360/144: the light being ambient light - G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00) - G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING ## Abstract An electronic device, computer program product, and method present augmented reality (AR) imagery at an AR display device with contextual, adaptive brightening control. The AR display device includes eyeglasses having lenses positioned in front of eyes of a person. A first camera sensor detects ambient light. An AR projector displays AR imagery on the lenses. A second camera sensor is configured to detect whether the eyes of the person are open or closed. A controller of the electronic device is communicatively coupled to the AR display device. The controller detects brightness of the ambient light. The controller dynamically adjusts brightness of the AR imagery in relation to the brightness of the ambient light. The controller reduces the brightness of the AR imagery in response to determining a brightness context that the eyes of the person have been closed for longer than threshold period of time. ## Claims ### Claim 1 An electronic device comprising: an augmented reality (AR) display device comprising: eyeglasses having one or more lenses configured to be positioned in front of eyes of a person; at least one first camera sensor that detects ambient light; an AR projector that displays AR imagery on the one or more lenses; and at least one second camera sensor configured to detect whether the eyes of the person are open or closed; and a controller communicatively coupled to the AR display device, and which: detects brightness of the ambient light; dynamically adjusts brightness of the AR imagery in relation to the brightness of the ambient light; and reduces the brightness of the AR imagery in response to determining a brightness context that the eyes of the person have been closed for longer than a threshold period of time. ### Claim 2 (depends on 1) The electronic device of claim 1, wherein the controller ramps up the brightness of the AR imagery over an interval of time in response to determining that the eyes of the person have opened subsequent to having been closed longer than the threshold period of time. ### Claim 3 (depends on 1) The electronic device of claim 1, wherein: the one or more lenses comprise one or more electrochromatic lenses; and the controller activates the one or more electrochromatic lenses to a darker state in response to determining that the eyes of the person have been closed longer than the threshold period of time. ### Claim 4 (depends on 3) The electronic device of claim 3, wherein the controller dynamically adjusts brightness of the AR imagery in relation to the brightness of the ambient light that is transmitted through the one or more electrochromatic lenses. ### Claim 5 (depends on 1) The electronic device of claim 1, wherein: the one or more lenses comprise one or more electrochromatic lenses; and the controller: in response to determining that the eyes of the person have opened subsequent to having been closed longer than the threshold period of time: gradually reduces a level of activation of the one or more electrochromatic lenses over an interval of time to gradually return the one or more lenses to an undarkened state. ### Claim 6 (depends on 5) The electronic device of claim 5, wherein the controller gradually increases the brightness of the AR imagery in relation to brightness of the ambient light allowed through the one or more electrochromatic lenses. ### Claim 7 (depends on 1) The electronic device of claim 1, wherein: the one or more lenses comprise one or more electrochromatic lenses; and the controller activates the one or more electrochromatic lenses to a darker state in response to determining that the brightness of the ambient light exceeds a brightness limit threshold associated with effective presentation of the AR imagery. ### Claim 8 (depends on 1) The electronic device of claim 1, wherein: the one or more lenses comprise one or more electrochromatic lenses; and the controller activates the one or more electrochromatic lenses to a darker state in response to determining that: (i) a level of increase in the brightness of the ambient light is greater than a brightness increase threshold; and (ii) the increase occurs in less than a second threshold period of time. ### Claim 9 A method comprising: monitoring at least one first camera sensor that detects ambient light at an augmented reality (AR) display device comprising eyeglasses having one or more lenses configured to be positioned in front of eyes of a person; detecting brightness of the ambient light; dynamically adjusting brightness of AR imagery in relation to the brightness of the ambient light, the AR imagery projected by an AR projector and displayed on the one or more lenses; monitoring at least one second camera sensor configured to detect whether the eyes of the person are open or closed; and reducing the brightness of the AR imagery in response to determining a brightness context that the eyes of the person have been closed for longer than threshold period of time. ### Claim 10 (depends on 9) The method of claim 9, further comprising ramping up the brightness of the AR imagery over an interval of time in response to determining that the eyes of the person have opened subsequent to having been closed longer than the threshold period of time. ### Claim 11 (depends on 9) The method of claim 9, further comprising activating the one or more lenses that each comprise an electrochromatic lens to a darker state in response to determining that the eyes of the person have been closed longer than threshold period of time. ### Claim 12 (depends on 11) The method of claim 11, further comprising dynamically adjusting brightness of the AR imagery in relation to the brightness of the ambient light that is transmitted through the one or more electrochromatic lenses. ### Claim 13 (depends on 9) The method of claim 9, further comprising: in response to determining that the eyes of the person have opened subsequent to having been closed longer than the threshold period of time: gradually reducing a level of activation of the one or more lenses that each comprise an electrochromatic lens over an interval of time to gradually return the one or more lenses to an undarkened state. ### Claim 14 (depends on 13) The method of claim 13, further comprising gradually increasing the brightness of the AR imagery in relation to brightness of the ambient light allowed through the one or more electrochromatic lenses. ### Claim 15 (depends on 9) The method of claim 9, further comprising activating the one or more lenses that each comprise an electrochromatic lens to a darker state in response to determining that the brightness of the ambient light exceeds a brightness limit threshold associated with effective presentation of the AR imagery. ### Claim 16 (depends on 9) The method of claim 9, further comprising activating the one or more lenses that each comprise an electrochromatic lens to a darker state in response to determining that: (i) a level of increase in the brightness of the ambient light is greater than a brightness increase threshold; and (ii) the increase occurs in less than a second threshold period of time. ### Claim 17 A computer program product comprising: a computer readable storage device; and program code on the computer readable storage device that when executed by a processor associated with an electronic device, the program code enables the electronic device to provide functionality of: monitoring at least one first camera sensor that detects ambient light at an augmented reality (AR) display device comprising eyeglasses having one or more lenses configured to be positioned in front of eyes of a person; detecting brightness of the ambient light; dynamically adjusts brightness of AR imagery in relation to the brightness of the ambient light, the AR imagery projected by an AR projector and displayed on the one or more lenses; monitoring at least one second camera sensor configured to detect whether the eyes of the person are open or closed; and reducing the brightness of the AR imagery in response to a brightness context of determining that the eyes of the person have been closed for longer than a threshold period of time. ### Claim 18 (depends on 17) The computer program product of claim 17, wherein the program code enables the electronic device to provide the functionality of ramping up the brightness of the AR imagery over an interval of time in response to determining that the eyes of the person have opened subsequent to having been closed longer than the threshold period of time. ### Claim 19 (depends on 17) The computer program product of claim 17, wherein the program code enables the electronic device to provide the functionality of: activating the one or more lenses that each comprise an electrochromatic lens to a darker state in response to determining that the eyes of the person have been closed longer than threshold period of time; dynamically adjusting brightness of the AR imagery in relation to the brightness of the ambient light that is transmitted through the one or more electrochromatic lenses; in response to determining that the eyes of the person have opened subsequent to having been closed longer than the threshold period of time: gradually reducing a level of activation of the one or more lenses that each comprise an electrochromatic lens over an interval of time to gradually return the one or more lenses to an undarkened state; and gradually increasing the brightness of the AR imagery in relation to brightness of the ambient light allowed through the one or more electrochromatic lenses. ### Claim 20 (depends on 17) The computer program product of claim 17, wherein the program code enables the electronic device to provide the functionality of: activating the one or more lenses that each comprise an electrochromatic lens to a darker state in response to determining that the brightness of the ambient light exceeds a brightness limit threshold associated with effective presentation of the AR imagery; and activating the one or more electrochromatic lens to a darker state in response to determining that: (i) a level of increase in the brightness of the ambient light is greater than a brightness increase threshold; and (ii) the increase occurs in less than a threshold period of time.