# US 12,016,213 B2 · Electronic device and illuminance sensing method based on display information on electronic device > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,016,213 B2 - Document ID: US12016213B2 - Status: Granted - Kind: B2 - Application number: 17/666,108 - Filed: 2022-02-07 - Published: 2022-05-19 - Granted: 2024-06-18 - Earliest claimed: 2018-11-13 - Assignees: Samsung Electronics Co., Ltd. - Applicants: Samsung Electronics Co., Ltd. - Inventors: Jeongho Cho; Jongah Kim; Heewoong Yoon; Donghan Lee; Kyusung Kim; Chanhyoung Park; Eunsook Seo; Taewoong Lee; Euntaek Jang - Web page: https://patentgrep.com/patent/US12016213B2 ## CPC - H10K 59/13: comprising photosensors that control luminance - G06F 1/1694: {the I/O peripheral being a single or a set of motion sensors for pointer control or gesture input obtained by sensing movements of the portable computer} - G06F 1/3206: Monitoring of events, devices or parameters that trigger a change in power modality - G06F 1/3265: {Power saving in display device} - G06F 1/3293: by switching to a less power-consuming processor, e.g. sub-CPU - G06F 3/0412: {Digitisers structurally integrated in a display} - G09G 3/2003: {Display of colours (specific for liquid crystal displays G09G3/3607)} - G09G 3/3225: using an active matrix - H10K 59/40: OLEDs integrated with touch screens - H10K 59/60: OLEDs integrated with inorganic light-sensitive elements, e.g. with inorganic solar cells or inorganic photodiodes - G06F 3/041: Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means - G09G 2320/0242: Compensation of deficiencies in the appearance of colours - G09G 2320/0626: for control of overall brightness - G09G 2320/0693: Calibration of display systems - G09G 2360/144: the light being ambient light - G09G 2360/16: Calculation or use of calculated indices related to luminance levels in display data - Y02D 10/00: Energy efficient computing, e.g. low power processors, power management or thermal management - H10K: ORGANIC ELECTRIC SOLID-STATE DEVICES - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00) - Y02D: CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE ## Abstract An electronic device is provided. The electronic device includes a housing including a front surface and a rear surface facing, a display exposed through a portion of the front surface, an illuminance sensor disposed between the display and the rear surface to overlap an area of the display when viewed from above the front surface, a processor positioned inside the housing and operatively connected with the display, and a memory positioned inside the housing and operatively connected with the processor, wherein the memory stores instructions configured to, when executed, enable the processor to receive first illuminance data measured using the illuminance sensor, identify display parameter information associated with the first illuminance data, obtain second illuminance data based on at least a part of the display parameter information and the first illuminance data, and adjust a brightness of the display based on at least a part of the second illuminance data. ## Claims ### Claim 1 A portable communication device comprising: a housing including a front plate and a rear plate opposite to the front plate; a display disposed in the housing and visible through the front plate; an illuminance sensor disposed between the display and the rear plate such that the illuminance sensor is overlapped with a portion of the display when viewed from above the front plate; and a processor disposed in the housing and operatively connected with the display, the processor being configured to: output an image via the display, obtain first illuminance data corresponding to an illuminance sensed by the illuminance sensor for an image frame while the image is output via the display, in response to the obtaining of the first illuminance data, identify display parameter information associated with the first illuminance data, the display parameter information including display brightness information obtained while the image is output via the display, in response to the display brightness information corresponding to a first brightness of the display, select a first illumination value, in response to the display brightness information corresponding to a second brightness of the display different from the first brightness, select a second illumination value different from the first illumination value, based on the selecting of the first illumination value or the second illumination value, obtain second illuminance data, and adjust a brightness of the display based at least in part on the first illumination value or the second illumination value selected as the second illuminance data while the image is output via the display, wherein the first illumination value is determined as the illuminance sensor senses a light emitted while a first image having the first brightness is output via the display in a state in which an external light is blocked off, wherein the second illumination value is determined as the illuminance sensor senses a light emitted while a second image having the second brightness is output via the display in the state in which the external light is blocked off, and wherein the display brightness information comprises at least one of color on pixel ratio (COPR) information about the image output via the display or active matrix organic light emitting diode (AMOLED) off ratio (AOR) information about the display. ### Claim 2 (depends on 1) The portable communication device of claim 1, further comprising: a memory, wherein each of the first illumination value and the second illumination value is stored in the memory before the outputting of the image. ### Claim 3 (depends on 1) The portable communication device of claim 1, wherein the display parameter information further includes at least one of color information or transmittance information obtained while the image is output via the display. ### Claim 4 (depends on 1) The portable communication device of claim 1, wherein the illuminance sensor is disposed under an area of the display. ### Claim 5 (depends on 1) The portable communication device of claim 1, wherein the second illuminance data comprises a red (R) channel sensing value, a green (G) channel sensing value, a blue (B) channel sensing value, and a clear (C) channel sensing value of the illuminance sensor, corresponding to an R value, a G value, a B value, and a C value, respectively, of the image output from the display, with light blocked off from outside. ### Claim 6 A method of sensing illuminance by an electronic device, the method comprising: outputting an image via a display of the electronic device; obtaining first illuminance data corresponding to an illuminance sensed by an illuminance sensor of the electronic device for an image frame while the image is output via the display; in response to the obtaining of the first illuminance data, identifying display parameter information associated with the first illuminance data, the display parameter information including display brightness information obtained while the image is output via the display; in response to the display brightness information corresponding to a first brightness of the display, selecting a first illumination value; in response to the display brightness information corresponding to a second brightness of the display different from the first brightness, selecting a second illumination value different from the first illumination value; based on the selecting of the first illumination value or the second illumination value, obtaining second illuminance data; and adjusting a brightness of the display based at least in part on the first illumination value or the second illumination value selected as the second illuminance data while the image is output via the display, wherein the first illumination value is determined as the illuminance sensor senses a light emitted while a first image having the first brightness is output via the display in a state in which an external light is blocked off, wherein the second illumination value is determined as the illuminance sensor senses a light emitted while a second image having the second brightness is output via the display in the state in which the external light is blocked off, and wherein the display brightness information comprises at least one of color on pixel ratio (COPR) information about the image output via the display or active matrix organic light emitting diode (AMOLED) off ratio (AOR) information about the display. ### Claim 7 (depends on 6) The method of claim 6, wherein each of the first illumination value and the second illumination value is stored in a memory of the electronic device before the outputting of the image. ### Claim 8 (depends on 6) The method of claim 6, wherein the display parameter information further includes at least one of color information or transmittance information obtained while the image is output via the display. ### Claim 9 (depends on 6) The method of claim 6, wherein the illuminance sensor is disposed under an area of the display. ### Claim 10 (depends on 6) The method of claim 6, wherein the second illuminance data comprises a red (R) channel sensing value, a green (G) channel sensing value, a blue (B) channel sensing value, and a clear (C) channel sensing value of the illuminance sensor, corresponding to an R value, a G value, a B value, and a C value, respectively, of the image output from the display, with light blocked off from outside. ### Claim 11 A non-transitory storage medium storing instructions, the instructions being configured to be executed by at least one circuit to cause an electronic device to perform at least one operation, the at least one operation comprising: outputting an image via a display of the electronic device; obtaining first illuminance data corresponding to an illuminance sensed by an illuminance sensor of the electronic device for an image frame while the image is output via the display; in response to the obtaining of the first illuminance data, identifying display parameter information associated with the first illuminance data, the display parameter information including display brightness information obtained while the image is output via the display; in response to the display brightness information corresponding to a first brightness of the display, selecting a first illumination value; in response to the display brightness information corresponding to a second brightness of the display different from the first brightness, selecting a second illumination value different from the first illumination value; based on the selecting of the first illumination value or the second illumination value, obtaining second illuminance data, and adjusting a brightness of the display based at least in part on the first illumination value or the second illumination value selected as the second illuminance data while the image is output via the display, wherein the first illumination value is determined as the illuminance sensor senses a light emitted while a first image having the first brightness is output via the display in a state in which an external light is blocked off, wherein the second illumination value is determined as the illuminance sensor senses a light emitted while a second image having the second brightness is output via the display in the state in which the external light is blocked off, and wherein the display brightness information comprises at least one of color on pixel ratio (COPR) information about the image output via the display or active matrix organic light emitting diode (AMOLED) off ratio (AOR) information about the display. ### Claim 12 (depends on 1) The portable communication device of claim 1, wherein the processor is further configured to: obtain illuminance raw data corresponding to the display parameter information in a state in which an external light is blocked off, based on the illuminance raw data, obtain correction information associated with the display parameter information, based on the correction information, obtain the second illuminance data, and based on the second illuminance data, adjust the brightness of the display. ### Claim 13 (depends on 4) The portable communication device of claim 4, wherein the processor is further configured to: obtain the correction information associated with the display parameter information using the illuminance raw data, based on the correction information and the first illuminance data, obtain the second illuminance data, and based on the second illuminance data, adjust the brightness of the display, and wherein the correction information is information where an illuminance value by influence of the display is excluded from the first illuminance data. ### Claim 14 (depends on 12) The portable communication device of claim 12, wherein the correction information comprises one of first correction information or second correction information, wherein the first correction information includes at least one of a first illuminance value when a red (R) value is 1 with the external light blocked off, a second illuminance value when a green (G) value is 1 with the external light blocked off, or a third illuminance value when a blue (B) value is 1 with die external light blocked off, and wherein the second correction information includes information about a mathematical equation or formula relationship between P. G, and B values of each of a plurality of images included in die display parameter information, with external light blocked off, and an illuminance value measured at a time of outputting each of the plurality of images.