# US 12,223,927 B2 · Region-by-region illumination control at display device based on per-region brightness > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,223,927 B2 - Document ID: US12223927B2 - Status: Granted - Kind: B2 - Application number: 16/670,673 - Filed: 2019-10-31 - Published: 2020-07-09 - Granted: 2025-02-11 - Earliest claimed: 2019-01-04 - Assignees: ATI Technologies ULC - Applicants: Ati Technologies Ulc - Inventors: Ed Callway; David Glen - Web page: https://patentgrep.com/patent/US12223927B2 ## CPC - G09G 5/10: Intensity circuits - G06F 3/013: {Eye tracking input arrangements (G06F3/015 takes precedence)} - G06T 15/506: {Illumination models} - G09G 3/20: for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix {no fixed position being assigned to or needed to be assigned to the individual characters or partial characters} - G09G 3/3208: organic, e.g. using organic light-emitting diodes [OLED] - G09G 3/3406: {Control of illumination source (illumination devices structurally associated with liquid crystal cells G02F1/1336)} - G09G 5/12: Synchronisation between the display unit and other units, e.g. other display units, video-disc players - G09G 3/32: semiconductive, e.g. using light-emitting diodes [LED] - G09G 3/3426: {the different display panel areas being distributed in two dimensions, e.g. matrix} - G09G 3/36: using liquid crystals - G09G 2310/0237: Switching ON and OFF the backlight within one frame - G09G 2310/08: Details of timing specific for flat panels, other than clock recovery - G09G 2320/0247: Flicker reduction other than flicker reduction circuits used for single beam cathode-ray tubes - G09G 2320/0261: in the context of movement of objects on the screen or movement of the observer relative to the screen - G09G 2320/062: Adjustment of illumination source parameters - G09G 2320/0626: for control of overall brightness - G09G 2320/0633: by amplitude modulation of the brightness of the illumination source - G09G 2320/064: by time modulation of the brightness of the illumination source - G09G 2320/0646: Modulation of illumination source brightness and image signal correlated to each other - G09G 2320/10: Special adaptations of display systems for operation with variable images - G09G 2320/106: Determination of movement vectors or equivalent parameters within the image - G09G 2330/021: Power management, e.g. power saving - G09G 2340/0435: Change or adaptation of the frame rate of the video stream - G09G 2340/16: Determination of a pixel data signal depending on the signal applied in the previous frame - G09G 2354/00: Aspects of interface with display user - G09G 2360/145: the light originating from the display screen - G09G 2360/16: Calculation or use of calculated indices related to luminance levels in display data - G09G 2370/022: Centralised management of display operation, e.g. in a server instead of locally - G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00) - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL ## Abstract A display system includes a rendering device and a display device having a plurality of individually-controllable illumination regions. The rendering device is to render a frame for display at the display device during a frame period and to determine a brightness representation for each region of a plurality of regions of the frame, each region of the frame corresponding to an illumination region of the display device. The rendering device further is to set, for each illumination region, an illumination configuration to be applied by the display device for the illumination region during at least one of the frame period and a subsequent frame period based on the brightness representation for the corresponding region of the frame, wherein the illumination configuration controls at least one of an illumination level, a duration, and a position of an illumination strobe to be implemented for the corresponding illumination region. ## Claims ### Claim 1 A computer-implemented method comprising: displaying a frame at a display device during a frame period, the display device having a plurality of individually-controllable illumination regions; determining a brightness representation for each of the illumination regions for the frame; and setting, for each illumination region, an illumination configuration to be applied by the display device for the illumination region during at least one of the frame period and a subsequent frame period based on the determined brightness representation for the illumination region, wherein setting the illumination configuration includes specifying one or more of an illumination level of an illumination strobe or an illumination level of an illumination fill. ### Claim 2 (depends on 1) The computer-implemented method of claim 1, wherein setting the illumination configuration to be applied by the display device for the illumination region comprises: determining a general illumination configuration for the frame; and modifying the general illumination configuration based on the brightness representation to determine the illumination configuration to be applied by the display device for the illumination region. ### Claim 3 (depends on 2) The computer-implemented method of claim 2, wherein modifying the general illumination configuration includes identifying one or more modifications to be made to one or more of an illumination level, a duration, or a position of the illumination strobe or an illumination level of an illumination fill of the general illumination configuration based on the brightness representation. ### Claim 4 (depends on 3) The computer-implemented method of claim 3, wherein identifying the one or more modifications comprises at least one of: identifying the one or more modifications from an entry of a look-up table indexed based on the brightness representation; identifying the one or more modifications from a software function using the brightness representation; and identifying the one or more modifications from a learned model generated by a machine learning algorithm. ### Claim 5 (depends on 2) The computer-implemented method of claim 2, wherein modifying the general illumination configuration includes: responsive to the brightness representation indicating the region of the frame has a lower average brightness, modifying the general illumination configuration to increase at least one of the illumination level or a duration of the illumination strobe and to decrease an illumination level of an illumination fill; and responsive to the brightness representation indicating the region of the frame has a higher average brightness, modifying the general illumination configuration to decrease at least one of the illumination level or the duration of the illumination strobe and to increase an illumination level of an illumination fill. ### Claim 6 (depends on 1) The computer-implemented method of claim 1, wherein setting the illumination configuration to be applied by the display device for the illumination region comprises: generating an illumination configuration specific to the illumination region based on the brightness representation, the illumination configuration including at least one of the illumination level or a duration for the illumination strobe and an illumination level for at least one illumination fill. ### Claim 7 (depends on 6) The computer-implemented method of claim 6, wherein generating the illumination configuration specific to the illumination region comprises at least one of: determining the illumination configuration from an entry of a look-up table indexed based on the brightness representation; determining the illumination configuration from a software function using the brightness representation; and determining the illumination configuration from a learned model generated by a machine learning algorithm. ### Claim 8 (depends on 6) The computer-implemented method of claim 6, wherein generating the illumination configuration specific to the illumination region comprises: responsive to the brightness representation indicating the region of the frame has a lower average brightness, generating the illumination configuration to have the illumination strobe with a first illumination level and a first duration and an illumination fill with a second illumination level; and responsive to the brightness representation indicating the region of the frame has a higher average brightness, generating the illumination configuration to have an illumination strobe with at least one of a third illumination level and a second duration and an illumination fill with a fourth illumination level, wherein at least one of: the first illumination level is greater than the third illumination level, the fourth illumination level is greater than the second illumination level, or the second duration is less than the first duration. ### Claim 9 (depends on 1) The computer-implemented method of claim 1, wherein determining a brightness representation for each region of a plurality of regions of the frame comprises: determining a histogram of pixel values for the region; and determining the brightness representation for the region from the histogram. ### Claim 10 (depends on 1) The computer-implemented method of claim 1, wherein determining a brightness representation for each region of a plurality of regions of the frame comprises: determining the brightness representation for the region based on an average pixel value of the region. ### Claim 11 A display system, configured to: render a frame for display at a display device during a frame period, the display device having a plurality of individually-controllable illumination regions, wherein each of the illumination regions includes two or more pixels; determine a brightness representation for each region of a plurality of regions of the frame, each region of the frame corresponding to an illumination region of the display device; and set, for each illumination region, an illumination configuration to be applied by the display device for the illumination region during at least one of the frame period and a subsequent frame period based on the brightness representation for a corresponding region of the frame, wherein to set the illumination configuration includes to specify at least one of an illumination level of an illumination strobe or an illumination level of an illumination fill. ### Claim 12 (depends on 11) The display system of claim 11, wherein the display system is configured to set the illumination configuration to be applied by the display device for the illumination region by: determining a general illumination configuration for the frame; and modifying the general illumination configuration based on the brightness representation to determine the illumination configuration to be applied by the display device for the illumination region. ### Claim 13 (depends on 12) The display system of claim 12, wherein the display system is configured to modify the general illumination configuration by identifying one or more modifications to be made to one or more of the illumination level of the illumination strobe, a duration of the illumination strobe, or an illumination level of an illumination fill of the general illumination configuration based on the brightness representation. ### Claim 14 (depends on 12) The display system of claim 12, wherein the display system is configured to modify the general illumination configuration by: responsive to the brightness representation indicating the region of the frame has a lower average brightness, modifying the general illumination configuration to increase at least one of the illumination level or a duration of the illumination strobe and to decrease an illumination level of an illumination fill; and responsive to the brightness representation indicating the region of the frame has a higher average brightness, modifying the general illumination configuration to decrease at least one of the illumination level or the duration of the illumination strobe and to increase an illumination level of an illumination fill. ### Claim 15 (depends on 11) The display system of claim 11, wherein the display system is configured to set the illumination configuration to be applied by the display device for the illumination region by: generating an illumination configuration specific to the illumination region based on the brightness representation, the illumination configuration including at least one of the illumination level for the illumination strobe, a duration of the illumination strobe, and an illumination level for at least one illumination fill. ### Claim 16 (depends on 15) The display system of claim 15, wherein the display system is configured to generate the illumination configuration specific to the illumination region by: responsive to the brightness representation indicating the region of the frame has a lower average brightness, generating the illumination configuration to have the illumination strobe with a first illumination level and a first duration and an illumination fill with a second illumination level; and responsive to the brightness representation indicating the region of the frame has a higher average brightness, generating the illumination configuration to have the illumination strobe with at least one of a third illumination level and a second duration, and an illumination fill with a fourth illumination level, wherein at least one of: the first illumination level is greater than the third illumination level, the fourth illumination level is greater than the second illumination level, or the second duration is greater than the first duration. ### Claim 17 (depends on 11) The display system of claim 11, wherein the display system is configured to determine a brightness representation for each region of a plurality of regions of the frame by: determining a histogram of pixel values for the region; and determining the brightness representation for the region from the histogram. ### Claim 18 (depends on 11) The display system of claim 11, wherein the display system is configured to determine a brightness representation for each region of a plurality of regions of the frame by: determining the brightness representation for the region based on an average pixel value of the region. ### Claim 19 (depends on 11) The display system of claim 11, further comprising: the display device. ### Claim 20 A display system comprising: a display device having a plurality of individually-controllable illumination regions, the display device configured to: determine, for each illumination region, an illumination configuration to be applied for the illumination region during at least one of a current frame period or a subsequent frame period based on a brightness representation for a region of a current frame, the region of the current frame corresponding to the illumination region, wherein the illumination configuration specifies one or more of an illumination level of an illumination strobe or an illumination level of an illumination fill.