# US 11,908,112 B2 · Dynamic tone mapping > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 11,908,112 B2 - Document ID: US11908112B2 - Status: Granted - Kind: B2 - Application number: 18/303,376 - Filed: 2023-04-19 - Published: 2023-09-14 - Granted: 2024-02-20 - Earliest claimed: 2021-11-24 - Assignees: Roku, Inc. - Applicants: Roku, Inc. - Inventors: Sheng Yuan Chiu; Kunlung Wu - Web page: https://patentgrep.com/patent/US11908112B2 ## CPC - G06T 5/92: based on global image properties - G06T 5/40: using histogram techniques - G06T 5/50: using two or more images, e.g. averaging or subtraction - G06T 7/0002: {Inspection of images, e.g. flaw detection} - H04N 5/20: Circuitry for controlling amplitude response - H04N 5/202: Gamma control (circuits for controlling camera response irrespective of the scene brightness H04N23/82) - G06T 2200/24: involving graphical user interfaces [GUIs] - G06T 2207/10016: Video; Image sequence - G06T 2207/10024: Color image - G06T 2207/20208: High dynamic range [HDR] image processing - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract Disclosed herein are system, apparatus, article of manufacture, method and/or computer program product embodiments, and/or combinations and sub-combinations thereof, for dynamic tone mapping of video content. An example embodiment operates by identifying, by a dynamic tone mapping system executing on a media device, characteristics of a first video signal having a first dynamic range based on a frame-by-frame analysis of the first video signal. The example embodiment further operates by modifying, by the dynamic tone mapping system, a tone mapping curve based on the characteristics of the first video signal to generate a modified tone mapping curve. Subsequently, the example embodiment operates by converting, by the dynamic tone mapping system, the first video signal based on the modified tone mapping curve to generate a second video signal having a second dynamic range that is less than the first dynamic range. ## Claims ### Claim 1 A computer-implemented method for dynamic tone mapping of video content, comprising: receiving, by a dynamic tone mapping system executing on a media device, histogram data associated with a first video signal representing a video program, wherein the first video signal has a first dynamic range and static metadata describing one or more brightness characteristics of the video program, wherein the histogram data comprises color values for a plurality of frames in the first video signal outputted by a display device; determining, by the dynamic tone mapping system, a cumulative histogram for a scene in the video program based on the histogram data; determining, by the dynamic tone mapping system, a near-brightest pixel for the scene in the video program based on the cumulative histogram, wherein the near-brightest pixel is a representative pixel value that defines a maximum target brightness value for proper display of the scene; modifying, by the dynamic tone mapping system, a tone mapping curve based on the near-brightest pixel and characteristics of the display device to generate a modified tone mapping curve; and converting, by the dynamic tone mapping system, the first video signal based on the modified tone mapping curve to generate a second video signal having a second dynamic range that is less than the first dynamic range. ### Claim 2 (depends on 1) The computer-implemented method of claim 1, wherein the modifying the tone mapping curve comprises: modifying the tone mapping curve based on a user setting. ### Claim 3 (depends on 2) The computer-implemented method of claim 2, further comprising: adapting, by the dynamic tone mapping system, the second video signal to the user setting. ### Claim 4 (depends on 1) The computer-implemented method of claim 1, wherein the modifying further comprises: temporally filtering, by the dynamic tone mapping system, the modified tone mapping curve. ### Claim 5 (depends on 1) The computer-implemented method of claim 1, wherein the determining the near-brightest pixel for the scene in the video program further comprises: determining the near-brightest pixel for the scene in the video program by identifying, using the cumulative histogram, a pixel value in the scene that belongs to a top percentage value of brightest pixels in the scene, wherein the top percentage value is defined by a threshold value. ### Claim 6 (depends on 1) The computer-implemented method of claim 1, further comprising: generating, by the dynamic tone mapping system, video quality enhancement data based on the histogram data associated with the first video signal, and wherein the converting further comprises: converting, by the dynamic tone mapping system, the first video signal based on the video quality enhancement data. ### Claim 7 (depends on 6) The computer-implemented method of claim 6, wherein the video quality enhancement data comprises dark scene adjustment data, bright scene adjustment data, or detail enhancement data. ### Claim 8 A system for dynamic tone mapping of video content, comprising: a memory; and at least one processor coupled to the memory and configured to: receive histogram data associated with a first video signal representing a video program, wherein the first video signal has a first dynamic range and static metadata describing one or more brightness characteristics of the video program, wherein the histogram data comprises color values for a plurality of frames in the first video signal outputted by a display device; determine a cumulative histogram for a scene in the video program based on the histogram data; determine a near-brightest pixel for the scene in the video program based on the cumulative histogram, wherein the near-brightest pixel is a representative pixel value that defines a maximum target brightness value for proper display of the scene; modify a tone mapping curve based on the near-brightest pixel and characteristics of the display device to generate a modified tone mapping curve; and convert the first video signal based on the modified tone mapping curve to generate a second video signal having a second dynamic range that is less than the first dynamic range. ### Claim 9 (depends on 8) The system of claim 8, wherein to modify the tone mapping curve, the at least one processor is further configured to: modify the tone mapping curve based on a user setting. ### Claim 10 (depends on 8) The system of claim 8, wherein the at least one processor is further configured to: adapt the second video signal to the user setting. ### Claim 11 (depends on 8) The system of claim 8, wherein to modify the tone mapping curve, the at least one processor is further configured to: temporally filter the modified tone mapping curve. ### Claim 12 (depends on 8) The system of claim 8, wherein to determine the near-brightest pixel for the scene in the video program, the at least one processor is further configured to: determine the near-brightest pixel for the scene in the video program by identifying, using the cumulative histogram, a pixel value in the scene that belongs to a top percentage value of brightest pixels in the scene, wherein the top percentage value is defined by a threshold value. ### Claim 13 (depends on 8) The system of claim 8, wherein the at least one processor is further configured to: generate video quality enhancement data based on the histogram data associated with the first video signal; and wherein to convert the first video signal, the at least one processor is further configured to: convert the first video signal based on the video quality enhancement data. ### Claim 14 (depends on 13) The system of claim 13, wherein the video quality enhancement data comprises dark scene adjustment data, bright scene adjustment data, or detail enhancement data. ### Claim 15 A non-transitory computer-readable medium having instructions stored thereon that, when executed by at least one computing device, cause the at least one computing device to perform operations for dynamic tone mapping of video content, the operations comprising: receiving histogram data associated with a first video signal representing a video program, wherein the first video signal has a first dynamic range and static metadata describing one or more brightness characteristics of the video program, wherein the histogram data comprises color values for a plurality of frames in the first video signal outputted by a display device; determining a cumulative histogram for a scene in the video program based on the histogram data; determining a near-brightest pixel for the scene in the video program based on the cumulative histogram, wherein the near-brightest pixel is a representative pixel value that defines a maximum target brightness value for proper display of the scene; modifying a tone mapping curve based on the near-brightest pixel and characteristics of the display device to generate a modified tone mapping curve; and converting the first video signal based on the modified tone mapping curve to generate a second video signal having a second dynamic range that is less than the first dynamic range. ### Claim 16 (depends on 15) The non-transitory computer-readable medium of claim 15, wherein the modifying the tone mapping curve comprises; modifying the tone mapping curve based on a user setting. ### Claim 17 (depends on 15) The non-transitory computer-readable medium of claim 15, wherein the operations further comprise: adapting the second video signal to the user setting. ### Claim 18 (depends on 15) The non-transitory computer-readable medium of claim 15, wherein the modifying further comprises: temporally filtering the modified tone mapping curve. ### Claim 19 (depends on 15) The non-transitory computer-readable medium of claim 15, wherein the determining the near-brightest pixel for the scene in the video program further comprises: determining the near-brightest pixel for the scene in the video program by identifying, using the cumulative histogram, a pixel value in the scene that belongs to a top percentage value of brightest pixels in the scene, wherein the top percentage value is defined by a threshold value. ### Claim 20 (depends on 15) The non-transitory computer-readable medium of claim 15, wherein the operations further comprise: generating video quality enhancement data based on the histogram data associated with the first video signal; and wherein the converting further comprises: converting the first video signal based on the video quality enhancement data.