# US 9,437,171 B2 · Local tone mapping for high dynamic range images > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 9,437,171 B2 - Document ID: US9437171B2 - Status: Granted - Kind: B2 - Application number: 14/098,243 - Filed: 2013-12-05 - Published: 2014-06-05 - Granted: 2016-09-06 - Earliest claimed: 2012-12-05 - Assignees: Texas Instruments Incorporated - Applicants: Texas Instruments Incorporated - Inventors: Rajesh Narasimha; Aziz Umit Batur - Web page: https://patentgrep.com/patent/US9437171B2 ## CPC - G09G 5/377: for mixing or overlaying two or more graphic patterns (G09G5/02, G09G5/397 take precedence) - G06T 5/50: using two or more images, e.g. averaging or subtraction - G06T 5/92: based on global image properties - G06T 5/94: based on local image properties, e.g. for local contrast enhancement - G06V 10/60: relating to illumination properties, e.g. using a reflectance or lighting model - H04N 23/741: by increasing the dynamic range of the image compared to the dynamic range of the electronic image sensors - H04N 23/743: Bracketing, i.e. taking a series of images with varying exposure conditions - G06T 2207/10144: Varying exposure - G06T 2207/20012: Locally adaptive - G06T 2207/20021: Dividing image into blocks, subimages or windows - G06T 2207/20208: High dynamic range [HDR] image processing - H04N 25/589: with different integration times, e.g. short and long exposures - G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00) - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract A method of local tone mapping of a high dynamic range (HDR) image is provided that includes dividing a luminance image of the HDR image into overlapping blocks and computing a local tone curve for each block, computing a tone mapped value for each pixel of the luminance image as a weighted sum of values computed by applying local tone curves of neighboring blocks to the pixel value, computing a gain for each pixel as a ratio of the tone mapped value to the value of the pixel, and applying the gains to corresponding pixels in the HDR image. A weight for each value is computed based on distance from the pixel to the center point of the block having the local tone curve applied to compute the value and the intensity difference between the value of the pixel and the block mean pixel value. ## Claims ### Claim 1 A method of local tone mapping of a high dynamic range (HDR) image, the method comprising: generating, with one or more processors, a luminance image of the HDR image; dividing, with the one or more processors, the luminance image into overlapping blocks and computing a local tone curve for each block; computing, with the one or more processors, a tone mapped value for each pixel of the luminance image as a weighted sum of N values computed by applying local tone curves of N neighboring blocks of the pixel to a value of the pixel, wherein a weight for each value of the N values is computed based on a distance from the pixel to a center point of the block having the local tone curve applied to compute the value of the N values and an intensity difference between the value of the pixel and a mean pixel value of the block, wherein N is a positive integer; computing, with the one or more processors, a gain for each pixel of the luminance image as a ratio of the tone mapped value to the value of the pixel; and applying, with the one or more processors, the computed gains to corresponding pixels in the HDR image to generate a tone-mapped HDR image. ### Claim 2 (depends on 1) The method of claim 1, further comprising performing white point adjustment on the luminance image. ### Claim 3 (depends on 1) The method of claim 1, wherein N=4, and wherein the neighboring blocks are four blocks having center points closest to the pixel. ### Claim 4 (depends on 1) The method of claim 1, further comprising: generating the HDR image by merging a long exposure image and a short exposure image. ### Claim 5 (depends on 4) The method of claim 4, wherein merging a long exposure image and a short exposure image comprises: computing a merging weight for each pixel location of the long exposure image based on a pixel value of the pixel location and a saturation threshold; and computing a pixel value for each pixel location of the HDR image as a weighted sum of corresponding pixel values in the long exposure image and the short exposure image, wherein a weight applied to a pixel value of the pixel location of the short exposure image and a weight applied to a pixel value of the pixel location in the long exposure image are determined based on the merging weight computed for the pixel location of the long exposure image and responsive to motion in a scene of the long exposure image and the short exposure image. ### Claim 6 (depends on 5) The method of claim 5, wherein computing a pixel value further comprises: computing a motion adaptation weight for each pixel location of the long exposure image; computing a weight for each pixel location of the long exposure image based on the merging weight computed for the pixel location of the long exposure image and the motion adaptation weight computed for each pixel location of the long exposure image; and computing a weight for each pixel location of the short exposure image by subtracting the weight computed for the pixel location in the long exposure image from one. ### Claim 7 (depends on 6) The method of claim 6, wherein computing a motion adaptation weight comprises: computing the motion adaptation weight for each pixel location of the long exposure image based on a delta between a pixel value of the pixel location in the long exposure image and a pixel value of the pixel location in the short exposure image. ### Claim 8 (depends on 6) The method of claim 6, wherein computing a motion adaptation weight comprises: computing the motion adaptation weight for each pixel location based on deltas between pixel values of a block of pixel locations around the pixel location in the long exposure image and pixels values of a corresponding block of pixel locations around the pixel location in the short exposure image. ### Claim 9 (depends on 4) The method of claim 4, further comprising: adjusting gain difference between the long exposure image and the short exposure image. ### Claim 10 (depends on 4) The method of claim 4, further comprising: performing black level adjustment on the long exposure image and the short exposure image; and performing white balancing on the long exposure image and the short exposure image. ### Claim 11 An apparatus configured to perform local tone mapping of a high dynamic range (HDR) image, the apparatus comprising: means for generating the HDR image; means for generating a luminance image of the HDR image; means for dividing the luminance image into overlapping blocks and computing a local tone curve for each block; means for computing a tone mapped value for each pixel of the luminance image as a weighted sum of N values computed by applying local tone curves of N neighboring blocks of the pixel to a value of the pixel, wherein a weight for each value of the N values is computed based on a distance from the pixel to a center point of the block having the local tone curve applied to compute the value of the N values and an intensity difference between the value of the pixel and a mean pixel value of the block, wherein N is an integer; means for computing a gain for each pixel of the luminance image as a ratio of the tone mapped value to the value of the pixel; and means for applying the computed gains to corresponding pixels in the HDR image to generate a tone-mapped HDR image. ### Claim 12 (depends on 11) The apparatus of claim 11, further comprising means for performing white point adjustment on the luminance image. ### Claim 13 (depends on 11) The apparatus of claim 11, wherein N=4, and wherein the neighboring blocks are four blocks having center points closest to the pixel. ### Claim 14 (depends on 11) The apparatus of claim 11, wherein the means for generating the HDR image generates the HDR image by merging a long exposure image and a short exposure image. ### Claim 15 (depends on 14) The apparatus of claim 14, wherein the means for generating the HDR image merges the long exposure image and the short exposure image by: computing a merging weight for each pixel location of the long exposure image based on a pixel value of the pixel location and a saturation threshold; and computing a pixel value for each pixel location of the HDR image as a weighted sum of corresponding pixel values in the long exposure image and the short exposure image, wherein a weight applied to a pixel value of the pixel location of the short exposure image and a weight applied to a pixel value of the pixel location in the long exposure image are determined based on the merging weight computed for the pixel location of the long exposure image and responsive to motion in a scene of the long exposure image and the short exposure image. ### Claim 16 (depends on 15) The apparatus of claim 15, wherein computing a pixel value further comprises: computing a motion adaptation weight for each pixel location of the long exposure image; computing a weight for each pixel location of the long exposure image based on the merging weight computed for the pixel location of the long exposure image and the motion adaptation weight computed for each pixel location of the long exposure image; and computing a weight for each pixel location of the short exposure image by subtracting the weight computed for the pixel location in the long exposure image from one. ### Claim 17 (depends on 16) The apparatus of claim 16, wherein computing a motion adaptation weight comprises: computing the motion adaptation weight for each pixel location of the long exposure image based on a delta between a pixel value of the pixel location in the long exposure image and a pixel value of the pixel location in the short exposure image. ### Claim 18 (depends on 16) The apparatus of claim 16, wherein computing a motion adaptation weight comprises: computing the motion adaptation weight for each pixel location based on deltas between pixel values of a block of pixel locations around the pixel location in the long exposure image and pixels values of a corresponding block of pixel locations around the pixel location in the short exposure image. ### Claim 19 (depends on 14) The apparatus of claim 14, further comprising: means for adjusting gain difference between the long exposure image and the short exposure image. ### Claim 20 (depends on 14) The apparatus of claim 14, further comprising: means for performing black level adjustment on the long exposure image and the short exposure image; and means for performing white balancing on the long exposure image and the short exposure image.