# US 2017/0256039 A1 · Method of Processing High Dynamic Range Images Using Dynamic Metadata

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2017/0256039 A1
- Document ID: US20170256039A1
- Status: Published application
- Kind: A1
- Application number: 15/063,462
- Filed: 2016-03-07
- Published: 2017-09-07
- Earliest claimed: 2016-03-07
- Assignees: Novatek Microelectronics Corp.
- Applicants: NOVATEK Microelectronics Corp.
- Inventors: Chia-Jung Hsu; Wan-Ching Tsai; Chao-Wei Ho; Chih-Chia Kuo
- Web page: https://patentgrep.com/patent/US20170256039A1

## CPC

- G06T 5/92: based on global image properties
- G09G 5/02: characterised by the way in which colour is displayed {(details of colour display specific for CRTs G09G1/28; specific for flat matrix panels other than liquid crystal displays G09G3/2003; specific for liquid crystal displays G09G3/3607)}
- G09G 5/026: {Control of mixing and/or overlay of colours in general (G09G5/022 and G09G5/024 take precedence)}
- G06T 2207/20208: High dynamic range [HDR] image processing
- G09G 2320/0276: for the purpose of adaptation to the characteristics of a display device, i.e. gamma correction
- G09G 2320/066: for control of contrast
- G09G 2320/0666: for control of colour parameters, e.g. colour temperature
- G09G 2320/0673: for control of gamma adjustment, e.g. selecting another gamma curve
- G09G 2340/0428: Gradation resolution change
- G09G 2340/06: Colour space transformation
- G09G 2360/144: the light being ambient light
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00)

## Abstract

A method of performing luminance/brightness adjustment and gamut mapping to high dynamic range images for a display device includes receiving an input image to analyze an image distribution of the input image, generating a scene information of the input image according to the image distribution, and performing luminance/brightness adjustment and gamut mapping to the input image according to the scene information, to generate an output image corresponding to the input image, wherein the scene information is regarded as dynamic metadata of the input image.

## Claims

### Claim 1

A method of performing luminance/brightness adjustment to high dynamic range images for a display device, comprising:
receiving an input image to analyze an image distribution of the input image;
generating a scene information of the input image according to the image distribution; and
performing luminance/brightness adjustment to the input image according to the scene information, to generate an output image corresponding to the input image.

### Claim 2 (depends on 1)

The method of claim 1, wherein the image distribution comprises a color distribution in red, green, blue channels, and a luminance distribution in a luminance channel.

### Claim 3 (depends on 1)

The method of claim 1, wherein the scene information comprises at least one of a mean, a maximum, a minimum, and a portion of pixel counts in red, green, blue, and luminance channels, and the scene information is regarded as dynamic metadata of the input image.

### Claim 4 (depends on 1)

The method of claim 1, wherein performing luminance/brightness adjustment to the input image according to the scene information comprises:
calculating a black pivot, a white pivot, and signed clip curve according to at least one of the image distribution, a display capability of the display device, an ambient light, and a user preference; and
adjusting contrast and brightness levels of the display device according to the signed clip curve.

### Claim 5 (depends on 1)

The method of claim 1, wherein performing luminance/brightness adjustment to the input image according to the scene information comprises:
calculating a color correction curve according to at least one of the image distribution, the scene information, a display capability of the display device, and a user preference; and
performing color saturation compensation according to the color correction curve.

### Claim 6 (depends on 1)

The method of claim 1, wherein performing luminance/brightness adjustment to the input image according to the scene information comprises:
calculating a global tone mapping curve according to at least one of the scene information, an input luminance range associated with the image distribution, a display luminance range associated with the display device; and
performing global tone mapping according to the global tone mapping curve.

### Claim 7 (depends on 6)

The method of claim 6, wherein the global tone mapping curve is calculated according to a user preference, and the user preference indicates proportions of blending a tone mapping curve for dark scene with a tone mapping curve for bright scene.

### Claim 8 (depends on 6)

The method of claim 6, wherein performing luminance/brightness adjustment to the input image according to the scene information comprises:
detecting edges of objects in the input image to generate weighted pixels; and
combining the weighted pixels with input pixels of the input image processed with the global tone mapping curve to perform local tone mapping;
wherein weightings of the weighted pixels are generated according to the image distribution and the scene information.

### Claim 9 (depends on 1)

The method of claim 1, wherein performing luminance/brightness adjustment to the input image according to the scene information comprises:
calculating a local dimming curve according to an input luminance range associated with the image distribution, a display luminance range associated with the display device; and
performing local dimming according to the local dimming curve.

### Claim 10 (depends on 9)

The method of claim 9, wherein the local dimming curve is generated according to a highlight region associated with the scene information and the image distribution, and a boost-up brightness level associated with the display panel, where power duties of a backlight module of the display device correspond to the highlight region is calculated according to the local dimming curve.

### Claim 11

A method of performing gamut mapping to high dynamic range images for a display device, comprising:
receiving an input image to analyze an image distribution of the input image;
generating a scene information of the input image according to the image distribution; and
performing gamut mapping to the input image according to the scene information, to generate an output image corresponding to the input image.

### Claim 12 (depends on 11)

The method of claim 11, wherein the image distribution comprises a color distribution in red, green, blue channels, and a luminance distribution in a luminance channel.

### Claim 13 (depends on 11)

The method of claim 11, wherein the scene information comprises at least one of a mean, a maximum, a minimum, and a portion of pixel counts in red, green, blue, and luminance channels, and the scene information is regarded as dynamic metadata of the input image.

### Claim 14 (depends on 11)

The method of claim 11, wherein performing gamut mapping to the input image according to the scene information comprises:
calculating an input gamut range of the input image, a display gamut range of the display device, gamut nodes value, a protect range and a compression range according to the scene information, a display capability of the display device, and a user preference; and
performing gamut mapping according to the input gamut range, the display gamut range, the gamut nodes value, the protect range and the compression range.

### Claim 15 (depends on 14)

The method of claim 14, wherein a node of the input image whose color code is inside the protect range is completely preserved, and another node of the input image whose color code is outside the protect range is mapped into the compression range.

### Claim 16 (depends on 15)

The method of claim 15, wherein another node of the input image whose color code is outside the protect range is mapped into the compression range based on non-linear compression algorithm.

### Claim 17 (depends on 14)

The method of claim 14, wherein the gamut mapping is 3-dimensional color volume mapping in an LCH (Lightness, Chromaticity, Hue angle) color domain.
