# US 2016/0253792 A1 · Guided color grading for extended dynamic range

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2016/0253792 A1
- Document ID: US20160253792A1
- Status: Published application
- Kind: A1
- Application number: 15/030,346
- Filed: 2014-10-21
- Published: 2016-09-01
- Earliest claimed: 2013-10-22
- Assignees: Dolby Laboratories Licensing Corporation
- Applicants: Dolby Laboratories Licensing Corporation
- Inventors: Ning XU; Tao CHEN; James E. CRENSHAW; Samir N. HULYALKAR
- Web page: https://patentgrep.com/patent/US20160253792A1

## CPC

- G06T 5/90: Dynamic range modification of images or parts thereof
- G06T 5/50: using two or more images, e.g. averaging or subtraction
- G06T 5/94: based on local image properties, e.g. for local contrast enhancement
- H04N 1/6052: {Matching two or more picture signal generators or two or more picture reproducers}
- H04N 9/67: for matrixing (camera processing pipelines for matrixing of colour signals H04N23/85)
- G06T 2207/20208: High dynamic range [HDR] image processing
- H04N 1/40006: {Compensating for the effects of ageing, i.e. changes over time}
- H04N 5/57: Control of contrast or brightness
- H04N 21/4318: {by altering the content in the rendering process, e.g. blanking, blurring or masking an image region (image enhancement or restoration in general G06T5/00)}
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

Novel methods and systems for color grading are disclosed. The color grading process for a visual dynamic range image can be guided by information relating to the color grading of other images such as the standard dynamic range image.

## Claims

### Claim 1

A method to perform color grading, the method comprising:
providing, by a computer, an ungraded image;
providing, by a computer, a color graded lower dynamic range image; and
color grading, by a computer, the ungraded image based on the color graded lower dynamic range image, thereby obtaining a higher dynamic range color graded image.

### Claim 2 (depends on 1)

The method of claim 1, further comprising spatially and temporally aligning, by a computer, the ungraded image and the color graded lower dynamic range image, thereby obtaining an aligned ungraded image, and wherein the color grading, by a computer, is applied to the aligned ungraded image, based on the color graded lower dynamic range image, thereby obtaining a higher dynamic range color graded image.

### Claim 3 (depends on 2)

The method of claim 2, wherein the spatially and temporally aligning, by a computer, comprises applying a hand trim alignment pass.

### Claim 4 (depends on 1)

The method of claim 1, wherein the color grading, by a computer, comprises applying a hand trim color grading pass.

### Claim 5 (depends on 2)

The method of claim 2, wherein the spatially and temporally aligning comprises:
detecting, by a computer, feature points in the ungraded image and in the color graded lower dynamic range image;
matching, by a computer, the feature points; and
estimating, by a computer, a transformation between the ungraded image and the color graded lower dynamic range image, based on the matching of the feature points.

### Claim 6 (depends on 5)

The method of claim 5, wherein the detecting further comprises extracting, by a computer, feature descriptors in at least one local region of the ungraded image and at least one local region of the color graded lower dynamic range image, and wherein the matching further comprises matching, by a computer, the feature descriptors.

### Claim 7

A method to perform color grading, the method comprising:
providing, by a computer, an ungraded image;
providing, by a computer, a color graded lower dynamic range image;
applying, by a computer, an inverse tone and gamut mapping transformation to the color graded lower dynamic range image, thereby obtaining an inversely mapped lower dynamic range image;
providing, by a computer, a higher dynamic range editing, based on the ungraded image; and
applying, by a computer, a color transformation to the ungraded image, based on the higher dynamic range editing and the inversely mapped lower dynamic range image, thereby obtaining a higher dynamic range master image.

### Claim 8 (depends on 7)

The method of claim 7, further comprising spatially and temporally aligning, by a computer, the ungraded image and the inversely mapped lower dynamic range image, thereby obtaining an aligned image, and wherein the applying, by a computer, a color transformation is applied to the aligned image, based on the higher dynamic range editing, thereby obtaining a higher dynamic range master image.

### Claim 9 (depends on 7)

The method of claim 7, wherein the applying an inverse tone and gamut mapping transformation comprises:
applying, by a computer, gamma decoding to the color graded lower dynamic range image in a first color space, thereby obtaining a gamma decoded first image;
converting, by a computer, the gamma decoded first image from the first color space to a second color space, thereby obtaining a second image;
applying, by a computer, a reverse tone mapping transformation to the second image, thereby obtaining a third image;
applying, by a computer, a reverse saturation correction to the third image, thereby obtaining a fourth image; and
converting, by a computer, the fourth image from the second color space to a third color space, thereby obtaining an inversely mapped lower dynamic range image.

### Claim 10 (depends on 8)

The method of claim 8, further comprising determining, by a computer, corresponding colors between the ungraded image and the inversely mapped lower dynamic range image, and wherein the applying, by a computer, a color transformation is further based on the corresponding colors.

### Claim 11 (depends on 10)

The method of claim 10, wherein the determining corresponding colors comprises applying adaptive sampling and wherein the applying, by a computer, a color transformation is further based on the adaptive sampling.

### Claim 12 (depends on 11)

The method of claim 11, wherein the adaptive sampling is based on having a near-uniform distribution of intensity.

### Claim 13 (depends on 10)

The method of claim 10, wherein the color transformation comprises three one-dimensional functions for three color components.

### Claim 14 (depends on 13)

The method of claim 13, wherein the one-dimensional functions are a polynomial or are based on a look-up table.

### Claim 15 (depends on 10)

The method of claim 10, wherein the color transformation comprises a three by three linear matrix.

### Claim 16 (depends on 10)

The method of claim 10, wherein the color transformation comprises color grading outlier pixels at least one additional time.

### Claim 17

A method to perform color grading, the method comprising:
removing, by a computer, at least one first special handling region from an ungraded image, thereby obtaining at least one first special handling region and a first remaining data;
removing, by a computer, at least one second special handling region from a color graded lower dynamic range image, thereby obtaining a second remaining data;
estimating, by a computer, a global color transformation based on the first and second remaining data, wherein the global color transformation comprises minimizing a difference between the ungraded image and the color graded lower dynamic range image;
processing, by a computer, the at least one first special handling region, thereby obtaining at least one processed special region;
estimating, by a computer, a local color transformation for at least one local area; and
combining, by a computer, the global and local color transformations based on the at least one processed special region.

### Claim 18 (depends on 17)

The method of claim 17, wherein the estimating a local color transformation is applied to areas with large errors.

### Claim 19 (depends on 1)

The method of claim 1, wherein the image is a frame in a video.

### Claim 20 (depends on 5)

The method of claim 5, wherein the image is a frame in a video.

### Claim 21 (depends on 7)

The method of claim 7, wherein the image is a frame in a video.

### Claim 22 (depends on 17)

The method of claim 17, wherein the image is a frame in a video.
