# US 10,873,763 B2 · Video compression techniques for high dynamic range data

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 10,873,763 B2
- Document ID: US10873763B2
- Status: Granted
- Kind: B2
- Application number: 15/613,081
- Filed: 2017-06-02
- Published: 2018-12-06
- Granted: 2020-12-22
- Earliest claimed: 2017-06-02
- Assignees: Apple Inc.
- Applicants: Apple Inc.
- Inventors: Mei Guo; Jun Xin; Yeping Su; Chris Chung; Dazhong Zhang; Xiaosong Zhou; Hsi-Jung Wu
- Web page: https://patentgrep.com/patent/US10873763B2

## CPC

- H04N 19/619: {the transform being operated outside the prediction loop}
- H04N 19/119: Adaptive subdivision aspects, e.g. subdivision of a picture into rectangular or non-rectangular coding blocks
- H04N 19/124: Quantisation
- H04N 19/176: the region being a block, e.g. a macroblock
- H04N 19/18: the unit being a set of transform coefficients
- H04N 19/182: the unit being a pixel
- H04N 19/196: being specially adapted for the computation of encoding parameters, e.g. by averaging previously computed encoding parameters (processing of motion vectors H04N19/513)
- H04N 19/52: by predictive encoding
- H04N 19/85: using pre-processing or post-processing specially adapted for video compression
- H04N 19/91: Entropy coding, e.g. variable length coding [VLC] or arithmetic coding
- H04N 19/122: Selection of transform size, e.g. 8x8 or 2x4x8 DCT; Selection of sub-band transforms of varying structure or type
- H04N 19/82: involving filtering within a prediction loop
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

Techniques are disclosed for coding high dynamic range (HDR) data. According to such techniques, HDR data may be converted to a domain of uniform luminance data. The uniform domain data may be coded by motion compensated predictive coding. The HDR data also may be coded by motion compensated predictive coding, using a coding parameter that is derived from a counterpart coding parameter of the coding of the uniform domain data. In another technique, HDR data may be coded using coding parameters that are derived from HDR domain processing but distortion measurements may be performed in a uniform domain.

## Claims

### Claim 1

A video coding system comprising:
a source of high dynamic range (HDR) data;
a converter having an input for the source of HDR data and an output for data having perceptually uniform luminance quantization;
a first predictive coder, having an input coupled to an output of the converter;
a coding-parameters converter, having an input coupled to the first predictive coder for data representing coding parameters output by the first predictive coder and an output for coding parameters transformed to an HDR space,
a second predictive coder, having an input coupled to the source of HDR data, and
a transmitter, coupled to an output of the second predictive coder, for outputting coded video data representing the HDR data,
wherein the data representing coding parameters output by the first predictive coder and transformed to an HDR space by the coding-parameters converter are input to the second predictive coder.

### Claim 2 (depends on 1)

The system of claim 1, wherein the coding parameter data input to the second predictive coder represents a prediction mode selected by the first predictive coder and transformed by the coding-parameters converter.

### Claim 3 (depends on 1)

The system of claim 1, wherein the coding parameter data input to the second predictive coder represents a quantization parameter selected by the first predictive coder and transformed by the coding-parameters converter.

### Claim 4 (depends on 1)

The system of claim 1, wherein the coding parameter data input to the second predictive coder represents in loop filtering parameters selected by the first predictive coder and transformed by the coding-parameters converter.

### Claim 5 (depends on 1)

The system of claim 1, wherein the coding parameter data input to the second predictive coder represents a coding unit size determination selected by the first predictive coder and transformed by the coding-parameters converter.

### Claim 6 (depends on 1)

The system of claim 1, wherein the coding parameter data input to the second predictive coder represents a coding unit complexity determination made by the first predictive coder and transformed by the coding-parameters converter.

### Claim 7 (depends on 1)

The system of claim 1, wherein the coding parameter data input to the second predictive coder represents a transform unit size determination selected by the first predictive coder and transformed by the coding-parameters converter.

### Claim 8 (depends on 1)

The system of claim 1, wherein the coding parameter data input to the second predictive coder represents pixel interpolation data derived by the first predictive coder and transformed by the coding-parameters converter.

### Claim 9 (depends on 1)

The system of claim 1, wherein the first and second predictive coders operate according to HEVC.

### Claim 10

A method of coding high dynamic range (HDR) data, comprising;
converting the HDR data to a domain of perceptually uniform luminance data;
coding the converted data by motion compensated predictive coding; and
coding the HDR data by motion compensated predictive coding, wherein a coding parameter of the HDR data coding is based on a parameter converted from a counterpart coding parameter of the coding of the converted data to an HDR space, and
outputting the coded video data representing the HDR data.

### Claim 11 (depends on 10)

The method of claim 10, wherein the counterpart coding parameter is converted from a prediction mode selected during coding the converted data.

### Claim 12 (depends on 10)

The method of claim 10, wherein the counterpart coding parameter is converted from a quantization parameter selected during coding the converted data.

### Claim 13 (depends on 10)

The method of claim 10, wherein the counterpart coding parameter is converted from an in loop filtering parameter selected during coding the converted data.

### Claim 14 (depends on 10)

The method of claim 10, wherein the counterpart coding parameter is converted from a coding unit size determination selected during coding the converted data.

### Claim 15 (depends on 10)

The method of claim 10, wherein the counterpart coding parameter is converted from a coding unit complexity determination made during coding the converted data.

### Claim 16 (depends on 10)

The method of claim 10, wherein the counterpart coding parameter is converted from a transform unit size determination selected during coding the converted data.

### Claim 17 (depends on 10)

The method of claim 10, wherein the counterpart coding parameter is converted from pixel interpolation data.

### Claim 18

A non-transitory computer readable medium storing program instructions that, when executed by a processing device, cause the device to:
convert the HDR data to a domain of perceptually uniform luminance data;
code the converted data by motion compensated predictive coding; and
code the HDR data by motion compensated predictive coding, wherein a coding parameter of the HDR data coding is based on a parameter converted from a counterpart coding parameter of the coding of the converted data to an HDR space, and
output the coded video data representing the HDR data.

### Claim 19

A video coding system comprising:
a source of high dynamic range (HDR) data;
a predictive coder, having an input coupled to the source of HDR data and comprising:
a pixel block coder having an input for pixel blocks of the HDR data;
a pixel block decoder having an input for coded pixel blocks of the HDR data output by the pixel block coder;
an in loop filter, having an input for frames of decoded pixel blocks output by the pixel block decoder;
a reference picture store for storage of frames output by the in loop filter;
a predictor, having an input coupled to the reference picture store and an output coupled to the pixel block coder; and
a distortion estimator; and
a transmitter, coupled to an output of the second predictive coder, for outputting coded video data representing the HDR data;
wherein, the pixel block coder, pixel block decoder, in loop filter, reference picture store and predictor operate in a domain of the HDR data, and the distortion estimator operates in a domain of uniform luminance data.