US 10,771,784 B2Granted

System for coding high dynamic range and wide color gamut sequences

AssigneeARRIS Enterprises LLC

InventorsKoohyar Minoo, Zhouye Gu, David M. Baylon, Ajay Luthra

Life of this patent

Estimating the term…

Loading patent…

Abstract

A method of encoding a digital video data applies adaptive pre-processing to data representing high dynamic range (HDR) and/or wide color gamut (WCG) image data prior to encoding and complementary post-processing to the data after decoding in order to allow at least partial reproduction of the HDR and/or WCG data. The example methods apply one or more color space conversions, and a perceptual transfer functions to the data prior to quantization. The example methods apply inverse perceptual transfer functions and inverse color space conversions after decoding to recover the HDR and/or WCG data. The transfer functions are adaptive so that different transfer functions may be applied to video data sets including different groups of frames, frames or processing windows in a single frame. Information on the data set and information on the applied transfer function is passed as metadata from the encoder to the decoder.

Claims6

Dependent claims

A digital video decoding system for decoding a bit stream in a format that does not accommodate a digital video data set including high dynamic range (HDR) and wide color gamut (WCG) video data, to reconstruct an output digital video data set including at least one of HDR and WCG video data, the digital video decoding system comprising:

a decoder for decoding the bit stream to recover a digital video data set from the bit stream;
an intermediate color conversion process configured to:
extract intermediate color conversion metadata from the bit stream, the intermediate color conversion metadata identifying an input color space of the digital video data set extracted from the bit stream and an intermediate color space to which the digital video data set is to be converted;
convert the inverse transformed portion of the digital video data set from the input color space to the intermediate color space to produce intermediate color converted digital video data;
and
an inverse compression transfer function process configured to extract compression metadata from the bit stream and to apply an inverse compression transfer function to the intermediate color converted video data to generate the digital video data set to be applied to the output color conversion process;
predictively decode the bit stream using one or more reference frames;
apply a color conversion process to the output digital video data set, the color conversion process being an inverse of the output color conversion process to generate a color converted video data set;
generate a perceptual transfer function process from the metadata identifying the inverse perceptual transfer function to be applied to the received video data;
apply the perceptual transfer function to the color converted video data set to generate a transformed video data set;
generate a perceptual normalization function using the metadata identifying the inverse perceptual normalization function;
apply the perceptual normalization function to the transformed video data set to generate a perceptually normalized video data set;
generate a further reference frame for use in predictively decoding the bit stream from the perceptually normalized video data set.

10 more elements

a decoder for decoding the bit stream to recover a digital video data set from the bit stream;
an intermediate color conversion process configured to:
extract intermediate color conversion metadata from the bit stream, the intermediate color conversion metadata identifying an input color space of the digital video data set extracted from the bit stream and an intermediate color space to which the digital video data set is to be converted;
convert the inverse transformed portion of the digital video data set from the input color space to the intermediate color space to produce intermediate color converted digital video data;
and
an inverse compression transfer function process configured to extract compression metadata from the bit stream and to apply an inverse compression transfer function to the intermediate color converted video data to generate the digital video data set to be applied to the output color conversion process;
receive video data corresponding to a portion of the digital video data set;
retrieve metadata from the bit stream identifying a transfer function to be applied to the received video data;
retrieve metadata from the bit stream identifying an inverse perceptual normalization function, including at least one of a gain factor or an offset, to be applied to the received video data;
generate an inverse perceptual transfer function based on the identified transfer function;
and
apply the generated inverse perceptual transfer function and the inverse perceptual normalization function to the portion of the digital video data set to generate an inverse transformed portion of the digital video data set;
an output color conversion process configured to process the inverse transformed portion of the digital video data set to reconstruct the output digital video data set including at least one of HDR and WCG video data.

10 more elements

Dependencies are inferred from the claim text.

Facts

Application: 16/143,067Filed 26 Sep 2018 · continuation
Priority: 22 Jul 2015
Published: US 2019/0028706 A124 Jan 2019
Granted: 8 Sep 2020
Term ends: Not estimatedThe source records don’t support an estimate.

Classification11 codes

H04N 19/124
Characterised by the element, parameter or selection affected or controlled by the adaptive coding: quantisation
H04N 19/117
Characterised by the element, parameter or selection affected or controlled by the adaptive coding: filters, e.g. for pre-processing or…
H04N 19/136
Characterised by the element, parameter or criterion affecting or controlling the adaptive coding: incoming video signal characteristics or properties
H04N 19/172
The unit being an image region, e.g. an object: the region being a picture, frame or field

Family

Application62/195,342Us provisional application · filed 22 Jul 2015
Application15/217,046Parent of this continuation · filed 22 Jul 2016
US 2019/0028706 A1Pre-grant publication · published 24 Jan 2019
US 10,116,938 B2Parent of this continuation
US 2017/0026646 A1Published application
US 10,771,784 B2This patent

From the US filing history. Foreign family members aren’t listed.

Timeline

Citations

Open elsewhere

Building an agent or pulling many patents? Use the API or MCP server instead of scraping pages. Get an API key