# US 11,445,219 B2 · System for handling multiple HDR video formats > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 11,445,219 B2 - Document ID: US11445219B2 - Status: Granted - Kind: B2 - Application number: 16/968,625 - Filed: 2019-02-05 - Published: 2021-02-18 - Granted: 2022-09-13 - Earliest claimed: 2018-02-13 - Assignees: Koninklijke Philips N.V. - Applicants: Koninklijke Philips N.V. - Inventors: Johan Cornelis Talstra; Nicoll Burleigh Shepherd; Leon Maria Van De Kerkhof - Web page: https://patentgrep.com/patent/US11445219B2 ## CPC - H04N 19/70: characterised by syntax aspects related to video coding, e.g. related to compression standards - G09G 5/10: Intensity circuits - H04N 19/124: Quantisation - H04N 19/172: the region being a picture, frame or field - H04N 19/46: Embedding additional information in the video signal during the compression process (H04N19/517, H04N19/68, H04N19/70 take precedence) - G09G 5/006: {Details of the interface to the display terminal (specific for a display terminal using a CRT G09G1/167; using a flat panel G09G3/2096; circuits for interfacing with colour displays G09G5/04)} - G09G 2320/0276: for the purpose of adaptation to the characteristics of a display device, i.e. gamma correction - G09G 2320/0613: The adjustment depending on the type of the information to be displayed - G09G 2320/0673: for control of gamma adjustment, e.g. selecting another gamma curve - G09G 2320/0686: with two or more screen areas displaying information with different brightness or colours - G09G 2340/02: Handling of images in compressed format, e.g. JPEG, MPEG - G09G 2340/06: Colour space transformation - G09G 2370/04: Exchange of auxiliary data, i.e. other than image data, between monitor and graphics controller - H04N 19/177: the unit being a group of pictures [GOP] - H04N 19/179: the unit being a scene or a shot - H04N 19/186: the unit being a colour or a chrominance component - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION - G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00) ## Abstract Because there are currently probably more than necessary different HDR video coding methods appearing, it is expected that practical communicated HDR videos may in several future scenarios consist of a complicated mix of differently encoded HDR video segments, which may be difficult to decode unless one has our presently presented video decoder (341) arranged to decode a high dynamic range video consisting of temporally successive images, in which the video is composed of successive time segments (S1, S2) consisting of a number of temporally successive images (I1, I2) which have pixel colors, which pixel colors in different time segments are defined by having lumas corresponding to pixel luminances according to different electro-optical transfer functions (EOTF), wherein the images in some of the segments are defined according to dynamically changeable electro-optical transfer functions which are transmitted as a separate function for each temporally successive image, and wherein the images in other segments have lumas defined by a fixed electro-optical transfer function, of which the information is co-communicated in data packages (DRAM) which are transmitted less frequently than the image repetition rate, and wherein at least one of said data packages (DRAM) characterizing the electro-optical transfer function of the image pixel lumas after a moment of change (t1) between a first and a second segment is transmitted prior to the moment of change (t1); and similarly a corresponding encoder which composes the segmented video stream assuring that at least one correct package (DRAM) describing the EOTF according to which the lumas of a later video segment is coded is received by receivers before the change to a different HDR encoding method segment. ## Claims ### Claim 1 A video decoder comprising: a memory circuit; and a processor circuit, wherein the processor circuit is arranged to decode a high dynamic range video, wherein the high dynamic range video comprises a plurality of segments, wherein the plurality of segments comprises a first segment and a second segment, wherein each of the plurality of segments comprises a plurality of images, wherein each of the plurality of images comprises a plurality of pixels, wherein each of the plurality of pixels comprise pixel colors, wherein the pixel colors are defined by lumas, wherein the lumas correspond to pixel luminances according to an electro-optical transfer function, wherein the pixel luminances in the first segment are defined according to a dynamically changeable electro-optical transfer function, wherein the dynamically changeable electro-optical transfer function has a variable function shape, wherein the pixel luminances in the second segment are defined according to a fixed electro-optical transfer function, wherein the images are received at an image repetition rate, wherein the processor circuit is arranged to receive a dynamically changeable electro-optical function for each image of the first segment, wherein the processor circuit is arranged to receive at least one data package, wherein the at least one data package comprises the fixed electro-optical transfer function, wherein the at least one data package is provided less frequently than the image repetition rate, wherein the receiving of the at least one data packages is at a receive time, wherein the receive time is before a moment of change, wherein the moment of change is the moment between receiving the last image of the first segment and the first image of the second segment; wherein the processor circuit is arranged to store the at least one data package in the memory circuit; wherein the processor circuit is arranged to detect the moment of change; and wherein the processor circuit is arranged to apply the stored fixed electro-optical transfer function to the images of the second segment. ### Claim 2 (depends on 1) The video decoder as claimed in claim 1, further comprising a change detector circuit, wherein the change detector circuit is arranged to detect a change of segment by the presence or absence of a per image dynamically changeable electro-optical transfer function. ### Claim 3 (depends on 1) The video decoder as claimed in claim 1, further comprising a change detector, wherein the change detector circuit is arranged to detect the presence of a change of a codec indication packet in metadata, wherein the codec indication is received synchronously with the first image of one of the plurality of the segments, wherein the first image has a different method of a HDR video encoding than an image received prior to the first image. ### Claim 4 (depends on 1) The video decoder as claimed in claim 1, wherein the calculation of the pixel luminances corresponding to the lumas received in the consecutive incoming images of the second segment, wherein the calculation uses an electro-optical transfer function defined by the information in a last received data package. ### Claim 5 (depends on 1) The video decoder as claimed in claim 1, further comprising an input circuit, wherein the input circuit is arranged to receive video communicated on a HDMI or a DisplayPort cable. ### Claim 6 (depends on 1) The video encoder as claimed in claim 1, wherein the calculation of the pixel luminances corresponding to the lumas received in the consecutive incoming images of the second segment, wherein the calculation uses an electro-optical transfer function defined by the information in a last received data package. ### Claim 7 A video encoder comprising: a memory circuit; and a processor circuit, wherein the processor circuit arranged to encode a high dynamic range video, wherein the high dynamic range video comprises a plurality of segments, wherein the plurality of segments comprises a first segment and a second segment, wherein each of the plurality of segments comprises a plurality of images, wherein each of the plurality of images comprises a plurality of pixels, wherein each of the plurality of pixels comprise pixel colors, wherein the pixel colors pixel colors are defined by lumas, wherein the lumas correspond to pixel luminances according to an electro-optical transfer function, wherein the pixel luminances in the first segment are defined according to a dynamically changeable electro-optical transfer function, wherein the dynamically changeable electro-optical transfer function has a variable function shape, wherein the pixel luminances in the second segment are defined according to a fixed electro-optical transfer function, wherein the images are received at an image repetition rate, wherein the processor circuit is arranged to provide a dynamically changeable electro-optical function for each image of the first segment, wherein the processor circuit is arranged to provide at least one data package, wherein the at least one data package comprises the fixed electro-optical transfer function, wherein the at least one data package is transmitted less frequently than the image repetition rate, wherein the transmitting of the at least one data packages is at a transmit time wherein the transmit time is before a moment of change, wherein the moment of change is the moment between transmitting the last image of the first segment and the first image of the second segment; wherein the processor circuit is arranged to store the at least one data package in the memory circuit; wherein the processor circuit is arranged to detect the moment of change; and wherein the processor circuit is arranged to transmit the stored fixed electro-optical transfer function to the images of the second segment. ### Claim 8 (depends on 7) The video encoder as claimed in claim 7, further comprising a change detector circuit, wherein the change detector circuit is arranged to detect a change of segment by the presence or absence of a per image dynamically changeable electro-optical transfer function. ### Claim 9 (depends on 7) The video encoder as claimed in claim 7, wherein the change detector is arranged to detect the presence of a change of a codec indication packet in metadata, wherein the codec indication is transmitted synchronously with the first image of one of the plurality of segments, wherein the first image has a different method of a HDR video encoding than an image received prior to the first image. ### Claim 10 (depends on 7) The video encoder as claimed in claim 7, further comprising an output circuit, wherein the output circuit is arranged to receive video communicated on a HDMI or a DisplayPort cable. ### Claim 11 A method of video decoding comprising: receiving a high dynamic range video, wherein the high dynamic range video comprises a plurality of segments, wherein the plurality of segments comprises a first segment and a second segment, wherein each of the plurality of segments comprises a plurality of images, wherein each of the plurality of images comprises a plurality of pixels, wherein each of the plurality of pixels comprise pixel colors, wherein the pixel colors are defined by lumas, wherein the lumas correspond to pixel luminances according to an electro-optical transfer function, wherein the pixel luminances in the first segment are defined according to a dynamically changeable electro-optical transfer function, wherein the dynamically changeable electro-optical transfer function has a variable function shape, wherein the pixel luminances in the second segment are defined according to a fixed electro-optical transfer function, wherein the images are received at an image repetition rate; receiving a dynamically changeable electro-optical function for each image of the first segment; receiving at least one data package, wherein the at least one data package comprises the fixed electro-optical transfer function, wherein the at least one data package is provided less frequently than the image repetition rate, wherein the receiving of the at least one data packages is at a receive time, wherein the receive time is before a moment of change, wherein the moment of change is the moment between receiving the last image of the first segment and the first image of the second segment; storing the at least one data package in a memory; detecting the moment of change; and applying the stored fixed electro-optical transfer function to the images of the second segment. ### Claim 12 (depends on 11) The method as claimed in claim 11, further comprising detecting a change of segment by the presence or absence of a per image dynamically changeable electro-optical transfer function. ### Claim 13 (depends on 11) The method as claimed in claim 11, further comprising, detecting the presence of a change of a codec indication packet in metadata, wherein the codec indication is received synchronously with a first image of one of the plurality of segments, wherein the first image has a different method of a HDR video encoding than an image received prior to the first image. ### Claim 14 (depends on 11) The method as claimed in claim 11, wherein the calculation of the pixel luminances corresponding to the lumas received in the consecutive incoming images of the second segment, wherein the calculation uses an electro-optical transfer function defined by the information in a last received data package. ### Claim 15 (depends on 11) The method as claimed in claim 11, wherein the video communicated on a HDMI or a DisplayPort cable. ### Claim 16 A method of video encoding comprising: providing a high dynamic range video, wherein the high dynamic range video comprises a plurality of segments, wherein the plurality of segments comprise a first segment and a second segment, wherein each of the plurality of segments comprise a plurality of images, wherein each of the plurality of images comprise a plurality of pixels, wherein each of the plurality of pixels comprise pixel colors, wherein the pixel colors are defined by lumas, wherein the lumas correspond to pixel luminances according to an electro-optical transfer function, wherein the pixel luminances in the first segment are defined according to a dynamically changeable electro-optical transfer function, wherein the dynamically changeable electro-optical transfer function has a variable function shape, wherein the pixel luminances in the second segment are defined according to a fixed electro-optical transfer function, wherein the images are provided at an image repetition rate; providing a dynamically changeable electro-optical function for each image of the first segment; and providing at least one data package, wherein the at least one data package comprises the fixed electro-optical transfer function, wherein the at least one data package is provided less frequently than the image repetition rate, wherein the providing of the at least one at least one of the at least one data package is at a transmit time, wherein the transmit time is before a moment of change, wherein the moment of change is the moment between providing the last image of the first segment and the first image of the second segment. ### Claim 17 (depends on 16) The method as claimed in claim 16, further comprising detecting a change of segment by the presence or absence of a per image dynamically changeable electro-optical transfer function. ### Claim 18 (depends on 16) The method as claimed in claim 16, further comprising, detecting the presence of a change of a codec indication packet in metadata, wherein the codec indication is received synchronously with a first image of one of the plurality of segments, wherein the first image has a different method of a HDR video encoding than an image received prior to the first image. ### Claim 19 (depends on 16) The method as claimed in claim 16, wherein the calculation of the pixel luminances corresponding to the lumas received in the consecutive incoming images of the second segment, wherein the calculation uses an electro-optical transfer function defined by the information in a last received data package.