# US 12,217,404 B2 · Image processing method and apparatus and terminal device

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 12,217,404 B2
- Document ID: US12217404B2
- Status: Granted
- Kind: B2
- Application number: 17/581,193
- Filed: 2022-01-21
- Published: 2022-05-12
- Granted: 2025-02-04
- Earliest claimed: 2017-04-21
- Assignees: Huawei Technologies Co., Ltd.
- Applicants: Huawei Technologies Co., Ltd.
- Inventors: Le Yuan; Zheng Wang; Xiumei Yan
- Web page: https://patentgrep.com/patent/US12217404B2

## CPC

- G06T 5/92: based on global image properties
- H04N 21/431: Generation of visual interfaces {for content selection or interaction}; Content or additional data rendering
- G06T 11/10: Texturing; Colouring; Generation of textures or colours (retouching, inpainting or scratch removal G06T5/77)
- H04N 21/4402: involving reformatting operations of video signals for household redistribution, storage or real-time display {(details of conversion of video standards at pixel level H04N7/01; video transcoding H04N19/40; adapting incoming signals to the display format of the display terminal G09G5/005; media handling at the source in data packet switching networks H04L65/764)}
- G06T 2207/10016: Video; Image sequence
- G06T 2207/20208: High dynamic range [HDR] image processing
- G09G 5/005: {Adapting incoming signals to the display format of the display terminal}
- G09G 5/006: {Details of the interface to the display terminal (specific for a display terminal using a CRT G09G1/167; using a flat panel G09G3/2096; circuits for interfacing with colour displays G09G5/04)}
- G09G 2360/02: Graphics controller able to handle multiple formats, e.g. input or output formats
- G09G 2370/06: Consumer Electronics Control, i.e. control of another device by a display or vice versa
- G09G 2370/12: Use of DVI or HDMI protocol in interfaces along the display data pipeline
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00)

## Abstract

An image processing method includes determining a format of first image data; determining a first interface mode that is currently used, where the first interface mode is determined when the processing device establishes physical connections with a display device, and the format of the first image data format is not supported by the first interface mode; and processing the first image data based on the first interface mode to generate second image data, where a format of the second image data is supported by the first interface mode. Image data will be processed when an image format of the image data is not supported by the first interface mode.

## Claims

### Claim 1

A method, comprising:
receiving video data having a first format, wherein the first format is an image format corresponding to standard dynamic range (SDR) or high dynamic range (HDR), wherein the first format is inconsistent with a second format supported by a first interface mode being used between a processing device and a display device of a display system, and wherein the first interface mode is a high definition multimedia interface (HDMI) operation mode; and
outputting converted video data after converting the first format of the video data into the second format based on the first interface mode.

### Claim 2 (depends on 1)

The method of claim 1, further comprising sending the converted video data to the display device, wherein the processing device is a playback device.

### Claim 3 (depends on 1)

The method of claim 1, further comprising:
converting the video data from a first color space to a second color space to obtain second converted video data corresponding to the second color space;
performing dynamic range mapping on a luminance component of the second converted video data to obtain mapped data;
restoring the mapped data into a linear optical space to obtain restored data;
performing color gamut mapping on the restored data to obtain gamut mapped data; and
performing non-uniform encoding on the gamut mapped data to generate the converted video data.

### Claim 4

The method of 1, wherein:
the first format is standard dynamic range (SDR) and the second format is high dynamic range (HDR);
the first format is HDR and the second format is SDR;
the first format is HDR of a hybrid log-gamma (HLG) standard and the second format is HDR of a perceptual quantizer (PQ) standard; or
the first format is HDR of a PQ standard and the second format is HDR of an HLG standard.

### Claim 5 (depends on 1)

The method of claim 1, wherein the video data comprises a video image or a graphic image.

### Claim 6

An apparatus, which is a processing device or included in the processing device, comprising:
a memory configured to store one or more programs; and
a processor coupled to the memory and configured to execute the one or more programs to cause the apparatus to be configured to:
receive video data having a first format, wherein the first format is an image format corresponding to standard dynamic range (SDR) or high dynamic range (HDR), wherein the first format is inconsistent with a second format supported by a first interface mode being used between the processing device and a display device of a display system, and wherein the first interface mode is a high definition multimedia interface (HDMI) operation mode; and
output converted video data after converting the first format of the video data into the second format based on the first interface mode.

### Claim 7 (depends on 6)

The apparatus of claim 6, further comprising an output interface configured to send the converted video data to the display device, and wherein the apparatus is a playback device.

### Claim 8 (depends on 6)

The apparatus of claim 6, wherein when executed by the processor, the one or more programs further cause the apparatus to be configured to:
convert the video data from a first color space to a second color space to obtain second converted video data corresponding to the second color space;
perform dynamic range mapping on a luminance component of the second converted video data to obtain mapped data;
restore the mapped data into a linear optical space to obtain restored data;
perform color gamut mapping on the restored data to obtain gamut mapped data; and
perform non-uniform encoding on the gamut mapped data to generate the converted video data.

### Claim 9 (depends on 6)

The apparatus of claim 6, wherein:
the first format is standard dynamic range (SDR), and the second format is high dynamic range (HDR);
the first format is HDR, and the second format is SDR;
the first format is HDR of a hybrid log-gamma (HLG) standard, and the second format is HDR of a perceptual quantizer (PQ) standard; or
the first format is HDR of a PQ standard, and the second format is HDR of an HLG standard.

### Claim 10 (depends on 6)

The apparatus of claim 6, wherein the video data comprises a video image or a graphic image.

### Claim 11

An apparatus, which is a processing device or included in the processing device, comprising:
a memory configured to store one or more programs; and
a processor coupled to the memory and configured to execute the one or more programs to cause the apparatus to:
receive first video data having a first format, wherein the first format is an image format corresponding to standard dynamic range (SDR), wherein a second format supported by a first interface mode being used between the processing device and a display device of a display system is an image format corresponding to high dynamic range (HDR), and wherein the first interface mode is a high definition multimedia interface (HDMI) operation mode;
output first converted video data after converting the first format of the first video data into the second format based on the first interface mode;
receive second video data having the second format, wherein the first format is now supported by a second interface mode being used between the processing device and the display device; and
output second converted video data after converting the second format of the second video data into the first format.

### Claim 12 (depends on 11)

The apparatus of claim 11, wherein the processor configured to execute the one or more programs to further cause the apparatus to send the first converted video data and the second converted video data to the display device.

### Claim 13 (depends on 11)

The apparatus of claim 11, wherein the processor configured to execute the one or more programs to further cause the apparatus to:
convert the first video data from a first color space to a second color space to obtain third converted video corresponding to the second color space;
perform dynamic range mapping on a luminance component of the third converted video data to obtain mapped data;
restore the mapped data into a linear optical space to obtain restored data;
perform color gamut mapping on the restored data to obtain gamut mapped data; and
perform non-uniform encoding on the gamut mapped data to generate the first converted video data.

### Claim 14 (depends on 11)

The apparatus of claim 11, wherein either:
the first format is standard dynamic range (SDR) and the second format is high dynamic range (HDR); or
the first format is HDR and the second format is SDR.

### Claim 15 (depends on 11)

The apparatus of claim 11, wherein the first video data comprises a video image or a graphic image.

### Claim 16 (depends on 11)

The apparatus of claim 11, wherein the first format is HDR of a hybrid log-gamma (HLG) standard, and wherein the second format is HDR of a perceptual quantizer (PQ) standard.

### Claim 17 (depends on 11)

The apparatus of claim 11, wherein the first format is HDR of a perceptual quantizer (PQ) standard, and wherein the second format is HDR of a hybrid log-gamma (HLG) standard.

### Claim 18 (depends on 3)

The method of claim 3, wherein the second color space is red-green-blue (RGB) color space.

### Claim 19 (depends on 3)

The method of claim 3, wherein the second color space is a luminance-chroma color space.

### Claim 20 (depends on 1)

The method of claim 1, wherein the first interface mode is negotiated when the processing device establishes a physical connection with the display device.
