# US 12,439,012 B2 · Image processing method and apparatus, electronic device and readable storage medium

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 12,439,012 B2
- Document ID: US12439012B2
- Status: Granted
- Kind: B2
- Application number: 18/759,733
- Filed: 2024-06-28
- Published: 2024-10-24
- Granted: 2025-10-07
- Earliest claimed: 2021-12-30
- Assignees: Beijing Zitiao Network Technology Co., Ltd.
- Applicants: Beijing Zitiao Network Technology Co., Ltd.
- Inventors: Siyu He
- Web page: https://patentgrep.com/patent/US12439012B2

## CPC

- H04N 9/67: for matrixing (camera processing pipelines for matrixing of colour signals H04N23/85)
- G06F 16/44: Browsing; Visualisation therefor
- G11B 27/031: Electronic editing of digitised analogue information signals, e.g. audio or video signals
- H04N 21/440254: {by altering signal-to-noise parameters, e.g. requantization}
- H04N 21/4402: involving reformatting operations of video signals for household redistribution, storage or real-time display {(details of conversion of video standards at pixel level H04N7/01; video transcoding H04N19/40; adapting incoming signals to the display format of the display terminal G09G5/005; media handling at the source in data packet switching networks H04L65/764)}
- H04N 21/854: Content authoring
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G11B: INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER (recording measured values in a way that does not require playback through a transducer G01D9/00; recording or playback apparatus using mechanically marked tape, e.g. punched paper tape, or using unit records, e.g. punched or magnetically marked cards G06K; transferring data from one type of record carrier to another G06K1/18; circuits for coupling output of reproducer to radio receiver H04B1/20; gramophone pick-ups or like acoustic electromechanical transducers or circuits therefor H04R)

## Abstract

The present disclosure relates to an image processing method and apparatus, an electronic device and a readable storage medium. The method comprises: traversing a plurality of multimedia materials, and according to a target color display standard, determining a multimedia material of a non-target color display standard included in the plurality of multimedia materials; converting the multimedia material of the non-target color display standard into a multimedia material of the target color display standard; and performing image rendering on the plurality of multimedia materials according to the target color display standard, so as to display the plurality of multimedia materials according to the image rendering result or export the plurality of multimedia materials as a video file in a specific format according to the image rendering result.

## Claims

### Claim 1

A method for editing a plurality of multimedia materials with different color display standards in a mixed manner, comprising:
determining, according to a target color display standard, a multimedia material of a non-target color display standard that is included in the plurality of multimedia materials;
transferring the multimedia material of the non-target color display standard into a multimedia material of the target color display standard; and
performing image rendering on the plurality of multimedia materials according to the target color display standard, so as to display the plurality of multimedia materials on a display screen of an electronic device according to an image rendering result or export the plurality of multimedia materials into a video file in a specific format according to the image rendering result,
wherein the transferring the multimedia material of the non-target color display standard into the multimedia material of the target color display standard comprises:
in response to that the multimedia material of the non-target color display standard is generated according to a video frame image of another multimedia material of the non-target color display standard among the plurality of multimedia materials at a freeze frame position, transferring the multimedia material of the non-target color display standard into the multimedia material of the target color display standard.

### Claim 2 (depends on 1)

The method according to claim 1, wherein before the determining, according to a target color display standard, a multimedia material of a non-target color display standard that is included in the plurality of multimedia materials, the method further comprises:
determining the target color display standard.

### Claim 3 (depends on 2)

The method according to claim 2, wherein the determining the target color display standard comprises:
determining the target color display standard according to a color display standard with a widest color space among color display standards respectively corresponding to the plurality of multimedia materials.

### Claim 4 (depends on 2)

The method according to claim 2, wherein the determining the target color display standard comprises:
determining the target color display standard according to a pre-specified color display standard.

### Claim 5 (depends on 1)

The method according to claim 1, wherein the transferring the multimedia material of the non-target color display standard into the multimedia material of the target color display standard further comprises:
in response to that the multimedia material of the non-target color display standard is generated according to a video frame image of a multimedia material of the target color display standard among the plurality of multimedia materials at the freeze frame position, not transferring the multimedia material of the non-target color display standard.

### Claim 6 (depends on 1)

The method according to claim 1, wherein the transferring the multimedia material of the non-target color display standard into the multimedia material of the target color display standard further comprises:
decoding the multimedia material of the non-target color display standard to obtain a first set of color values of individual pixel points of the multimedia material under the non-target color display standard;
transferring, based on an electro-optical transfer function corresponding to the non-target color display standard, individual color values in the first set of color values into optical signals under the non-target color display standard, so as to obtain a first set of optical signals;
transferring, based on an optical-optical transfer function, individual optical signals in the first set of optical signals to obtain a second set of optical signals under the target color display standard; and
transferring, based on an optical-electric transfer function corresponding to the target color display standard, the individual optical signals in the second set of optical signals into color values, so as to obtain a second set of color values of the multimedia material under the target color display standard.

### Claim 7 (depends on 6)

The method according to claim 6, wherein in response to the transferring, based on an optical-optical transfer function, the individual optical signals in the first set of optical signals to obtain a second set of optical signals under the target color display standard, the method further comprises: performing gamut mapping to align color values under different color display standards.

### Claim 8 (depends on 1)

The method according to claim 1, wherein the target color display standard is a perceptually quantized (PQ) color display standard, and the non-target color display standard comprises a standard dynamic range (SDR) color display standard and/or a hybrid log gamma curve (HLG) color display standard; or,
the target color display standard is the SDR color display standard, and the non-target color display standard comprises the HLG, color display standard and/or the PQ color display standard; or,
the target color display standard is the HLG color display standard, and the non-target color display standard comprises the SDR color display standard and/or the PQ color display standard.

### Claim 9 (depends on 1)

The method according to claim 1, wherein before the performing image rendering on the plurality of multimedia materials according to the target color display standard, the method further comprises:
processing the plurality of multimedia materials according to editing operation modes respectively corresponding to one or more editing types.

### Claim 10

An electronic device, comprising a memory and a processor;
the memory being configured to store computer program instructions;
the processor being configured to execute the computer program instructions, so that the electronic device implements the following operations for editing a plurality of multimedia materials with different color display standards in a mixed manner;
determining, according to a target color display standard, a multimedia material of a non-target color display standard that is included in the plurality of multimedia materials;
transferring the multimedia material of the non-target color display standard into a multimedia material of the target color display standard; and
performing image rendering on the plurality of multimedia materials according to the target color display standard, so as to display the plurality of multimedia materials on a display screen of an electronic device according to an image rendering result or export the plurality of multimedia materials into a video file in a specific format according to the image rendering result,
wherein the transferring the multimedia material of the non-target color display standard into the multimedia material of the target color display standard comprises:
in response to that the multimedia material of the non-target color display standard is generated according to a video frame image of another multimedia material of the non-target color display standard among the plurality of multimedia materials at a freeze frame position, transferring the multimedia material of the non-target color display standard into the multimedia material of the target color display standard.

### Claim 11 (depends on 10)

The electronic device according to claim 10, wherein before the determining, according to a target color display standard, a multimedia material of a non-target color display standard that is included in the plurality of multimedia materials, the processor is further configured to execute the computer program instructions, so that the electronic device implements the following operation:
determining the target color display standard.

### Claim 12 (depends on 11)

The electronic device according to claim 11, wherein the determining the target color display standard comprises:
determining the target color display standard according to a color display standard with a widest color space among color display standards respectively corresponding to the plurality of multimedia materials.

### Claim 13 (depends on 11)

The electronic device according to claim 11, wherein the determining the target color display standard comprises:
determining the target color display standard according to a pre-specified color display standard.

### Claim 14 (depends on 10)

The electronic device according to claim 10, wherein the transferring the multimedia material of the non-target color display standard into the multimedia material of the target color display standard further comprises:
in response to that the multimedia material of the non-target color display standard is generated according to a video frame image of a multimedia material of the target color display standard among the plurality of multimedia materials at the freeze frame position, not transferring the multimedia material of the non-target color display standard.

### Claim 15 (depends on 10)

The electronic device according to claim 10, wherein the transferring the multimedia material of the non-target color display standard into the multimedia material of the target color display standard further comprises:
decoding the multimedia material of the non-target color display standard to obtain a first set of color values of individual pixel points of the multimedia material under the non-target color display standard;
transferring, based on an electro-optical transfer function corresponding to the non-target color display standard, individual color values in the first set of color values into optical signals under the non-target color display standard, so as to obtain a first set of optical signals;
transferring, based on an optical-optical transfer function, individual optical signals in the first set of optical signals to obtain a second set of optical signals under the target color display standard; and
transferring, based on an optical-electric transfer function corresponding to the target color display standard, the individual optical signals in the second set of optical signals into color values, so as to obtain a second set of color values of the multimedia material under the target color display standard.

### Claim 16

A non-transitory computer readable storage medium, comprising computer program instructions;
the computer program instructions, when executed by at least one processor of an electronic device, causing the electronic device to implement the following operations for editing a plurality of multimedia materials with different color display standards in a mixed manner:
determining, according to a target color display standard, a multimedia material of a non-target color display standard that is included in the plurality of multimedia materials;
transferring the multimedia material of the non-target color display standard into a multimedia material of the target color display standard; and
performing image rendering on the plurality of multimedia materials according to the target color display standard, so as to display the plurality of multimedia materials on a display screen of an electronic device according to an image rendering result or export the plurality of multimedia materials into a video file in a specific format according to the image rendering result,
wherein the transferring the multimedia material of the non-target color display standard into the multimedia material of the target color display standard comprises:
in response to that the multimedia material of the non-target color display standard is generated according to a video frame image of another multimedia material of the non-target color display standard among the plurality of multimedia materials at a freeze frame position, transferring the multimedia material of the non-target color display standard into the multimedia material of the target color display standard.

### Claim 17 (depends on 16)

The non-transitory computer readable storage medium according to claim 16, wherein before the determining, according to a target color display standard, a multimedia material of a non-target color display standard that is included in the plurality of multimedia materials, the computer program instructions, when executed by at least one processor of the electronic device, further causes the electronic device to implement the following operation:
determining the target color display standard.

### Claim 18 (depends on 17)

The non-transitory computer readable storage medium according to claim 17, wherein the determining the target color display standard comprises:
determining the target color display standard according to a color display standard with a widest color space among color display standards respectively corresponding to the plurality of multimedia materials.

### Claim 19 (depends on 17)

The non-transitory computer readable storage medium according to claim 17, wherein the determining the target color display standard comprises:
determining the target color display standard according to a pre-specified color display standard.

### Claim 20 (depends on 16)

The non-transitory computer readable storage medium according to claim 16, wherein the transferring the multimedia material of the non-target color display standard into the multimedia material of the target color display standard further comprises:
in response to that the multimedia material of the non-target color display standard is generated according to a video frame image of a multimedia material of the target color display standard among the plurality of multimedia materials at the freeze frame position, not transferring the multimedia material of the non-target color display standard.
