# US 2026/0089339 A1 · Multimedia data processing method and apparatus, computer device, computer-readable storage medium, and computer program product

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2026/0089339 A1
- Document ID: US20260089339A1
- Status: Published application
- Kind: A1
- Application number: 19/407,197
- Filed: 2025-12-03
- Published: 2026-03-26
- Earliest claimed: 2021-10-20
- Assignees: Tencent Technology (Shenzhen) Company Limited
- Applicants: Tencent Technology (Shenzhen) Company Limited
- Inventors: Yingbin WANG
- Web page: https://patentgrep.com/patent/US20260089339A1

## CPC

- H04N 19/176: the region being a block, e.g. a macroblock
- G06V 10/751: {Comparing pixel values or logical combinations thereof, or feature values having positional relevance, e.g. template matching}
- H04N 19/105: Selection of the reference unit for prediction within a chosen coding or prediction mode, e.g. adaptive choice of position and number of pixels used for prediction
- H04N 19/159: Prediction type, e.g. intra-frame, inter-frame or bidirectional frame prediction
- H04N 19/174: the region being a slice, e.g. a line of blocks or a group of blocks
- H04N 19/593: involving spatial prediction techniques
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

Example embodiments provide a multimedia data processing method and apparatus, a computer device, a computer-readable storage medium, and a computer program product. The method includes: obtaining a global reference data block set and a local reference data block set, the global reference data block set and the local reference data block set being associated with a first data block in a multimedia data frame, the global reference data block set including a coded data block having no adjacent relationship with the first data block in the multimedia data frame, and the local reference data block set including a coded data block having an adjacent relationship with the first data block in the multimedia data frame; and determining a reference data block for coding or decoding of the first data block from the global reference data block set and the local reference data block set.

## Claims

### Claim 1

A method for processing multimedia data, the method being executed by at least one processor, the method comprising:
obtaining a global reference data block set and a local reference data block set, wherein the global reference data block set and the local reference data block set are associated with a first data block in a multimedia data frame, wherein the global reference data block set and the local reference data block set are both adjacent to at least one non-reference data block set comprising at least one data block that is not referenceable by the first data block; and
determining a reference data block for coding or decoding of the first data block based on the global reference data block set and the local reference data block set.

### Claim 2 (depends on 1)

The method according to claim 1, wherein the determining the reference data block comprises:
obtaining a coding mode of the first data block; and
determining, based on the coding mode of the first data block being an intra block copy (IBC) mode or an intra string copy (ISC) mode, the reference data block for coding or decoding of the first data block by using the global reference data block set and the local reference data block set.

### Claim 3 (depends on 2)

The method according to claim 2, wherein the determining the reference data block based on the coding mode of the first data block comprises:
obtaining, based on the coding mode of the first data block being an IBC mode or an ISC mode, a pixel difference between one data block in the local reference data block set and the first data block;
based on a target data block having the pixel difference less than a pixel difference threshold in the local reference data block set, selecting the target data block as the reference data block; and
based on the target data block having the pixel difference greater than or equal to the pixel difference threshold in the local reference data block set, determining the reference data block based on the global reference data block set.

### Claim 4 (depends on 2)

The method according to claim 2, wherein the determining the reference data block based on the coding mode of the first data block comprises:
based on the coding mode of the first data block being an IBC mode or an ISC mode, obtaining a target coded data block that is spatially adjacent to the first data block; and
obtaining the reference data block for coding or decoding of the first data block by searching regions corresponding to the global reference data block set and the local reference data block set is based on moving parameters based on a reference data block of the target coded data block belonging to the global reference data block set and the local reference data block set, wherein the moving parameters comprise a moving window and a moving step length, a size of the moving window being same as a size of the first data block, and the moving step length being less than a width of the moving window.

### Claim 5 (depends on 4)

The method according to claim 4, wherein the global reference data block set comprises at least one first reference data block;
wherein, when a coding mode of the multimedia data frame is a serial coding mode, the at least one first reference data block is a coded data block having a parameter association relationship meeting one or more writing-back restriction conditions in the multimedia data frame and belonging to a same tile as the first data block;
wherein the parameter association relationship indicates a first association relationship between a first position information and a size information of a superblock (SB) and a second association relationship between the first position information and a second position information, the first position information being position information of the coded data block in the multimedia data frame, and the second position information being position information of the first data block in the multimedia data frame; and
wherein, the one or more writing-back restriction conditions indicate a restricted delay of writing the coded data block to the global reference data block set.

### Claim 6 (depends on 4)

The method according to claim 4, wherein the global reference data block set comprises at least one second reference data block;
wherein the at least one second reference data block is a coded data block belonging to a same tile as the first data block and having a parameter association relationship meeting one or more writing-back restriction conditions in the multimedia data frame and meeting one or more coding processing conditions;
wherein the parameter association relationship reflects a third association relationship between a position information of the coded data block in the multimedia data frame, a position information of the first data block in the multimedia data frame, and a size information of an SB; and
wherein the one or more writing-back restriction conditions indicate a restricted delay of writing the coded data block to the global reference data block set.

### Claim 7 (depends on 4)

The method according to claim 4, wherein the obtaining the global reference data block set comprises:
obtaining, based on a coding mode of the multimedia data frame being a serial coding mode, a first position information, a size information of an SB and a second position information, wherein the first position information being position information of a coded data block in the multimedia data frame, and the second position information being position information of the first data block in the multimedia data frame;
obtaining one or more writing-back restriction conditions, wherein the one or more writing-back restriction conditions indicate a restricted delay of writing the coded data block to the global reference data block set;
selecting, the coded data block having a parameter association relationship meeting the one or more writing-back restriction conditions and belonging to a same tile as the first data block from the multimedia data frame, as a first reference data block, wherein the parameter association relationship indicates a first association relationship between the first position information and the size information of the SB and a second association relationship between the first position information and the second position information; and
adding the first reference data block to the global reference data block set.

### Claim 8 (depends on 7)

The method according to claim 7, wherein the selecting the coded data block having the parameter association relationship as the first reference data block comprises:
selecting the coded data block belonging to a same tile as the first data block from the multimedia data frame as a first candidate reference data block based on the first position information and the second position information;
determining a restricted number of spaced data blocks between the coded data block and the first data block in the multimedia data frame under the one or more writing-back restriction conditions;
determining a number of spaced data blocks between the first candidate reference data block and the first data block based on the first position information, the size information of the SB and the second position information; and
determining the first candidate reference data block with the number of spaced data blocks greater than the restricted number of spaced data blocks as the first reference data block.

### Claim 9 (depends on 8)

The method according to claim 8, wherein the determining the number of spaced data blocks comprises:
determining a first row identifier and a first column identifier of the first candidate reference data block based on the first position information and the size information of the SB;
determining a second row identifier and a second column identifier of the first data block based on the second position information and the size information of the SB;
determining a number of data blocks in each row in the multimedia data frame based on a size information of the first data block; and
determining the number of spaced data blocks between the first candidate reference data block and the first data block based on the number of data blocks in each row, the first row identifier, the first column identifier, the second row identifier, and the second column identifier.

### Claim 10 (depends on 4)

The method according to claim 4, wherein the obtaining the global reference data block set comprises:
obtaining a first position information, a size information of an SB and a second position information, wherein the first position information being position information of a coded data block in the multimedia data frame, and the second position information being position information of the first data block in the multimedia data frame;
obtaining one or more writing-back restriction conditions and one or more coding processing conditions, wherein the one or more writing-back restriction conditions indicate a restricted delay of writing the coded data block to the global reference data block set;
selecting the coded data block having a parameter association relationship meeting the one or more writing-back restriction conditions and the one or more coding processing conditions and belonging to a same tile as the first data block from the multimedia data frame as a second reference data block, wherein the parameter association relationship indicates a first association relationship between the first position information and a size information of the first data block and a second association relationship between the first position information and the second position information; and
adding the second reference data block to the global reference data block set.

### Claim 11 (depends on 10)

The method according to claim 10, wherein the selecting the coded data block having the parameter association relationship as the second reference data block comprises:
selecting one or more coded data blocks belonging to a same tile from the multimedia data frame as first candidate reference data blocks based on the first position information and the second position information;
selecting one or more candidate reference data blocks having a parameter association relationship meeting the one or more writing-back restriction conditions from the first candidate reference data blocks as second candidate reference data blocks;
determining a first data block restriction distance between the coded data block and the first data block in the multimedia data frame based on the one or more writing-back restriction conditions;
determining a second data block restriction distance between the coded data block and the first data block in the multimedia data frame based on the one or more coding processing conditions; and
determining a second candidate reference data block meeting the one or more coding processing conditions from the second candidate reference data block as the second reference data block based on the first position information, the size information of the SB, the second position information, the first data block restriction distance, and the second data block restriction distance.

### Claim 12 (depends on 11)

The method according to claim 11, wherein the determining the second candidate reference data block meeting the one or more coding processing conditions from the second candidate reference data blocks comprises:
determining a third row identifier and a third column identifier of the second candidate reference data block based on the first position information and the size information of the SB;
determining a fourth row identifier and a fourth column identifier of the first data block based on the second position information and the size information of the SB;
selecting, from the second candidate reference data blocks as a third candidate reference data block, the second candidate reference data block with a row identifier not greater than the fourth row identifier of the first data block;
determining a row distance between the third candidate reference data block and the first data block based on a fifth row identifier of the third candidate reference data block and the fourth row identifier;
determining a column distance between the third candidate reference data block and the first data block based on a column identifier of the third candidate reference data block and the fourth column identifier; and
determining the third candidate reference data block with the column distance less than a first distance threshold among one or more third candidate reference data blocks as the second reference data block, wherein the first distance threshold is determined based on the first data block restriction distance, the second data block restriction distance, and the row distance between the third candidate reference data block and the first data block.

### Claim 13 (depends on 4)

The method according to claim 4, wherein the local reference data block set comprises at least one third reference data block, and the at least one third reference data block is a coded data block located in a same coding processing unit as the first data block in the multimedia data frame.

### Claim 14 (depends on 4)

The method according to claim 4, wherein the local reference data block set comprises at least one fourth reference data block, and the at least one fourth reference data block is a coded data block adjacent to the first data block in the multimedia data frame and belonging to a same tile as the first data block.

### Claim 15 (depends on 14)

The method according to claim 14, wherein the at least one fourth reference data block being adjacent to the first data block comprises the at least one fourth reference data block and the first data block belonging to a same SB.

### Claim 16 (depends on 14)

The method according to claim 14, wherein the at least one fourth reference data block being adjacent to the first data block comprises the at least one fourth reference data block being located in a first number of SBs adjacent to the first data block, wherein a size of an SB is not greater than a size threshold, and wherein the first number of SBs is determined based on a size information of the SB.

### Claim 17 (depends on 14)

The method according to claim 14, wherein the at least one fourth reference data block being adjacent to the first data block comprises the at least one fourth reference data block being located in a first number of SBs adjacent to the first data block, wherein a size of an SB is not less than a size threshold, wherein a first data block at an upper left corner of a target region is not reconstructed, wherein the target region is a region where the at least one fourth reference data block in the multimedia data frame moves to the right by one SB, and wherein position information when the at least one fourth reference data block moves by a distance of one SB is different from the position information of the first data block, and wherein the first number of SBs is based on a size information of the SB.

### Claim 18

An apparatus for processing multimedia data, the apparatus comprising:
at least one memory configured to store computer program code; and
at least one processor configured to access the computer program code and operate as instructed by the computer program code, the computer program code including:
first obtaining code configured to cause the at least one processor to obtain a global reference data block set and a local reference data block set, wherein the global reference data block set and the local reference data block set are associated with a first data block in a multimedia data frame, wherein the global reference data block set and the local reference data block set are both adjacent to at least one non-reference data block set comprising at least one data block that is not referenceable by the first data block; and
first determining code configured to cause the at least one processor to determine a reference data block for coding or decoding of the first data block based on the global reference data block set and the local reference data block set.

### Claim 19 (depends on 18)

The apparatus of claim 18, further comprising:
second obtaining code configured to cause the at least one processor to obtain a coding mode of the first data block; and
second determining code configured to cause the at least one processor to determine, based on the coding mode of the first data block being an intra block copy (IBC) mode or an intra string copy (ISC) mode, the reference data block for coding or decoding of the first data block by using the global reference data block set and the local reference data block set.

### Claim 20

A non-transitory computer-readable medium storing instructions, the instructions comprising: one or more instructions that, when executed by one or more processors of a device for processing multimedia data, cause the one or more processors to:
obtain a global reference data block set and a local reference data block set, wherein the global reference data block set and the local reference data block set are associated with a first data block in a multimedia data frame, wherein the global reference data block set and the local reference data block set are both adjacent to at least one non-reference data block set comprising at least one data block that is not referenceable by the first data block; and
determine a reference data block for coding or decoding of the first data block based on the global reference data block set and the local reference data block set.
