# US 2019/0356911 A1 · Region-based processing of predicted pixels

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0356911 A1
- Document ID: US20190356911A1
- Status: Published application
- Kind: A1
- Application number: 16/529,620
- Filed: 2019-08-01
- Published: 2019-11-21
- Earliest claimed: 2005-11-18
- Assignees: Apple Inc.
- Applicants: Apple Inc.
- Inventors: Thomas Pun; Paul Chang; Hsi-Jung Wu
- Web page: https://patentgrep.com/patent/US20190356911A1

## CPC

- H04N 19/105: Selection of the reference unit for prediction within a chosen coding or prediction mode, e.g. adaptive choice of position and number of pixels used for prediction
- H04N 19/102: characterised by the element, parameter or selection affected or controlled by the adaptive coding
- H04N 19/134: characterised by the element, parameter or criterion affecting or controlling the adaptive coding
- H04N 19/157: Assigned coding mode, i.e. the coding mode being predefined or preselected to be further used for selection of another element or parameter
- H04N 19/176: the region being a block, e.g. a macroblock
- H04N 19/182: the unit being a pixel
- H04N 19/436: using parallelised computational arrangements
- H04N 19/44: Decoders specially adapted therefor, e.g. video decoders which are asymmetric with respect to the encoder
- H04N 19/46: Embedding additional information in the video signal during the compression process (H04N19/517, H04N19/68, H04N19/70 take precedence)
- H04N 19/52: by predictive encoding
- H04N 19/61: in combination with predictive coding
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

A method for decoding a compressed video data sequence containing one or more coded pixel blocks. The compressed video sequence is buffered. Prediction information for each of the coded pixel blocks is reviewed. One or more groups of coded pixel blocks are formed based on the reviewed prediction information such that the coded pixel blocks within a given group have similar prediction dependencies and/or at least do not depend on a reconstructed pixel within a group of received pixel blocks to enable parallel decoding. The formed groups are scheduled for processing and subsequently decoded to produce a decoded video data sequence.

## Claims

### Claim 1

A decoding method for coded video data, comprising:
assigning a first coded pixel block of a frame to be decoded to a decoding group;
for subsequent additional coded pixel blocks of the frame:
determining whether the respective subsequent coded pixel block contains a prediction reference that refers to a reconstructed pixel within the decoding group,
if not, assigning the respective subsequent coded pixel block to the decoding group, and
if so, terminating the decoding group;
retrieving from a memory previously decoded video data referenced by the prediction references of the decoding group; and
decoding the coded pixel blocks of the decoding group with reference to the retrieved decoded video data.

### Claim 2 (depends on 1)

The decoding method of claim 1, wherein the prediction references are motion vectors.

### Claim 3

A method for decoding a compressed video data sequence, comprising:
buffering the compressed video sequence, the compressed video sequence comprising one or more coded pixel blocks;
reviewing prediction information of the one or more coded pixel blocks;
grouping coded pixel blocks based on the reviewed prediction information, the coded pixel blocks within a group having similar prediction dependencies;
scheduling decoding of the pixel blocks according to the grouping; and
decoding the scheduled groups of coded pixel blocks to produce a decoded video data sequence.

### Claim 4 (depends on 3)

The method of claim 3, wherein the prediction information comprises a motion vector.

### Claim 5 (depends on 3)

The method of claim 3, wherein the prediction information comprises a reference frame.

### Claim 6 (depends on 3)

The method of claim 3, wherein grouping comprises forming at least one group comprising coded pixel blocks that can be predicted independently of one another.

### Claim 7 (depends on 6)

The method of claim 6, wherein the coded pixel blocks of the at least one group are intra-frame pixel blocks.

### Claim 8 (depends on 6)

The method of claim 6, wherein the coded pixel blocks of the at least one group are inter-frame pixel blocks.

### Claim 9 (depends on 3)

The method of claim 3, wherein forming comprises forming at least one group having coded pixel blocks that share one motion vector and one reference frame.

### Claim 10

A computer-readable memory having stored thereon a plurality of instructions for decoding a compressed video sequence comprising one or more coded pixel blocks, which when executed by a processor, cause the processor to:
retrieve coding parameters of a coded pixel block;
compare the coding parameters of the coded pixel block to coding parameters of a current group of pixel blocks;
add the coded pixel block to the current group of pixel blocks if the coding parameters of the coded pixel block match the coding parameters of the current group of pixel blocks; and
schedule decoding of the current group of pixel blocks once the current group of pixel blocks is closed, wherein the current group of pixel blocks is closed upon detection of a first non-qualifying coded pixel block.

### Claim 11 (depends on 10)

The computer-readable memory of claim 10, further comprising causing the processor to decode a chunk of the current group of pixel blocks.

### Claim 12 (depends on 10)

The computer-readable memory of claim 10, wherein the coding parameters of the coded pixel block match the coding parameters of the current group of pixel blocks when the coded pixel block can be predicted independently of other coded pixel blocks within the current group of pixel blocks.

### Claim 13 (depends on 12)

The computer-readable memory of claim 12, wherein the current group of pixel blocks comprises one or more inter-frame pixel blocks.

### Claim 14 (depends on 12)

The computer-readable memory of claim 12, wherein the current group of pixel blocks comprises one or more intra-frame pixel blocks.

### Claim 15 (depends on 10)

The computer-readable memory of claim 10, wherein the coding parameters of the coded pixel block match the coding parameters of the current group of pixel blocks when the coded pixel block and all other coded pixel blocks within the current group of pixel blocks share a motion vector and a reference frame.

### Claim 16

A method for encoding a video data sequence, comprising:
coding the video data sequence to generate a coded video sequence comprising one or more coded pixel blocks;
reviewing prediction information for each of the one or more coded pixel blocks;
forming one or more groups of coded pixel blocks based on the reviewed prediction information, the coded pixel blocks within a group having similar prediction dependencies;
associating a group identifier with each group of coded pixel blocks to form a formatted coded video data sequence.

### Claim 17 (depends on 16)

The method of claim 16, wherein coding comprises coding the video data sequence according to any one of the Moving Picture Experts Group (MPEG) standards.

### Claim 18 (depends on 16)

The method of claim 16, wherein coding comprises coding the video data sequence according to an International Telecommunication Union (ITU) H.264 standard.

### Claim 19 (depends on 16)

The method of claim 16, wherein forming comprises forming at least one group having coded pixel blocks that can be predicted independently of one another.

### Claim 20 (depends on 19)

The method of claim 19, wherein the coded pixel blocks of the at least one group are intra-frame pixel blocks.

### Claim 21 (depends on 19)

The method of claim 19, wherein the coded pixel blocks of the at least one group are inter-frame pixel blocks.

### Claim 22 (depends on 16)

The method of claim 16, wherein forming comprises forming at least one group having coded pixel blocks that share one motion vector and one reference frame.

### Claim 23 (depends on 16)

The method of claim 16, wherein each group identifier specifies a number of coded pixel blocks contained within an associated group of coded pixel blocks.

### Claim 24

A method for decoding a compressed video data sequence, comprising:
buffering the compressed video sequence, the compressed video sequence comprising one or more coded pixel blocks;
reviewing prediction information of the one or more coded pixel blocks;
grouping coded pixel blocks based on the reviewed prediction information, the coded pixel blocks within a group independent of a reconstructed pixel within the group;
scheduling decoding of the pixel blocks according to the grouping; and
decoding the scheduled groups of coded pixel blocks to produce a decoded video data sequence.

### Claim 25

A method for encoding a video data sequence, comprising:
coding the video data sequence to generate a coded video sequence comprising one or more coded pixel blocks;
reviewing prediction information for each of the one or more coded pixel blocks;
forming one or more groups of coded pixel blocks based on the reviewed prediction information, the coded pixel blocks within a group independent of a reconstructed pixel within the group;
associating a group identifier with each group of coded pixel blocks to form a formatted coded video data sequence.
