# US 2021/0243455 A1 · Multi-stage block coding

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0243455 A1
- Document ID: US20210243455A1
- Status: Published application
- Kind: A1
- Application number: 17/167,413
- Filed: 2021-02-04
- Published: 2021-08-05
- Earliest claimed: 2020-02-04
- Assignees: Apple Inc.
- Applicants: Apple Inc.
- Inventors: Krishnakanth Rapaka; Alexandros Tourapis; David William Singer
- Web page: https://patentgrep.com/patent/US20210243455A1

## CPC

- H04N 19/11: among a plurality of spatial predictive coding modes
- H04N 19/176: the region being a block, e.g. a macroblock
- H04N 19/103: Selection of coding mode or of prediction mode
- H04N 19/119: Adaptive subdivision aspects, e.g. subdivision of a picture into rectangular or non-rectangular coding blocks
- H04N 19/124: Quantisation
- H04N 19/136: Incoming video signal characteristics or properties
- H04N 19/14: Coding unit complexity, e.g. amount of activity or edge presence estimation (H04N19/146 takes precedence)
- H04N 19/159: Prediction type, e.g. intra-frame, inter-frame or bidirectional frame prediction
- H04N 19/182: the unit being a pixel
- H04N 19/192: the adaptation method, adaptation tool or adaptation type being iterative or recursive
- H04N 19/50: using predictive coding (H04N19/61 takes precedence)
- H04N 19/59: involving spatial sub-sampling or interpolation, e.g. alteration of picture size or resolution
- H04N 19/593: involving spatial prediction techniques
- H04N 19/61: in combination with predictive coding
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

A multi-stage coding method includes receiving an input block of data for encoding and one or more previously coded samples associated with the input block. The input block is segmented into at least a first sub-region and a second sub-region. A prediction for the first sub-region is generated based on the one or more previously coded samples. Residual data for the first sub-region is obtained using the prediction for the first sub-region. A reconstruction of the first sub-region is generated using the residual data for the first sub-region and the prediction for the first sub-region. A prediction for the second sub-region is generated using the reconstruction of the first sub-region. Residual data for the second sub-region is obtained using the prediction for the second sub-region. The input block is encoded based in part on the residual data for the first region and the residual data for the second region.

## Claims

### Claim 1

A method comprising:
receiving an input block of data for encoding and one or more previously coded samples associated with the input block;
segmenting the input block into at least a first sub-region and a second sub-region;
based on the one or more previously coded samples, generating a prediction for the first sub-region;
obtaining residual data for the first sub-region using the prediction for the first sub-region;
generating a reconstruction of the first sub-region using the residual data for the first sub-region and the prediction for the first sub-region;
generating a prediction for the second sub-region using the reconstruction of the first sub-region;
obtaining residual data for the second sub-region using the prediction for the second sub-region; and
encoding the input block based in part on the residual data for the first region and the residual data for the second region.

### Claim 2 (depends on 1)

The method of claim 1, further comprising:
refining the prediction or the reconstruction of the first sub-region before generating the prediction for the second sub-region.

### Claim 3 (depends on 2)

The method of claim 2, wherein the prediction for the first sub-region is a first prediction, and wherein the refining comprises generating a second prediction for the first sub-region using the reconstruction of the first sub-region.

### Claim 4 (depends on 2)

The method of claim 2, wherein the refining is based on a prediction mode of the first sub-region.

### Claim 5

(canceled)

### Claim 6 (depends on 2)

The method of claim 2, wherein the refining comprises applying a weighted average to at least the prediction for the first sub-region or the reconstruction of the first sub-region.

### Claim 7 (depends on 6)

The method of claim 6, wherein one or more weights for the weighted average are selected based on a quality of a correlation between the second sub-region and the prediction or the reconstruction of the first sub-region.

### Claim 8 (depends on 1)

The method of claim 1, further comprising:
selecting a number of refinement stages applied to the prediction or the reconstruction of the first sub-region.

### Claim 9 (depends on 1)

The method of claim 1, wherein the first sub-region comprises non-adjacent samples of the input block.

### Claim 10

(canceled)

### Claim 11 (depends on 1)

The method of claim 1, wherein segmenting comprises applying one or more linear regression or machine learning techniques to the input block to fit one or more samples of the input block according to a distribution or a characteristic of neighboring samples.

### Claim 12 (depends on 1)

The method of claim 1, wherein segmenting is based on one or more characteristics of one or more samples included in the input block.

### Claim 13 (depends on 1)

The method of claim 1, wherein the first sub-region comprises two or more samples of the input block arranged in an order.

### Claim 14 (depends on 1)

The method of claim 1, further comprising:
providing signaling information about the order of the samples included in the first sub-region.

### Claim 15 (depends on 1)

The method of claim 1, further comprising:
providing signaling information about a number of sub-regions of the input block or a geometry of at least one sub-region of the plurality of sub-regions.

### Claim 16 (depends on 1)

The method of claim 1, further comprising:
selecting a set of prediction modes available for generating the prediction of the first sub-region based on a distribution of samples in the first sub-region.

### Claim 17 (depends on 1)

The method of claim 1, wherein the prediction for the first sub-region and the prediction for the second sub-region are generated using different prediction modes.

### Claim 18

(canceled)

### Claim 19 (depends on 1)

The method of claim 1, wherein the input block includes one or more samples, and wherein the first sub-region includes at least one of the one or more samples.

### Claim 20 (depends on 1)

The method of claim 1, wherein at least one sample of the one or more previously coded samples is refined based on a quantization parameter applied to the at least one sample.

### Claim 21 (depends on 1)

The method of claim 1, wherein the one or more previously coded samples are refined based on a prediction mode used to generate the prediction of the first sub-region.

### Claim 22

A system, comprising:
one or more processors: and
memory storing instructions that, when executed by the one or more processors, cause the one or more processors for perform operations comprising:
receiving an input block of data for encoding and one or more previously coded samples associated with the input block;
segmenting the input block into at least a first sub-region and a second sub-region;
based on the one or more previously coded samples, generating a prediction for the first sub-region;
obtaining residual data for the first sub-region using the prediction for the first sub-region;
generating a reconstruction of the first sub-region using the residual data for the first sub-region and the prediction for the first sub-region;
generating a prediction for the second sub-region using the reconstruction of the first sub-region;
obtaining residual data for the second sub-region using the prediction for the second sub-region; and
encoding the input block based in part on the residual data for the first region and the residual data for the second region.

### Claim at position 23

23-63. (canceled)

### Claim 64

A method, comprising:
receiving encoded data representative of an input block of data, the input block including at least a first sub-region and a second sub-region;
decoding the encoded data to obtain residual data for the input block, the residual data including residual data for the first sub-region and residual data for the second sub-region, wherein the residual data for the second sub-region is generated based at least in part on a reconstruction of the residual data for the first sub-region;
generating a prediction for the input block using one or more previously decoded samples associated with the input block; and
generating a reconstruction of the input block using the prediction and the residual data.

### Claim at position 25

65-105. (canceled)
