# US 10,321,148 B2 · Effective wedgelet partition coding using spatial prediction

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 10,321,148 B2
- Document ID: US10321148B2
- Status: Granted
- Kind: B2
- Application number: 15/657,813
- Filed: 2017-07-24
- Published: 2017-11-16
- Granted: 2019-06-11
- Earliest claimed: 2011-11-11
- Assignees: Ge Video Compression, LLC
- Applicants: Ge Video Compression, LLC
- Inventors: Philipp Merkle; Christian Bartnik; Haricharan Lakshman; Detlev Marpe; Karsten Mueller; Thomas Wiegand; Gerhard Tech
- Web page: https://patentgrep.com/patent/US10321148B2

## CPC

- H04N 19/51: Motion estimation or motion compensation
- H04N 19/105: Selection of the reference unit for prediction within a chosen coding or prediction mode, e.g. adaptive choice of position and number of pixels used for prediction
- H04N 19/119: Adaptive subdivision aspects, e.g. subdivision of a picture into rectangular or non-rectangular coding blocks
- H04N 19/157: Assigned coding mode, i.e. the coding mode being predefined or preselected to be further used for selection of another element or parameter
- H04N 19/176: the region being a block, e.g. a macroblock
- H04N 19/196: being specially adapted for the computation of encoding parameters, e.g. by averaging previously computed encoding parameters (processing of motion vectors H04N19/513)
- H04N 19/46: Embedding additional information in the video signal during the compression process (H04N19/517, H04N19/68, H04N19/70 take precedence)
- H04N 19/52: by predictive encoding
- H04N 19/593: involving spatial prediction techniques
- H04N 19/597: specially adapted for multi-view video sequence encoding
- H04N 19/70: characterised by syntax aspects related to video coding, e.g. related to compression standards
- H04N 19/82: involving filtering within a prediction loop
- H04N 19/91: Entropy coding, e.g. variable length coding [VLC] or arithmetic coding
- H04N 19/96: Tree coding, e.g. quad-tree coding
- H04N 19/14: Coding unit complexity, e.g. amount of activity or edge presence estimation (H04N19/146 takes precedence)
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

In accordance with a first aspect, the intra prediction direction of a neighboring, intra-predicted block is used in order to predict the extension direction of the wedgelet separation line of a current block, thereby reducing the side information rate necessitated in order to convey the partitioning information. In accordance with a second aspect, the idea is that previously reconstructed samples, i.e. reconstructed values of blocks preceding the current block in accordance with the coding/decoding order allow for at least a prediction of a correct placement of a starting point of the wedgelet separation line, namely by placing the starting point of the wedgelet separation line at a position of a maximum change between consecutive ones of a sequence of reconstructed values of samples of a line of samples extending adjacent to the current block along a circumference thereof. Both aspects may be used individually or in combination.

## Claims

### Claim 1

A non-transitory computer-readable medium for storing data associated with a video, comprising:
a data stream stored in the non-transitory computer-readable medium, the data stream comprising encoded information indicating an intra-prediction direction related to intra prediction of a first block of a sample array, wherein the intra-prediction direction is used to decode a second block of the sample array using a plurality of operations including:
predicting the first block of the sample array using intra prediction by determining sample values of the first block based on reconstructed values of samples of the sample array, neighboring the first block, along the intra-prediction direction;
deriving a position of a wedgelet separation line within the second block neighboring the first block by setting an extension direction of the wedgelet separation line within the second block based on the intra-prediction direction used to predict the first block, the wedgelet separation line dividing the second block into first and second wedgelet portions; and
decoding the second block in units of the first and second wedgelet portions.

### Claim 2 (depends on 1)

The computer-readable medium according to claim 1, wherein the plurality of operations further comprise, in deriving the position of the wedgelet separation line within the second block of the sample array, placing a starting point of the wedgelet separation line at a position of a maximum change between consecutive ones of a sequence of reconstructed values of samples of a line of samples extending adjacent to the second block along a portion of a circumference of the second block.

### Claim 3 (depends on 1)

The computer-readable medium according to claim 1, wherein the plurality of operations further comprise:
retrieving a coding option identifier from the data stream,
if the coding option identifier comprises a predetermined value, checking as to whether any of a set of candidate blocks neighboring the second block comprises a wedgelet separation line continuing into the second block, and
if so, deriving a position of a wedgelet separation line within the second block of the sample array depending on the wedgelet separation line of the respective block such that the wedgelet separation line at the derived position within the second block forms an extension of the wedgelet separation line of the neighboring block into the second block, and
if not, performing the derivation of the position of the wedgelet separation line based on the intra-prediction direction.

### Claim 4 (depends on 1)

The computer-readable medium according to claim 1, wherein, in decoding the second block, the plurality of operations comprise:
predicting the second block by assigning a first constant partition value to samples of the sample array positioned within the first wedgelet portion and a second constant partition value to samples of the sample array positioned within the second wedgelet portion, the assignment depending on information extracted from the data stream.

### Claim 5 (depends on 4)

The computer-readable medium according to claim 4, the plurality of operations comprising:
refining the prediction of the second block by applying a first refinement value within the refinement information onto a mean value of values of neighboring samples associated with the first portion, and/or applying a second refinement value within the refinement information onto a mean value of values of neighboring samples associated with the second portion.

### Claim 6 (depends on 4)

The computer-readable medium according to claim 4, the plurality of operations comprising, in applying the first and/or second refinement value, linearly combining the first and/or second refinement value with the mean value of values of the neighboring samples associated with the first portion, and/or the mean value of values of the neighboring samples associated with the second portion, respectively.

### Claim 7 (depends on 5)

The computer-readable medium according to claim 5, wherein the sample array is a depth map, and the plurality of operations comprising scaling the first and/or second refinement value using a quantization step size depending on a reference quantization step size at which a predetermined spatially sampled component associated with the sample array is transmitted, and using the reference quantization step size in order to reconstruct a texture sample array from the data stream, the texture sample array associated with the depth map.

### Claim 8 (depends on 1)

The computer-readable medium according to claim 1, wherein the sample array is a depth map associated with a picture, wherein the plurality of operations comprising:
retrieving a coding option identifier from the data stream,
if the coding option identifier comprises a first predetermined value, performing the derivation of the position of the wedgelet separation line based on the intra-prediction direction, and
if the coding option identifier comprises a second predetermined value,
segmenting a reference block of the picture, co-located to the second block, by thresholding the picture within the reference block to acquire a bi-segmentation of the reference block into first and second portions,
spatially transferring the bi-segmentation of the reference block of the picture onto the second block of the depth map so as to acquire first and second portions of the second block, and
predicting the second block by assigning a first constant partition value to samples of the depth map positioned within the first portion of the second block and a second constant partition value to samples of the depth map positioned within the second portion of the second block, the assignment depending on the data stream.

### Claim 9 (depends on 1)

The computer-readable medium according to claim 1, further configured to use the second block as a reference in a prediction loop to encode or decode sample arrays.