# US 10,771,794 B2 · Adaptive partition coding

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 10,771,794 B2
- Document ID: US10771794B2
- Status: Granted
- Kind: B2
- Application number: 16/720,054
- Filed: 2019-12-19
- Published: 2020-04-23
- Granted: 2020-09-08
- Earliest claimed: 2011-11-11
- Assignees: Ge Video Compression, LLC
- Applicants: Ge Video Compression, LLC
- Inventors: Philipp Merkle; Christian Bartnik; Haricharan Lakshman; Detlev Marpe; Karsten Mueller; Thomas Wiegand; Gerhard Tech
- Web page: https://patentgrep.com/patent/US10771794B2

## CPC

- H04N 19/176: the region being a block, e.g. a macroblock
- H04N 19/103: Selection of coding mode or of prediction mode
- H04N 19/105: Selection of the reference unit for prediction within a chosen coding or prediction mode, e.g. adaptive choice of position and number of pixels used for prediction
- H04N 19/119: Adaptive subdivision aspects, e.g. subdivision of a picture into rectangular or non-rectangular coding blocks
- H04N 19/157: Assigned coding mode, i.e. the coding mode being predefined or preselected to be further used for selection of another element or parameter
- H04N 19/196: being specially adapted for the computation of encoding parameters, e.g. by averaging previously computed encoding parameters (processing of motion vectors H04N19/513)
- H04N 19/23: with coding of regions that are present throughout a whole video segment, e.g. sprites, background or mosaic
- H04N 19/44: Decoders specially adapted therefor, e.g. video decoders which are asymmetric with respect to the encoder
- H04N 19/46: Embedding additional information in the video signal during the compression process (H04N19/517, H04N19/68, H04N19/70 take precedence)
- H04N 19/593: involving spatial prediction techniques
- H04N 19/597: specially adapted for multi-view video sequence encoding
- H04N 19/70: characterised by syntax aspects related to video coding, e.g. related to compression standards
- H04N 19/82: involving filtering within a prediction loop
- H04N 19/96: Tree coding, e.g. quad-tree coding
- H04N 19/14: Coding unit complexity, e.g. amount of activity or edge presence estimation (H04N19/146 takes precedence)
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

Although wedgelet-based partitioning seems to represent a better tradeoff between side information rate on the one hand and achievable variety in partitioning possibilities on the other hand, compared to contour partitioning, the ability to alleviate the constraints of the partitioning to the extent that the partitions have to be wedgelet partitions, enables applying relatively uncomplex statistical analysis onto overlaid spatially sampled texture information in order to derive a good predictor for the bi-segmentation in a depth/disparity map. Thus, in accordance with a first aspect it is exactly the increase of the freedom which alleviates the signaling overhead provided that co-located texture information in form of a picture is present. Another aspect pertains the possibility to save side information rate involved with signaling a respective coding mode supporting irregular partitioning.

## Claims

### Claim 1

A decoder for reconstructing a block of a depth map associated with a texture picture from a data stream, configured to:
determine a texture threshold based on a mean of sample values of a reference block of a texture picture;
determine a contour partition of the reference block of the texture picture based on the texture threshold;
predict a contour partition of a block in a depth map based on the contour partition of the reference block such that the block of the depth map is segmented into two portions, wherein the block in the depth map corresponds to the reference block of the texture picture; and
reconstruct the block of the depth map by decoding the two portions associated with the contour partition.

### Claim 2 (depends on 1)

The decoder according to claim 1, configured to, in determining the contour partition of the reference block, individually check values of the texture picture within the reference block at tiles of a two-dimensional subdivision of the reference block, as to whether the respective value is greater than or lower than a respective predetermined value, so that each of first and second portions of the reference block of the texture picture is a set of the tiles which together completely cover the reference block of the texture picture and are complementary to each other.

### Claim 3 (depends on 2)

The decoder according to claim 2, configured to, in determining the contour partition of the reference block, individually check values of the texture picture within the reference block at sample resolution so that each tile corresponds to a sample position of the reference block.

### Claim 4 (depends on 1)

The decoder according to claim 1, configured to, in determining a contour partition of the reference block, apply morphological hole filling and/or low-pass filtering onto a result of the comparing in order to acquire two portions of the reference block.

### Claim 5 (depends on 1)

The decoder according to claim 1, configured to, in determining the texture threshold, determine a measure for a central tendency of reconstructed sample values of the reference block of the texture picture, wherein the measure represents the texture threshold.

### Claim 6 (depends on 1)

The decoder according to claim 1, further configured to
determine a dispersion of value of samples within the reference block of the texture picture;
receive a coding option identifier from the data stream; and
use the coding option identifier as an index to perform the determining of the texture threshold, the determining of the contour partition of the reference block, the predicting of the contour partition of the block of the depth map, and the decoding operations in case of the dispersion exceeding a predetermined threshold.

### Claim 7 (depends on 1)

The decoder according to claim 1, wherein the contour partition of the reference block is determined by comparing each sample of the reference block with the texture threshold.

### Claim 8

An encoder for encoding a block of a depth map associated with a texture picture into a data stream, configured to:
determine a texture threshold based on a mean of sample values of a reference block of a texture picture;
determine a contour partition of the reference block of the texture picture based on the texture threshold;
predict a contour partition of a block in a depth map based on the contour partition of the reference block such that the block of the depth map is segmented into two portions, wherein the block in the depth map corresponds to the reference block of the texture picture; and
encode, into the data stream, the block of the depth map based on the two portions associated with the contour partition.

### Claim 9 (depends on 8)

The encoder according to claim 8, configured to, in determining the contour partition of the reference block, individually check values of the texture picture within the reference block at tiles of a two-dimensional subdivision of the reference block, as to whether the respective value is greater than or lower than a respective predetermined value, so that each of first and second portions of the reference block of the texture picture is a set of the tiles which together completely cover the reference block of the texture picture and are complementary to each other.

### Claim 10 (depends on 9)

The encoder according to claim 9, configured to, in determining the contour partition of the reference block, individually check values of the texture picture within the reference block at sample resolution so that each tile corresponds to a sample position of the reference block.

### Claim 11 (depends on 8)

The encoder according to claim 8, configured to, in determining the contour partition of the reference block, apply morphological hole filling and/or low-pass filtering onto a result of the comparing in order to acquire two portions of the reference block.

### Claim 12 (depends on 8)

The encoder according to claim 8, configured to, in determining the texture threshold, determine a measure for a central tendency of reconstructed sample values of the reference block of the texture picture, wherein the measure represents the texture threshold.

### Claim 13 (depends on 8)

The encoder according to claim 8, further configured to:
determine a dispersion of value of samples within the reference block of the texture picture; and
encode a coding option identifier into the data stream, wherein the coding option identifier is used as an index to perform the operations forming the determining of the texture threshold, the determining of the contour partition of the reference block, the predicting of the contour partition of the block of the depth map, and the decoding operations in case of the dispersion exceeding a predetermined threshold.

### Claim 14 (depends on 8)

The encoder according to claim 8, wherein the contour partition of the reference block is determined by comparing each sample of the reference block with the texture threshold.

### Claim 15

A non-transitory computer-readable medium for storing data associated with a video, comprising:
a data stream stored in the non-transitory computer-readable medium, the data stream comprising encoded information of a reference block of a texture picture of the video and encoded information of a block in a depth map of the video, wherein the block in the depth map corresponds to the reference block of the texture picture, wherein the block in the depth map is decoded using a plurality of operations including:
determining a texture threshold based on a mean of sample values of the reference block of the texture picture;
determining a contour partition of the reference block of the texture picture based on the texture threshold;
predicting a contour partition of the block in the depth map based on the contour partition of the reference block such that the block of the depth map is segmented into two portions; and
reconstructing the block of the depth map by decoding the two portions associated with the contour partition.

### Claim 16 (depends on 15)

The computer-readable medium according to claim 15, wherein determining a contour partition of the reference block includes individually checking values of the texture picture within the reference block at tiles of a two-dimensional subdivision of the reference block, as to whether the respective value is greater than or lower than a respective predetermined value, so that each of first and second portions of the reference block of the texture picture is a set of the tiles which together completely cover the reference block of the texture picture and are complementary to each other.

### Claim 17 (depends on 16)

The computer-readable medium according to claim 16, wherein determining a contour partition of the reference block includes individually checking values of the texture picture within the reference block at sample resolution so that each tile corresponds to a sample position of the reference block.

### Claim 18 (depends on 15)

The computer-readable medium according to claim 15, wherein determining a contour partition of the reference block includes applying morphological hole filling and/or low-pass filtering onto a result of the comparing in order to acquire two portions of the reference block.

### Claim 19 (depends on 13)

The computer-readable medium according to claim 13, wherein determining the texture threshold includes determining a measure for a central tendency of reconstructed sample values of the reference block of the texture picture, wherein the measure represents the texture threshold.

### Claim 20 (depends on 15)

The computer-readable medium according to claim 15, wherein the contour partition of the reference block is determined by comparing each sample of the reference block with the texture threshold.
