# US 2019/0174148 A1 · Inheritance in sample array multitree subdivision

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0174148 A1
- Document ID: US20190174148A1
- Status: Published application
- Kind: A1
- Application number: 16/271,094
- Filed: 2019-02-08
- Published: 2019-06-06
- Earliest claimed: 2010-04-13
- Assignees: Ge Video Compression, LLC
- Applicants: Ge Video Compression, LLC
- Inventors: Philipp HELLE; Detlev MARPE; Simon OUDIN; Thomas WIEGAND
- Web page: https://patentgrep.com/patent/US20190174148A1

## CPC

- H04N 19/96: Tree coding, e.g. quad-tree coding
- H04N 19/124: Quantisation
- H04N 19/129: Scanning of coding units, e.g. zig-zag scan of transform coefficients or flexible macroblock ordering [FMO]
- H04N 19/13: Adaptive entropy coding, e.g. adaptive variable length coding [AVLC] or context adaptive binary arithmetic coding [CABAC]
- H04N 19/159: Prediction type, e.g. intra-frame, inter-frame or bidirectional frame prediction
- H04N 19/176: the region being a block, e.g. a macroblock
- H04N 19/30: using hierarchical techniques, e.g. scalability (H04N19/63 takes precedence)
- H04N 19/439: {using cascaded computational arrangements for performing a single operation, e.g. filtering}
- H04N 19/44: Decoders specially adapted therefor, e.g. video decoders which are asymmetric with respect to the encoder
- H04N 19/463: by compressing encoding parameters before transmission
- H04N 19/513: Processing of motion vectors
- H04N 19/52: by predictive encoding
- H04N 19/53: Multi-resolution motion estimation; Hierarchical motion estimation
- H04N 19/593: involving spatial prediction techniques
- H04N 19/70: characterised by syntax aspects related to video coding, e.g. related to compression standards
- H04N 19/136: Incoming video signal characteristics or properties
- H04N 19/46: Embedding additional information in the video signal during the compression process (H04N19/517, H04N19/68, H04N19/70 take precedence)
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

A better compromise between encoding complexity and achievable rate distortion ratio, and/or to achieve a better rate distortion ratio is achieved by using multitree sub-divisioning not only in order to subdivide a continuous area, namely the sample array, into leaf regions, but using the intermediate regions also to share coding parameters among the corresponding collocated leaf blocks. By this measure, coding procedures performed in tiles—leaf regions—locally, may be associated with coding parameters individually without having to, however, explicitly transmit the whole coding parameters for each leaf region separately. Rather, similarities may effectively exploited by using the multitree subdivision.

## Claims

### Claim 1

A decoder for reconstructing an array of information samples encoded in a data stream and representing video information, the decoder comprising:
an extractor configured for:
extracting, from the data stream, multi-tree subdivision information and inheritance information associated with an inheritance coding block of the array of information samples, the inheritance information indicating as to whether inheritance is used, wherein the inheritance coding block corresponds to a first hierarchy level of a sequence of hierarchy levels in accordance with the multi-tree subdivision information and is composed of a set of coding sub-blocks, each of which corresponds to a second hierarchy level of the sequence of hierarchy levels in accordance with the multi-tree subdivision information,
extracting, from the data stream if the inheritance is used with respect to the inheritance coding block, an inheritance subset associated with the inheritance coding block, the inheritance subset including at least one syntax element of a predetermined syntax element type, and
extracting, from the data stream, respective residual information associated with each of the set of coding sub-blocks; and
a predictor configured for:
copying the at least one syntax element in the inheritance subset into a set of syntax elements representing coding parameters used in an inter coding process corresponding to each of the set of coding sub-blocks,
determining, for each of the set of coding sub-blocks, a coding parameter used in the inter coding process associated with the corresponding coding sub-block based on the at least one syntax element,
predicting a respective prediction signal for each of the set of coding sub-blocks based on information associated with a previously reconstructed coding sub-block in accordance with the inter coding process, and
reconstructing each of the set of coding sub-blocks based on the respective coding parameter, the respective prediction signal, and the respective residual information.

### Claim 2 (depends on 1)

The decoder of claim 1, wherein the inheritance information includes an inheritance flag indicating whether inheritance is used with respect to the inheritance coding block defined by multi-tree subdivision based on the multi-tree subdivision information, and the extractor is configured to extract the inheritance flag from the data stream.

### Claim 3 (depends on 1)

The decoder of claim 1, wherein the decoder is a hybrid decoder.

### Claim 4 (depends on 1)

The decoder of claim 1, wherein the decoder is configured to decode residual information for each of the set of coding sub-blocks.

### Claim 5 (depends on 1)

The decoder of claim 1, wherein the decoder is configured to extract, from the data stream, at least one syntax element of the predetermined syntax element type representing a coding parameter associated with a leaf region that is not a coding sub-block of an inheritance coding block.

### Claim 6 (depends on 1)

The decoder of claim 1, wherein the decoder is configured to, if inheritance is indicated not to be used, extract at least one syntax element of the predetermined syntax element type representing a coding parameter associated with leaf regions of the array of information samples for which inheritance is not used.

### Claim 7 (depends on 1)

The decoder of claim 1, wherein the decoder is configured to reconstruct the array of information samples by prediction in a prediction mode determined based on at least one syntax element of the predetermined syntax element type associated with leaf regions of the array of information samples.

### Claim 8 (depends on 1)

The decoder of claim 1, wherein the data stream comprises at least a portion associated with color samples.

### Claim 9 (depends on 1)

The decoder of claim 1, wherein the data stream comprises at least a portion associated with depth values related to a depth map.

### Claim 10

A method for reconstructing an array of information samples encoded in a data stream and representing video information, the method comprising:
extracting, from the data stream, multi-tree subdivision information and inheritance information associated with an inheritance coding block of the array of information samples, the inheritance information indicating as to whether inheritance is used, wherein the inheritance coding block corresponds to a first hierarchy level of a sequence of hierarchy levels in accordance with the multi-tree subdivision information and is composed of a set of coding sub-blocks, each of which corresponds to a second hierarchy level of the sequence of hierarchy levels in accordance with the multi-tree subdivision information;
extracting, from the data stream if the inheritance is used with respect to the inheritance coding block, an inheritance subset associated with the inheritance coding block, the inheritance subset including at least one syntax element of a predetermined syntax element type;
extracting, from the data stream, respective residual information associated with each of the set of coding sub-blocks;
copying the at least one syntax element in the inheritance subset into a set of syntax elements representing coding parameters used in an inter coding process corresponding to each of the set of coding sub-blocks;
determining, for each of the set of coding sub-blocks, a coding parameter used in the inter coding process associated with the corresponding coding sub-block based on the at least one syntax element;
predicting a respective prediction signal for each of the set of coding sub-blocks based on information associated with a previously reconstructed coding sub-block in accordance with the inter coding process; and
reconstructing each of the set of coding sub-blocks based on the respective coding parameter, the respective prediction signal and the respective residual information.

### Claim 11 (depends on 10)

The method of claim 10, wherein the inheritance information includes an inheritance flag indicating whether inheritance is used with respect to the inheritance coding block defined by multi-tree subdivision in accordance with the multi-tree subdivision information, the method further comprising extracting the inheritance flag from the data stream.

### Claim 12 (depends on 10)

The method of claim 10, further comprising decoding residual information for each of the set of coding sub-blocks.

### Claim 13 (depends on 10)

The method of claim 10, further comprising extracting, from the data stream, at least one syntax element of the predetermined syntax element type representing a coding parameter associated with a leaf region that is not a coding sub-block of an inheritance coding block.

### Claim 14 (depends on 10)

The method of claim 10, further comprising, if inheritance is indicated not to be used, extracting at least one syntax element of the predetermined syntax element type representing a coding parameter associated with leaf regions of the array of information samples for which inheritance is not used.

### Claim 15 (depends on 10)

The method of claim 10, further comprising reconstructing the array of information samples by prediction in a prediction mode determined based on at least one syntax element of the predetermined syntax element type associated with leaf regions of the array of information samples.

### Claim 16 (depends on 10)

The method of claim 10, wherein the data stream comprises at least a portion associated with color samples.

### Claim 17 (depends on 10)

The method of claim 10, wherein the data stream comprises at least a portion associated with depth values related to a depth map.

### Claim 18 (depends on 10)

A non-transitory computer readable digital storage medium having stored thereon a computer program, which, when read by the computer, causes the computer to perform a method according to claim 10.

### Claim 19

A method for encoding an array of information samples representing video information signal into a data stream, the method comprising:
inserting, into the data stream, multi-tree subdivision information and inheritance information associated with an inheritance coding block of the array of information samples, the inheritance information indicating as to whether inheritance is used, wherein the inheritance coding block corresponds to a first hierarchy level of a sequence of hierarchy levels in accordance with the multi-tree subdivision information and is composed of a set of coding sub-blocks, each of which corresponds to a second hierarchy level of the sequence of hierarchy levels in accordance with the multi-tree subdivision information;
inserting, into the data stream if inheritance is indicated to be used with respect to the inheritance coding block, an inheritance subset including at least one syntax element of a predetermined syntax element type associated with the inheritance coding block, wherein, during decoding, at least one syntax element in the inheritance subset is to be copied into a set of syntax elements representing coding parameters used in an inter coding process corresponding to each of the set of coding sub-blocks in order to reconstruct the coding sub-block; and
inserting, into the data stream, respective residual information for each of the set sub-blocks so that each of the set of coding sub-blocks in the inheritance coding block is to be reconstructed based on one or more of the coding parameters used in the inter coding process, the respective residual information specific to the coding sub-block, and a respective prediction signal generated based on information associated with a previously reconstructed coding sub-block in accordance with the inter coding process.

### Claim 20 (depends on 19)

The method of claim 19, wherein the inheritance information includes an inheritance flag indicating whether inheritance is used with respect to the inheritance coding block defined by multi-tree subdivision in accordance with the multi-tree subdivision information, the method further comprising inserting the inheritance flag into the data stream.

### Claim 21 (depends on 19)

The method of claim 19, further comprising inserting, into the data stream, at least one syntax element of the predetermined syntax element type representing a coding parameter associated with a leaf region that is not a coding sub-block of an inheritance coding block.

### Claim 22 (depends on 19)

The method of claim 19, further comprising, if inheritance is indicated not to be used, inserting, into the data stream, at least one syntax element of the predetermined syntax element type representing a coding parameter associated with leaf regions of the array of information samples for which inheritance is not used.

### Claim 23 (depends on 19)

The method of claim 19, further comprising inserting, into the data stream, at least one syntax element of the predetermined syntax element type indicating a prediction mode associated with leaf regions of the array of information samples.

### Claim 24 (depends on 19)

The method of claim 19, wherein the data stream comprises at least a portion associated with color samples.

### Claim 25 (depends on 19)

The method of claim 19, wherein the data stream comprises at least a portion associated with depth values related to a depth map.

### Claim 26 (depends on 19)

A non-transitory computer readable digital storage medium having stored thereon a computer program having a program code, which, when read by the computer, causes the computer to perform a method according to claim 19.

### Claim 27

A machine readable non-transitory medium for storing data associated with a video signal, comprising a data stream stored in the non-transitory machine readable medium, the data stream comprising an array of information samples representing video information, multi-tree subdivision information and inheritance information associated with an inheritance coding block of the array of information samples, the inheritance information indicating as to whether inheritance is used, wherein the inheritance coding block corresponds to a first hierarchy level of a sequence of hierarchy levels in accordance with the multi-tree subdivision information and is composed of a set of coding sub-blocks, each of which corresponds to a second hierarchy level of the sequence of hierarchy levels in accordance with the multi-tree subdivision information,
the data stream further comprising respective residual information associated with each of the set of coding sub-blocks and, if inheritance is indicated to be used with respect to the inheritance coding block, an inheritance subset including at least one syntax element of a predetermined syntax element type associated with the inheritance coding block, so that the at least one syntax element associated with the inheritance coding block is to be copied as a corresponding syntax element representing a coding parameter used in an inter coding process associated with the corresponding coding sub-block, and each of the set of coding sub-blocks is to be reconstructed based on the coding parameter used in the inter coding process, the respective residual information specific to the coding sub-block, and a respective prediction signal generated based on information associated with a previously reconstructed coding sub-block in accordance with the inter coding process.

### Claim 28 (depends on 27)

The non-transitory medium of claim 27, wherein the inheritance information includes an inheritance flag indicating whether inheritance is used with respect to the inheritance coding block defined by multi-tree subdivision, the data stream comprising the inheritance flag.

### Claim 29 (depends on 27)

The non-transitory medium of claim 27, wherein the data stream comprises at least a portion associated with color samples.

### Claim 30 (depends on 27)

The non-transitory medium of claim 27, wherein the data stream comprises at least a portion associated with depth values related to a depth map.