# US 2026/0075231 A1 · Decoding with signaling of segmentation information

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2026/0075231 A1
- Document ID: US20260075231A1
- Status: Published application
- Kind: A1
- Application number: 19/393,178
- Filed: 2025-11-18
- Published: 2026-03-12
- Earliest claimed: 2020-12-24
- Assignees: Huawei Technologies Co., Ltd.
- Applicants: Huawei Technologies Co., Ltd.
- Inventors: Sergey Yurievich Ikonin; Mikhail Vyacheslavovich Sosulnikov; Alexander Alexandrovich Karabutov; Timofey Mikhailovich Solovyev; Biao Wang; Elena Alexandrovna Alshina
- Web page: https://patentgrep.com/patent/US20260075231A1

## CPC

- H04N 19/46: Embedding additional information in the video signal during the compression process (H04N19/517, H04N19/68, H04N19/70 take precedence)
- G06N 3/045: Combinations of networks
- G06N 3/0455: Auto-encoder networks; Encoder-decoder networks
- G06N 3/0464: Convolutional networks [CNN, ConvNet]
- G06N 3/0495: Quantised networks; Sparse networks; Compressed networks
- G06N 3/088: Non-supervised learning, e.g. competitive learning
- G06T 9/002: {using neural networks}
- H04N 19/105: Selection of the reference unit for prediction within a chosen coding or prediction mode, e.g. adaptive choice of position and number of pixels used for prediction
- H04N 19/107: between spatial and temporal predictive coding, e.g. picture refresh
- H04N 19/117: Filters, e.g. for pre-processing or post-processing (sub-band filter banks H04N19/635)
- H04N 19/119: Adaptive subdivision aspects, e.g. subdivision of a picture into rectangular or non-rectangular coding blocks
- H04N 19/124: Quantisation
- H04N 19/132: Sampling, masking or truncation of coding units, e.g. adaptive resampling, frame skipping, frame interpolation or high-frequency transform coefficient masking
- H04N 19/33: in the spatial domain
- H04N 19/82: involving filtering within a prediction loop
- G06N 3/047: Probabilistic or stochastic networks
- G06N 3/048: Activation functions
- H04N 19/70: characterised by syntax aspects related to video coding, e.g. related to compression standards
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

The present disclosure relates to methods and apparatuses for decoding data for (still or video processing into a bitstream). Two or more sets of segmentation information elements are obtained from the bitstream. Then, each of the two or more sets of segmentation information elements are inputted respectively into two or more segmentation information processing layers out of a plurality of cascaded layers. In each of the two or more segmentation information processing layers, the respective sets of segmentation information are processed. The decoded data for picture or video processing are obtained based on the segmentation information processed by the plurality of cascaded layers. Accordingly, the data may be decoded from the bitstream in an efficient manner in the layered structure.

## Claims

### Claim 1

A method for decoding data for picture or video processing from a bitstream, the method comprising:
obtaining, from the bitstream, two or more sets of segmentation information elements;
inputting each of the two or more sets of segmentation information elements respectively into two or more segmentation information processing layers out of a plurality of cascaded layers; and
processing, in each of the two or more segmentation information processing layers, the respective sets of segmentation information,
wherein obtaining the decoded data for picture or video processing is based on the segmentation information processed by the plurality of cascaded layers,
wherein the segmentation information processed respectively in the two or more segmentation information processing layers differ in resolution,
wherein the processing of the segmentation information in the two or more segmentation information processing layers includes upsampling, and
wherein the upsampling of the segmentation information comprises a nearest neighbor upsampling.

### Claim 2 (depends on 1)

The method according to claim 1, wherein the obtaining of the sets of segmentation information elements is based on segmentation information processed by at least one segmentation information processing layer out of the plurality of cascaded layers.

### Claim 3 (depends on 1)

The method according to claim 1, wherein the inputting of the sets of segmentation information elements is based on the processed segmentation information outputted by at least one of the plurality of cascaded layers.

### Claim 4 (depends on 1)

The method according to claim 1, wherein said upsampling of the segmentation information comprises a transposed convolution.

### Claim 5 (depends on 1)

The method according to claim 1, wherein for each segmentation information processing layer j of the plurality of N segmentation information processing layers out of the plurality of cascaded layers:
the inputting comprises, inputting initial segmentation information from the bitstream if j=1, and otherwise inputting segmentation information processed by the (j−1)-th segmentation information processing layer; and
outputting the processed segmentation information.

### Claim 6 (depends on 5)

The method according to claim 5, wherein the processing of the inputted segmentation information by each layer j<N of the plurality of N segmentation information processing layers further comprises:
parsing, from the bitstream, a segmentation information element and associating the parsed segmentation information element with the segmentation information outputted by a preceding layer, wherein the position of the parsed segmentation information element in the associated segmentation information is determined based on the segmentation information outputted by the preceding layer.

### Claim 7 (depends on 6)

The method according to claim 6, wherein the amount of segmentation information elements parsed from the bitstream is determined based on segmentation information outputted by the preceding layer.

### Claim 8 (depends on 6)

The method according to claim 6, wherein the parsed segmentation information elements are represented by a set of binary flags.

### Claim 9 (depends on 1)

The method according to claim 1, wherein obtaining decoded data for picture or video processing comprises determining of at least one of:
intra- or inter-picture prediction mode;
picture reference index;
single-reference or multiple-reference prediction (including bi-prediction);
presence or absence prediction residual information;
quantization step size;
motion information prediction type;
length of the motion vector
motion vector resolution;
motion vector prediction index
motion vector difference size
motion vector difference resolution
motion interpolation filter
in-loop filter parameters
post-filter parameters;
based on segmentation information.

### Claim 10 (depends on 1)

The method according to claim 1, further comprising:
obtaining, from the bitstream, sets of feature map elements and inputting the sets of feature map elements respectively into a feature map processing layer out of the plurality of layers based on the segmentation information processed by a segmentation information processing layer; and
obtaining the decoded data for picture or video processing based on a feature map processed by the plurality of cascaded layers.

### Claim 11 (depends on 10)

The method according to claim 10, wherein at least one out of the plurality of cascaded layers is a segmentation information processing layer and a feature map processing layer.

### Claim 12 (depends on 10)

The method according to claim 10, wherein, each layer out of the plurality of layers is either a segmentation information processing layer or a feature map processing layer.

### Claim 13

A non-transitory storage medium storing a computer program product stored, which when executed on one or more processors performs steps for decoding data for picture or video processing from a bitstream, comprising:
obtaining, from the bitstream, two or more sets of segmentation information elements;
inputting each of the two or more sets of segmentation information elements respectively into two or more segmentation information processing layers out of a plurality of cascaded layers; and
processing, in each of the two or more segmentation information processing layers, the respective sets of segmentation information,
wherein obtaining the decoded data for picture or video processing is based on the segmentation information processed by the plurality of cascaded layers,
wherein the segmentation information processed respectively in the two or more segmentation information processing layers differ in resolution,
wherein the processing of the segmentation information in the two or more segmentation information processing layers includes upsampling, and
wherein the upsampling of the segmentation information comprises a nearest neighbor upsampling.

### Claim 14

A device for decoding an image or video including a processing circuitry which is configured to perform a method for decoding data for picture or video processing from a bitstream, comprising:
obtaining, from the bitstream, two or more sets of segmentation information elements;
inputting each of the two or more sets of segmentation information elements respectively into two or more segmentation information processing layers out of a plurality of cascaded layers; and
processing, in each of the two or more segmentation information processing layers, the respective sets of segmentation information,
wherein obtaining the decoded data for picture or video processing is based on the segmentation information processed by the plurality of cascaded layers,
wherein the segmentation information processed respectively in the two or more segmentation information processing layers differ in resolution,
wherein the processing of the segmentation information in the two or more segmentation information processing layers includes upsampling, and
wherein the upsampling of the segmentation information comprises a nearest neighbor upsampling.

### Claim 15

A device for decoding data for picture or video processing from a bitstream, the device comprising:
a processor; and
a memory storing instructions that when executed by the processor, cause the device to perform steps comprising:
obtaining, from the bitstream, two or more sets of segmentation information elements;
inputting each of the two or more sets of segmentation information elements respectively into two or more segmentation information processing layers out of a plurality of cascaded layers;
processing, in each of the two or more segmentation information processing layers, the respective sets of segmentation information; and
obtaining the decoded data for picture or video processing based on the segmentation information processed in the plurality of cascaded layers.
