# US 10,375,400 B2 · Method for decoding image and apparatus using same

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 10,375,400 B2
- Document ID: US10375400B2
- Status: Granted
- Kind: B2
- Application number: 15/933,010
- Filed: 2018-03-22
- Published: 2018-07-26
- Granted: 2019-08-06
- Earliest claimed: 2014-01-02
- Assignees: Electronics and Telecommunications Research Institute
- Applicants: Electronics and Telecommunications Research Institute
- Inventors: Ha Hyun Lee; Jung Won Kang; Jin Ho Lee; Jin Soo Choi; Jin Woong Kim
- Web page: https://patentgrep.com/patent/US10375400B2

## CPC

- H04N 19/159: Prediction type, e.g. intra-frame, inter-frame or bidirectional frame prediction
- G10L 15/04: Segmentation; Word boundary detection
- G10L 15/22: Procedures used during a speech recognition process, e.g. man-machine dialogue
- G10L 15/26: Speech to text systems (G10L15/08 takes precedence)
- G10L 17/00: Speaker identification or verification techniques
- G10L 25/78: Detection of presence or absence of voice signals (switching of direction of transmission by voice frequency in two-way loud-speaking telephone systems H04M9/10)
- H04N 19/172: the region being a picture, frame or field
- H04N 19/184: the unit being bits, e.g. of the compressed video stream
- H04N 19/187: the unit being a scalable video layer
- H04N 19/30: using hierarchical techniques, e.g. scalability (H04N19/63 takes precedence)
- H04N 19/70: characterised by syntax aspects related to video coding, e.g. related to compression standards
- G10L 15/005: {Language recognition}
- G10L 15/01: Assessment or evaluation of speech recognition systems
- G10L 15/063: {Training}
- G10L 15/142: {Hidden Markov Models [HMMs]}
- G10L 15/16: using artificial neural networks
- G10L 15/32: Multiple recognisers used in sequence or in parallel; Score combination systems therefor, e.g. voting systems
- G10L 25/51: for comparison or discrimination
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING

## Abstract

A method of decoding a image according to an embodiment of the present invention, which supports a plurality of layers, may comprise the steps of: receiving information on a reference layer used to decode a current picture for inter-layer prediction; inducing the number of valid reference layer pictures used to decode the current picture on the basis of the information on the reference layer; and performing inter-layer prediction on the basis of the number of valid reference layer pictures.

## Claims

### Claim 1

A method of decoding a video supporting a plurality of layers performed by a decoding apparatus, the method comprising:
receiving information on a reference layer used for decoding a current picture for interlayer prediction;
deriving a number of active reference layer pictures used for decoding the current picture based on the information on the reference layer;
performing interlayer prediction based on the number of active reference layer pictures to generate a prediction block for a current block;
generating a residual block for the current block; and
reconstructing the current block based on the prediction block and the residual block,
wherein the generating the residual block comprises entropy-decoding a bitstream to generate a quantized transformed coefficient and inverse-quantizing the quantized transformed coefficient to generate a transformed coefficient,
wherein when a layer identifier of a current layer comprising the current picture is not 0 and when a number of reference layer pictures available for interlayer prediction in the same access unit as that of the current picture is not 0, and when a reference layer picture available for interlayer prediction specified by values of maximum temporal sub-layer information on each layer and information on maximum allowed value of temporal sub-layer allowing inter-layer prediction in each layer among direct reference layer pictures comprised in all the direct reference layers of the current layer is present in the same access unit as that of the current picture and included in an interlayer reference picture set of the current picture, the number of active reference layer pictures is derived to be equal to the number of reference layer pictures, and
wherein the number of reference layer pictures is derived based on information indicating a number of direct reference layers of the current layer, the maximum temporal sub-layer information on each layer, the information on maximum allowed value of temporal sub-layer allowing inter-layer prediction in each layer and a temporal identifier of the current picture, and among the pictures in the direct reference layers of the current layer comprising the current picture, a picture in a reference layer is considered as a reference layer picture available for decoding the current picture for interlayer prediction when maximum temporal sub-layer information of the reference layer is greater than or equal to the temporal identifier of the current picture and either when information on maximum allowed value of temporal sub-layer allowing inter-layer prediction in the reference layer for the current layer is greater than the temporal identifier of the current picture or when the temporal identifier of the current picture is 0.

### Claim 2 (depends on 1)

The method of claim 1, wherein all slices of the current picture have the same number of active reference layer pictures.

### Claim 3 (depends on 1)

The method of claim 1, wherein when a layer identifier of a current layer comprising the current picture is 0, the number of active reference layer pictures is derived to be 0.

### Claim 4 (depends on 1)

The method of claim 1, wherein when a number of reference layer pictures available for interlayer prediction in the same access unit as that of the current picture is 0, the number of active reference layer pictures is derived to be 0.

### Claim 5 (depends on 1)

The method of claim 1, wherein when interlayer prediction is not used for decoding the current picture, the number of active reference layer pictures is derived to be 0.

### Claim 6 (depends on 1)

The method of claim 1, wherein when at most one picture is used for interlayer prediction for each picture in a coding video sequence or when a number of direct reference layers of the layer comprising the current picture is 1, the number of active reference layer pictures is derived to be 1.

### Claim 7 (depends on 1)

The method of claim 1, wherein when the information on the reference layer comprises number information indicating a number of pictures used for decoding the current picture for interlayer prediction, the number of active reference layer pictures is derived to be a value specified by the number information.

### Claim 8

An apparatus for decoding a video supporting a plurality of layers, the apparatus comprising:
a decoder configured to receive information on a reference layer used for decoding a current picture for interlayer prediction, derive a number of active reference layer pictures used for decoding the current picture based on the information on the reference layer, perform interlayer prediction based on the number of active reference layer pictures to generate a prediction block for a current block, generate a residual block for the current block, and reconstruct the current block based on the prediction block and the residual block,
wherein the generating the residual block comprises entropy-decoding a bitstream to generate a quantized transformed coefficient and inverse-quantizing the quantized transformed coefficient to generate a transformed coefficient,
wherein when a layer identifier of a current layer comprising the current picture is not 0 and when a number of reference layer pictures available for interlayer prediction in the same access unit as that of the current picture is not 0, and when a reference layer picture available for interlayer prediction specified by values of maximum temporal sub-layer information on each layer and information on maximum allowed value of temporal sub-layer allowing inter-layer prediction in each layer among direct reference layer pictures comprised in all the direct reference layers of the current layer is present in the same access unit as that of the current picture and included in an interlayer reference picture set of the current picture, the number of active reference layer pictures is derived to be equal to the number of reference layer pictures, and
wherein the number of reference layer pictures is derived based on information indicating a number of direct reference layers of the current layer, the maximum temporal sub-layer information on each layer, the information on maximum allowed value of temporal sub-layer allowing inter-layer prediction in each layer and a temporal identifier of the current picture, and among the pictures in the direct reference layers of the current layer comprising the current picture, a picture in a reference layer is considered as a reference layer picture available for decoding the current picture for interlayer prediction when maximum temporal sub-layer information of the reference layer is greater than or equal to the temporal identifier of the current picture and either when information on maximum allowed value of temporal sub-layer allowing inter-layer prediction in the reference layer for the current layer is greater than the temporal identifier of the current picture or when the temporal identifier of the current picture is 0.

### Claim 9 (depends on 8)

The apparatus of claim 8, wherein when a layer identifier of a current layer comprising the current picture is 0, the number of active reference layer pictures is derived to be 0.

### Claim 10 (depends on 8)

The apparatus of claim 8, wherein when a number of reference layer pictures available for interlayer prediction in the same access unit as that of the current picture is 0, the number of active reference layer pictures is derived to be 0.

### Claim 11 (depends on 8)

The apparatus of claim 8, wherein when interlayer prediction is not used for decoding the current picture, the number of active reference layer pictures is derived to be 0.

### Claim 12 (depends on 8)

The apparatus of claim 8, wherein when at most one picture is used for interlayer prediction for each picture in a coding video sequence or when a number of direct reference layers of the layer comprising the current picture is 1, the number of active reference layer pictures is derived to be 1.

### Claim 13

A method of encoding a video supporting a plurality of layers performed by an encoding apparatus, the method comprising:
determining information on a reference layer used for encoding a current picture for interlayer prediction;
deriving a number of active reference layer pictures used for encoding the current picture based on the information on the reference layer;
performing interlayer prediction based on the number of active reference layer pictures to generate a prediction block for a current block;
generating a residual block for the current block based on the prediction block; and
encoding the residual block,
wherein the encoding the residual block comprises transforming the residual block to generate a transformed coefficient and quantizing the transformed coefficient to generate a quantized transformed coefficient,
wherein when a layer identifier of a current layer comprising the current picture is not 0 and when a number of reference layer pictures available for interlayer prediction in the same access unit as that of the current picture is not 0, and when a reference layer picture available for interlayer prediction specified by values of maximum temporal sub-layer information on each layer and information on maximum allowed value of temporal sub-layer allowing inter-layer prediction in each layer among direct reference layer pictures comprised in all the direct reference layers of the current layer is present in the same access unit as that of the current picture and included in an interlayer reference picture set of the current picture, the number of active reference layer pictures is derived to be equal to the number of reference layer pictures, and
wherein the number of reference layer pictures is derived based on information indicating a number of direct reference layers of the current layer, the maximum temporal sub-layer information on each layer, the information on maximum allowed value of temporal sub-layer allowing inter-layer prediction in each layer and a temporal identifier of the current picture, and among the pictures in the direct reference layers of the current layer comprising the current picture, a picture in a reference layer is considered as a reference layer picture available for decoding the current picture for interlayer prediction when maximum temporal sub-layer information of the reference layer is greater than or equal to the temporal identifier of the current picture and either when information on maximum allowed value of temporal sub-layer allowing inter-layer prediction in the reference layer for the current layer is greater than the temporal identifier of the current picture or when the temporal identifier of the current picture is 0.

### Claim 14

An apparatus for encoding a video supporting a plurality of layers, the apparatus comprising:
an encoder configured to determine information on a reference layer used for encoding a current picture for interlayer prediction, derive a number of active reference layer pictures used for encoding the current picture based on the information on the reference layer, perform interlayer prediction based on the number of active reference layer pictures to generate a prediction block for a current block, generate a residual block for the current block based on the prediction block, and encode the residual block,
wherein the encoding the residual block comprises transforming the residual block to generate a transformed coefficient and quantizing the transformed coefficient to generate a quantized transformed coefficient,
wherein when a layer identifier of a current layer comprising the current picture is not 0 and when a number of reference layer pictures available for interlayer prediction in the same access unit as that of the current picture is not 0, and when a reference layer picture available for interlayer prediction specified by values of maximum temporal sub-layer information on each layer and information on maximum allowed value of temporal sub-layer allowing inter-layer prediction in each layer among direct reference layer pictures comprised in all the direct reference layers of the current layer is present in the same access unit as that of the current picture and included in an interlayer reference picture set of the current picture, the number of active reference layer pictures is derived to be equal to the number of reference layer pictures, and
wherein the number of reference layer pictures is derived based on information indicating a number of direct reference layers of the current layer, the maximum temporal sub-layer information on each layer, the information on maximum allowed value of temporal sub-layer allowing inter-layer prediction in each layer and a temporal identifier of the current picture, and among the pictures in the direct reference layers of the current layer comprising the current picture, a picture in a reference layer is considered as a reference layer picture available for decoding the current picture for interlayer prediction when maximum temporal sub-layer information of the reference layer is greater than or equal to the temporal identifier of the current picture and either when information on maximum allowed value of temporal sub-layer allowing inter-layer prediction in the reference layer for the current layer is greater than the temporal identifier of the current picture or when the temporal identifier of the current picture is 0.

### Claim 15

A non-transitory computer-readable medium storing a bitstream that is generated by a method of encoding a video supporting a plurality of layers, the method comprising:
determining information on a reference layer used for encoding a current picture for interlayer prediction;
deriving a number of active reference layer pictures used for encoding the current picture based on the information on the reference layer;
performing interlayer prediction based on the number of active reference layer pictures to generate a prediction block for a current block;
generating a residual block for the current block based on the prediction block; and
encoding the residual block,
wherein the encoding the residual block comprises transforming the residual block to generate a transformed coefficient and quantizing the transformed coefficient to generate a quantized transformed coefficient,
wherein when a layer identifier of a current layer comprising the current picture is not 0 and when a number of reference layer pictures available for interlayer prediction in the same access unit as that of the current picture is not 0, and when a reference layer picture available for interlayer prediction specified by values of maximum temporal sub-layer information on each layer and information on maximum allowed value of temporal sub-layer allowing inter-layer prediction in each layer among direct reference layer pictures comprised in all the direct reference layers of the current layer is present in the same access unit as that of the current picture and included in an interlayer reference picture set of the current picture, the number of active reference layer pictures is derived to be equal to the number of reference layer pictures, and
wherein the number of reference layer pictures is derived based on information indicating a number of direct reference layers of the current layer, the maximum temporal sub-layer information on each layer, the information on maximum allowed value of temporal sub-layer allowing inter-layer prediction in each layer and a temporal identifier of the current picture, and among the pictures in the direct reference layers of the current layer comprising the current picture, a picture in a reference layer is considered as a reference layer picture available for decoding the current picture for interlayer prediction when maximum temporal sub-layer information of the reference layer is greater than or equal to the temporal identifier of the current picture and either when information on maximum allowed value of temporal sub-layer allowing inter-layer prediction in the reference layer for the current layer is greater than the temporal identifier of the current picture or when the temporal identifier of the current picture is 0.