# US 2014/0192860 A1 · Method, device, computer program, and information storage means for encoding or decoding a scalable video sequence

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2014/0192860 A1
- Document ID: US20140192860A1
- Status: Published application
- Kind: A1
- Application number: 14/146,509
- Filed: 2014-01-02
- Published: 2014-07-10
- Earliest claimed: 2013-01-04
- Assignees: Canon Kabushiki Kaisha
- Applicants: Canon Kabushiki Kaisha
- Inventors: Patrice ONNO; Christophe GISQUET; Guillaume LAROCHE; Edouard FRANCOIS
- Web page: https://patentgrep.com/patent/US20140192860A1

## CPC

- H04N 19/86: involving reduction of coding artifacts, e.g. of blockiness
- H04N 19/30: using hierarchical techniques, e.g. scalability (H04N19/63 takes precedence)
- H04N 19/82: involving filtering within a prediction loop
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

The invention relates to a method of encoding or decoding a scalable video sequence of frames encoded in a bit-stream made of at least one lower layer and one upper layer, the method comprising: decoding a lower layer bitstream to obtain first sample adaptive offset, SAO, parameters defining a first SAO filtering applied to at least one lower layer frame area; and decoding an upper layer bitstream into at least one decoded upper layer frame area, using a second SAO filtering applied to at least one processed frame area of a processed frame based on respective second SAO parameters; wherein at least one flag in the bit-stream indicates that part or all of the second SAO parameters are inferred from the first SAO parameters

## Claims

### Claim 1

A method of encoding or decoding a scalable video sequence made of at least one lower layer and one upper layer, the method comprising:
decoding a lower layer bitstream to obtain first sample adaptive offset, SAO, parameters defining a first SAO filtering applied to at least one lower layer frame area; and
decoding an upper layer bitstream into at least one decoded upper layer frame area, using a second SAO filtering applied to at least one processed frame area of a processed frame based on respective second SAO parameters;
wherein part or all of the second SAO parameters are inferred from the first SAO parameters.

### Claim 2 (depends on 1)

The method of claim 1, wherein the second SAO parameters for SAO filtering a first processed frame area in the processed frame are first by-default SAO parameters when the first SAO parameters applied to a co-located lower layer frame area in a lower layer frame define a SAO filtering of a first type.

### Claim 3 (depends on 2)

The method of claim 2, wherein the first type of SAO filtering is a Band Offset SAO filtering.

### Claim 4 (depends on 2)

The method of claim 2, wherein a second processed frame area in the processed frame is assigned with a SAO filter type taken from the first SAO parameters applied to a co-located lower layer frame area in the lower layer frame, when the SAO filter type of the first SAO parameters is an Edge Offset SAO filtering.

### Claim 5 (depends on 2)

The method of claim 2, wherein the first by-default SAO parameters define no SAO filtering for the first processed frame area.

### Claim 6 (depends on 1)

The method of claim 1, wherein the second SAO parameters for SAO filtering a first processed frame area in the processed frame are second by-default SAO parameters when a co-located lower layer frame area in a lower layer frame is not subjected to SAO filtering.

### Claim 7 (depends on 2)

The method of claim 2, wherein the first or second by-default SAO parameters define an Edge Offset SAO filtering.

### Claim 8 (depends on 6)

The method of claim 6, wherein the first or second by-default SAO parameters define an Edge Offset SAO filtering.

### Claim 9 (depends on 7)

The method of claim 7, wherein the processed frame comprises at least one luminance component and one chrominance component, and the first or second by-default SAO parameters define the Edge Offset SAO filtering of the luminance component only and not of the chrominance component.

### Claim 10 (depends on 9)

The method of claim 9, wherein the first or second by-default SAO parameters for the first processed frame area in the chrominance component define a Band Offset SAO filtering.

### Claim 11 (depends on 8)

The method of claim 8, wherein the processed frame comprises at least one luminance component and one chrominance component, and the first or second by-default SAO parameters define the Edge Offset SAO filtering of the luminance component only and not of the chrominance component.

### Claim 12 (depends on 11)

The method of claim 11, wherein the first or second by-default SAO parameters for the first processed frame area in the chrominance component define a Band Offset SAO filtering.

### Claim 13 (depends on 2)

The method of claim 2, wherein the first by-default SAO parameters define no SAO filtering and the second by-default SAO parameters define an Edge Offset SAO filtering.

### Claim 14 (depends on 2)

The method of claim 2, wherein the first and second by-default SAO parameters are the same.

### Claim 15 (depends on 2)

The method of claim 2, further comprising determining all or part of the first or second by-default SAO parameters from all the processed frame areas in a frame part of the processed frame that are subjected to SAO filtering using such first or second by-default SAO parameters.

### Claim 16 (depends on 6)

The method of claim 6, wherein the first by-default SAO parameters define no SAO filtering and the second by-default SAO parameters define an Edge Offset SAO filtering.

### Claim 17 (depends on 6)

The method of claim 6, wherein the first and second by-default SAO parameters are the same.

### Claim 18 (depends on 6)

The method of claim 6, further comprising determining all or part of the first or second by-default SAO parameters from all the processed frame areas in a frame part of the processed frame that are subjected to SAO filtering using such first or second by-default SAO parameters.

### Claim 19 (depends on 15)

The method of claim 15, further comprising including the determined first or second by-default SAO parameters within the upper layer bitstream.

### Claim 20 (depends on 15)

The method of claim 15, wherein the first or second by-default SAO parameters includes predefined offsets and a predefined SAO filter type defining an Edge Offset SAO filtering, and determining all or part of the first or second by-default SAO parameters comprises determining an Edge Offset direction based on a rate distortion criterion using the predefined offsets and samples of all the processed frame areas in the frame part of the processed frame that are subjected to SAO filtering using the first or second by-default SAO parameters.

### Claim 21 (depends on 18)

The method of claim 18, further comprising including the determined first or second by-default SAO parameters within the upper layer bitstream.

### Claim 22 (depends on 18)

The method of claim 18, wherein the first or second by-default SAO parameters includes predefined offsets and a predefined SAO filter type defining an Edge Offset SAO filtering, and determining all or part of the first or second by-default SAO parameters comprises determining an Edge Offset direction based on a rate distortion criterion using the predefined offsets and samples of all the processed frame areas in the frame part of the processed frame that are subjected to SAO filtering using the first or second by-default SAO parameters.

### Claim 23 (depends on 2)

The method of claim 2, wherein offsets of the first or second by-default SAO parameters depend on a quantization parameter implemented in the decoding of the upper layer bitstream.

### Claim 24 (depends on 6)

The method of claim 6, wherein offsets of the first or second by-default SAO parameters depend on a quantization parameter implemented in the decoding of the upper layer bitstream.

### Claim 25 (depends on 1)

The method of claim 1, wherein the second SAO parameters used for SAO filtering each processed frame area composing the processed frame are the same as the first SAO parameters used for SAO filtering a corresponding co-located lower layer frame area in a lower layer frame temporally coinciding with the at least one upper layer frame area being decoded.

### Claim 26 (depends on 1)

The method of claim 1, wherein inferring the second SAO parameters includes replacing SAO offsets of the first SAO parameters by determined offsets, and keeping a SAO filter type and, if any, a filter-type-depending sub-parameter of the first SAO parameters, to obtain the second SAO parameters.

### Claim 27 (depends on 26)

The method of claim 26, wherein replacing SAO offsets of the first SAO parameters by determined offsets comprises determining the offsets from all the processed frame areas within a frame part of the processed frame that inherit the same SAO filter type and the same filter-type-depending sub-parameter from first SAO parameters of a lower layer frame.

### Claim 28 (depends on 26)

The method of claim 26, wherein the determined offsets comprise the same predefined set of SAO offsets dedicated for all the processed frame areas within a frame part of the processed frame.

### Claim 29 (depends on 28)

The method of claim 28, wherein the predefined set of offsets equals the four following offsets {1, 0, 0, −1}.

### Claim 30 (depends on 1)

The method of claim 1, wherein the second SAO filtering is applied to the first processed frame area independently of neighbouring frame areas in the same processed frame.

### Claim 31 (depends on 1)

The method of claim 1, wherein decoding an upper layer bitstream comprises performing a restricted number of SAO filtering on the same processed frame area, including the second SAO filtering based on the second SAO parameters.

### Claim 32 (depends on 1)

The method of claim 1, wherein the processed frame includes an upper layer frame reconstructed from the upper layer bitstream during the decoding.

### Claim 33 (depends on 1)

The method of claim 1, wherein the processed frame includes an intermediary frame obtained independently of the upper layer bitstream and used to decode the upper layer frame area.

### Claim 34 (depends on 33)

The method of claim 33, wherein the intermediary frame is constructed using a lower layer frame that temporally coincides with the at least one upper layer frame area being decoded.

### Claim 35 (depends on 34)

The method of claim 34, wherein the intermediary frame is used as a spatial or temporal predictor for the upper layer frame area being decoded.

### Claim 36 (depends on 34)

The method of claim 34, wherein the intermediary frame includes an up-sampled version of a decoded lower layer frame.

### Claim 37 (depends on 34)

The method of claim 34, wherein the intermediary frame mixes frame areas extracted from a decoded lower layer frame and frame areas extracted from reference frames of the upper layer using prediction information from the lower layer.

### Claim 38 (depends on 36)

The method according to claim 36 wherein the up-sampling operation allowing obtaining the up-sampled version the decoded lower layer frame is applied on a version of the decoded lower layer frame on which had been applied a SAO filtering using the second SAO parameters.

### Claim 39

A device for encoding or decoding a scalable video sequence made of at least one lower layer and one upper layer, the device comprising:
an internal base decoder configured to decode a lower layer bitstream to obtain first sample adaptive offset, SAO, parameters defining a first SAO filtering applied to at least one lower layer frame area; and
an internal enhancement decoder configured to decode an upper layer bitstream into at least one decoded upper layer frame area, using a second SAO filtering applied to at least one processed frame area of a processed frame based on respective second SAO parameters;
wherein part or all of the second SAO parameters are inferred from the first SAO parameters.

### Claim 40 (depends on 39)

The device of claim 39, wherein the second SAO parameters for SAO filtering a first processed frame area in the processed frame are first by-default SAO parameters when the first SAO parameters applied to a co-located lower layer frame area in a lower layer frame define a SAO filtering of a first type.

### Claim 41 (depends on 40)

The device of claim 40, wherein the first type of SAO filtering is a Band Offset SAO filtering.

### Claim 42 (depends on 40)

The device of claim 40, wherein a second processed frame area in the processed frame is assigned with a SAO filter type taken from the first SAO parameters applied to a co-located lower layer frame area in the lower layer frame, when the SAO filter type of the first SAO parameters is an Edge Offset SAO filtering.

### Claim 43 (depends on 40)

The device of claim 40, wherein the first by-default SAO parameters define no SAO filtering for the first processed frame area.

### Claim 44 (depends on 39)

The device of claim 39, wherein the second SAO parameters for SAO filtering a first processed frame area in the processed frame are second by-default SAO parameters when a co-located lower layer frame area in a lower layer frame is not subjected to SAO filtering.

### Claim 45 (depends on 40)

The device of claim 40, wherein the first or second by-default SAO parameters define an Edge Offset SAO filtering.

### Claim 46 (depends on 44)

The device of claim 44, wherein the first or second by-default SAO parameters define an Edge Offset SAO filtering.

### Claim 47 (depends on 45)

The device of claim 45, wherein the processed frame comprises at least one luminance component and one chrominance component, and the first or second by-default SAO parameters define the Edge Offset SAO filtering of the luminance component only and not of the chrominance component.

### Claim 48 (depends on 47)

The device of claim 47, wherein the first or second by-default SAO parameters for the first processed frame area in the chrominance component define a Band Offset SAO filtering.

### Claim 49 (depends on 46)

The device of claim 46, wherein the processed frame comprises at least one luminance component and one chrominance component, and the first or second by-default SAO parameters define the Edge Offset SAO filtering of the luminance component only and not of the chrominance component.

### Claim 50 (depends on 49)

The device of claim 49, wherein the first or second by-default SAO parameters for the first processed frame area in the chrominance component define a Band Offset SAO filtering.

### Claim 51 (depends on 40)

The device of claim 40, wherein the first by-default SAO parameters define no SAO filtering and the second by-default SAO parameters define an Edge Offset SAO filtering.

### Claim 52 (depends on 40)

The device of claim 40, wherein the first and second by-default SAO parameters are the same.

### Claim 53 (depends on 40)

The device of claim 40, further comprising a SAO parameter determining module configured to determine all or part of the first or second by-default SAO parameters from all the processed frame areas in a frame part of the processed frame that are subjected to SAO filtering using such first or second by-default SAO parameters.

### Claim 54 (depends on 44)

The device of claim 44, wherein the first by-default SAO parameters define no SAO filtering and the second by-default SAO parameters define an Edge Offset SAO filtering.

### Claim 55 (depends on 44)

The device of claim 44, wherein the first and second by-default SAO parameters are the same.

### Claim 56 (depends on 44)

The device of claim 44, further comprising a SAO parameter determining module configured to determine all or part of the first or second by-default SAO parameters from all the processed frame areas in a frame part of the processed frame that are subjected to SAO filtering using such first or second by-default SAO parameters.

### Claim 57 (depends on 53)

The device of claim 53, configured to include the determined first or second by-default SAO parameters within the upper layer bitstream.

### Claim 58 (depends on 53)

The device of claim 53, wherein the first or second by-default SAO parameters includes predefined offsets and a predefined SAO filter type defining an Edge Offset SAO filtering, and the SAO parameter determining module is configured to determine an Edge Offset direction based on a rate distortion criterion using the predefined offsets and samples of all the processed frame areas in the frame part of the processed frame that are subjected to SAO filtering using the first or second by-default SAO parameters.

### Claim 59 (depends on 56)

The device of claim 56, configured to include the determined first or second by-default SAO parameters within the upper layer bitstream.

### Claim 60 (depends on 56)

The device of claim 56, wherein the first or second by-default SAO parameters includes predefined offsets and a predefined SAO filter type defining an Edge Offset SAO filtering, and the SAO parameter determining module is configured to determine an Edge Offset direction based on a rate distortion criterion using the predefined offsets and samples of all the processed frame areas in the frame part of the processed frame that are subjected to SAO filtering using the first or second by-default SAO parameters.

### Claim 61 (depends on 40)

The device of claim 40, wherein offsets of the first or second by-default SAO parameters depend on a quantization parameter implemented in the decoding of the upper layer bitstream.

### Claim 62 (depends on 44)

The device of claim 44, wherein offsets of the first or second by-default SAO parameters depend on a quantization parameter implemented in the decoding of the upper layer bitstream.

### Claim 63 (depends on 39)

The device of claim 39, wherein the second SAO parameters used for SAO filtering each processed frame area composing the processed frame are the same as the first SAO parameters used for SAO filtering a corresponding co-located lower layer frame area in a lower layer frame temporally coinciding with the at least one upper layer frame area being decoded.

### Claim 64 (depends on 39)

The device of claim 39, configured to infer the second SAO parameters by replacing SAO offsets of the first SAO parameters by determined offsets, and keeping a SAO filter type and, if any, a filter-type-depending sub-parameter of the first SAO parameters, to obtain the second SAO parameters.

### Claim 65 (depends on 64)

The device of claim 64, configured to replace SAO offsets of the first SAO parameters with determined offsets by determining the offsets from all the processed frame areas within a frame part of the processed frame that inherit the same SAO filter type and the same filter-type-depending sub-parameter from first SAO parameters of a lower layer frame.

### Claim 66 (depends on 64)

The device of claim 64, wherein the determined offsets comprise the same predefined set of SAO offsets dedicated for all the processed frame areas within a frame part of the processed frame.

### Claim 67 (depends on 66)

The device of claim 66, wherein the predefined set of offsets equals the four following offsets {1, 0, 0, −1}.

### Claim 68 (depends on 39)

The device of claim 39, wherein the internal enhancement decoder is configured to apply the second SAO filtering to the first processed frame area independently of neighbouring frame areas in the same processed frame.

### Claim 69 (depends on 39)

The device of claim 39, wherein the internal enhancement decoder comprises a restricted number of SAO filtering on the same processed frame area, including the second SAO filtering based on the second SAO parameters.

### Claim 70 (depends on 39)

The device of claim 39, wherein the processed frame includes an upper layer frame reconstructed from the upper layer bitstream during the decoding.

### Claim 71 (depends on 39)

The device of claim 39, wherein the processed frame includes an intermediary frame obtained independently of the upper layer bitstream and used to decode the upper layer frame area.

### Claim 72 (depends on 71)

The device of claim 71, wherein the intermediary frame is constructed using a lower layer frame that temporally coincides with the at least one upper layer frame area being decoded.

### Claim 73 (depends on 72)

The device of claim 72, wherein the intermediary frame is used as a spatial or temporal predictor for the upper layer frame area being decoded.

### Claim 74 (depends on 72)

The device of claim 72, wherein the intermediary frame includes an up-sampled version of a decoded lower layer frame.

### Claim 75 (depends on 72)

The device of claim 72, wherein the intermediary frame mixes frame areas extracted from a decoded lower layer frame and frame areas extracted from reference frames of the upper layer using prediction information from the lower layer.

### Claim 76 (depends on 74)

The device of claim 74 wherein the up-sampling operation allowing obtaining the up-sampled version the decoded lower layer frame is applied on a version of the decoded lower layer frame on which had been applied a SAO filtering using the second SAO parameters.

### Claim 77

A non-transitory computer-readable medium carrying a program which, when executed by a microprocessor or computer system in a device, causes the device to perform a method of encoding or decoding a scalable video sequence made of at least one lower layer and one upper layer, the method comprising:
decoding a lower layer bitstream to obtain first sample adaptive offset, SAO, parameters defining a first SAO filtering applied to at least one lower layer frame area; and
decoding an upper layer bitstream into at least one decoded upper layer frame area, using a second SAO filtering applied to at least one processed frame area of a processed frame based on respective second SAO parameters;
wherein part or all of the second SAO parameters are inferred from the first SAO parameters.