# US 2015/0103926 A1 · Video encoding and decoding

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2015/0103926 A1
- Document ID: US20150103926A1
- Status: Published application
- Kind: A1
- Application number: 14/514,044
- Filed: 2014-10-14
- Published: 2015-04-16
- Earliest claimed: 2013-10-15
- Assignees: Nokia Corporation
- Applicants: Nokia Corporation
- Inventors: Miska Matias Hannuksela
- Web page: https://patentgrep.com/patent/US20150103926A1

## CPC

- H04N 19/597: specially adapted for multi-view video sequence encoding
- H04N 19/119: Adaptive subdivision aspects, e.g. subdivision of a picture into rectangular or non-rectangular coding blocks
- H04N 19/127: Prioritisation of hardware or computational resources
- H04N 19/159: Prediction type, e.g. intra-frame, inter-frame or bidirectional frame prediction
- H04N 19/187: the unit being a scalable video layer
- H04N 19/30: using hierarchical techniques, e.g. scalability (H04N19/63 takes precedence)
- H04N 19/70: characterised by syntax aspects related to video coding, e.g. related to compression standards
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

There are disclosed various methods, apparatuses and computer program products for video encoding. In some embodiments pictures are encoded into a bitstream. The bitstream comprises at least two scalability layers and pictures being associated with access units. A first indication and a second indication are encoded into the bitstream. The first indication is configured to indicate an output layer. And the second indication is configured to indicate at least one alternative output layer. A first picture of said at least one alternative output layer is output by a decoding process of the bitstream when no picture of the output layer is in an access unit containing said first picture of said at least one alternative output layer.

## Claims

### Claim 1

A method comprising:
decoding pictures from a bitstream, the bitstream comprising at least two scalability layers;
storing decoded pictures in a decoded picture buffer;
decoding from the bitstream that a first picture is a base-layer picture used in initiating a layer-wise start-up process;
decoding from the bitstream a syntax element of the first picture, the syntax element controlling whether or not to output pictures preceding, in decoding order, the first picture; and
in response to the syntax element controlling not to output, removing, from the decoded picture buffer, those pictures in all layers that precede the first picture in decoding order.

### Claim 2 (depends on 1)

A method according to claim 1, further comprising:
decoding, from the bitstream, information on output layer sets of the bitstream, wherein an output layer set specifies layers that are output;
selecting a target output layer set for decoding;
decoding, from the bitstream, a picture-specific output indication for each decoded picture preceding, in decoding order, the first picture;
in response to the syntax element controlling to output, outputting those pictures that precede the first picture in decoding order, are in layers that are output in the target output layer set, and which the picture-specific output indication indicates to be output.

### Claim 3 (depends on 1)

A method according to claim 1, wherein pictures are associated with access units and the method further comprises:
decoding from the bitstream, information on output layer sets of the bitstream, wherein an output layer set specifies layers that are output;
selecting a target output layer set for decoding;
decoding, from the bitstream, a picture-specific output indication for each decoded picture preceding in decoding order, the first picture;
in response to the syntax element controlling to output, outputting picture from access units that precede the first picture in decoding order which the picture-specific output indication indicates to be output and that are either in layers that are output or, when an access unit lacks a picture in a layer that is output, in the at least one alternative output layer.

### Claim 4 (depends on 1)

A method according to claim 1, wherein
information on output layer sets of the bitstream is decoded from a video parameter set.

### Claim 5 (depends on 1)

A method according to claim 1, wherein
said decoding from the bitstream that a first picture is a base-layer picture used in initiating a layer-wise start-up process comprises:
decoding that the first picture is one broken link access picture, an instantaneous decoding refresh picture specifically marked to initiate a layer-wise start-up process, or any intra random access point picture for which information is received that it initiates a layer-wise start-up process; and
decoding a layer identifier of the first picture indicating the base layer.

### Claim 6 (depends on 1)

A method according to claim 1, wherein
said decoding from the bitstream a syntax element of the first picture comprises:
decoding no_output_of prior_pics_flag syntax element from at least one slice header of the first picture.

### Claim 7

A method comprising,
determining for a first picture is a base-layer picture used in initiating a layer-wise start-up process whether or not to output pictures preceding, in decoding order, the first picture;
including into a bitstream a syntax element of the first picture, the bitstream comprising pictures of at least two scalability layers and the syntax element controlling whether or not to output pictures preceding, in decoding order, the first picture, wherein the syntax element controls the output of pictures of all layers.

### Claim 8 (depends on 7)

A method according to claim 7, wherein
information on output layer sets of the bitstream is included into a video parameter set.

### Claim 9 (depends on 7)

A method according to claim 7, wherein
said determining for a first picture is a base-layer picture used in initiating a layer-wise start-up process comprises:
determining that the first picture is one broken link access picture, an instantaneous decoding refresh picture specifically marked to initiate a layer-wise start-up process, or any intra random access point picture for which information is received that it initiates a layer-wise start-up process; and
determining a layer identifier of the first picture indicating the base layer.

### Claim 10 (depends on 7)

A method according to claim 7, wherein
said including into the bitstream a syntax element of the first picture comprises:
encoding no_output_of_prior_pics_flag syntax element to at least one slice header of the first picture.

### Claim 11

An apparatus comprising at least one processor and at least one memory, said at least one memory stored with code thereon, which when executed by said at least one processor, causes an apparatus to perform at least the following:
decode pictures from a bitstream, the bitstream comprising at least two scalability layers;
store decoded pictures in a decoded picture buffer;
decode from the bitstream that a first picture is a base-layer picture used in initiating a layer-wise start-up process;
decode from the bitstream a syntax element of the first picture, the syntax element controlling whether or not to output pictures preceding, in decoding order, the first picture; and
in response to the syntax element controlling not to output, remove, from the decoded picture buffer, those pictures in all layers that precede the first picture in decoding order.

### Claim 12 (depends on 11)

An apparatus according to claim 11, wherein said at least one memory stored with code thereon, which when executed by said at least one processor, causes the apparatus to
decode, from the bitstream, information on output layer sets of the bitstream, wherein an output layer set specifies layers that are output;
select a target output layer set for decoding;
decode, from the bitstream, a picture-specific output indication for each decoded picture preceding, in decoding order, the first picture;
in response to the syntax element controlling to output, output those pictures that precede the first picture in decoding order, are in layers that are output in the target output layer set, and which the picture-specific output indication indicates to be output.

### Claim 13 (depends on 11)

An apparatus according to claim 11, wherein pictures are associated with access units and wherein said at least one memory stored with code thereon, which when executed by said at least one processor, causes the apparatus to:
decode from the bitstream, information on output layer sets of the bitstream, wherein an output layer set specifies layers that are output;
select a target output layer set for decoding;
decode, from the bitstream, a picture-specific output indication for each decoded picture preceding in decoding order, the first picture;
in response to the syntax element controlling to output, output picture from access units that precede the first picture in decoding order which the picture-specific output indication indicates to be output and that are either in layers that are output or, when an access unit lacks a picture in a layer that is output, in the at least one alternative output layer.

### Claim 14 (depends on 11)

An apparatus according to claim 11, wherein
information on output layer sets of the bitstream is decoded from a video parameter set.

### Claim 15 (depends on 11)

An apparatus according to claim 11, wherein said at least one memory stored with code thereon, which when executed by said at least one processor, causes the apparatus to
decode from the bitstream that a first picture is a base-layer picture used in initiating a layer-wise start-up process by
decoding that the first picture is one broken link access picture, an instantaneous decoding refresh picture specifically marked to initiate a layer-wise start-up process, or any intra random access point picture for which information is received that it initiates a layer-wise start-up process; and
decoding a layer identifier of the first picture indicating the base layer.

### Claim 16 (depends on 11)

An apparatus according to claim 11, wherein
said decoding from the bitstream a syntax element of the first picture comprises:
decoding no_output_of prior_pics_flag syntax element from at least one slice header of the first picture.

### Claim 17

An apparatus comprising at least one processor and at least one memory, said at least one memory stored with code thereon, which when executed by said at least one processor, causes an apparatus to perform at least the following:
determine for a first picture is a base-layer picture used in initiating a layer-wise start-up process whether or not to output pictures preceding, in decoding order, the first picture;
include into a bitstream a syntax element of the first picture, the bitstream comprising pictures of at least two scalability layers and the syntax element controlling whether or not to output pictures preceding, in decoding order, the first picture, wherein the syntax element controls the output of pictures of all layers.

### Claim 18 (depends on 17)

An apparatus according to claim 17, wherein
information on output layer sets of the bitstream is included into a video parameter set.

### Claim 19 (depends on 17)

An apparatus according to claim 17, wherein said at least one memory stored with code thereon, which when executed by said at least one processor, causes the apparatus to determine for a first picture is a base-layer picture used in initiating a layer-wise start-up process by
determining that the first picture is one broken link access picture, an instantaneous decoding refresh picture specifically marked to initiate a layer-wise start-up process, or any intra random access point picture for which information is received that it initiates a layer-wise start-up process; and
determining a layer identifier of the first picture indicating the base layer.

### Claim 20 (depends on 17)

An apparatus according to claim 17, wherein
said including into the bitstream a syntax element of the first picture comprises:
encoding no_output_of_prior_pics_flag syntax element to at least one slice header of the first picture.

### Claim 21

A computer program product embodied on a non-transitory computer readable medium, comprising computer program code configured to, when executed on at least one processor, cause an apparatus or a system to:
decode pictures from a bitstream, the bitstream comprising at least two scalability layers;
store decoded pictures in a decoded picture buffer;
decode from the bitstream that a first picture is a base-layer picture used in initiating a layer-wise start-up process;
decode from the bitstream a syntax element of the first picture, the syntax element controlling whether or not to output pictures preceding, in decoding order, the first picture; and
in response to the syntax element controlling not to output, remove, from the decoded picture buffer, those pictures in all layers that precede the first picture in decoding order.

### Claim 22

A computer program product embodied on a non-transitory computer readable medium, comprising computer program code configured to, when executed on at least one processor, cause an apparatus or a system to:
determine for a first picture is a base-layer picture used in initiating a layer-wise start-up process whether or not to output pictures preceding, in decoding order, the first picture;
include into a bitstream a syntax element of the first picture, the bitstream comprising pictures of at least two scalability layers and the syntax element controlling whether or not to output pictures preceding, in decoding order, the first picture, wherein the syntax element controls the output of pictures of all layers.
