Multi-Layer Video Stream Encoding and Decoding
AssigneeTelefonaktiebolaget L M Ericsson (publ)
InventorThomas Rusert
Life of this patent
Estimating the term…
Abstract
Multi-layer dependencies are signaled in an efficient way for a multi-view video stream (1). Coding or decoding relationship information defining coding or decoding dependencies is represented in bit-efficient syntax code, preferably through usage of hierarchical layer dependencies using layer indices for representing layer dependencies.
Claims26
1-25. (canceled)
A method, in a processing circuit, of determining a decoding relationship for a digitally coded multi-layer video stream defining multiple layers of pictures, said method comprising:
- retrieving, based on said digitally coded multi-layer video stream, at least one direct decoding flag indicating a direct coding relationship between a layer with layer index i of said multiple layers and a layer with layer index j of said multiple layers, where i is not equal to j;
- and
- determining information defining any decoding relationship between said multiple layers based on said at least one direct decoding flag.
A method, in a processing circuit, of decoding a digitally coded multi-layer video stream defining multiple layers of pictures, each layer of said multiple layers having a respective layer identifier, said method comprising:
- retrieving, for a layer with a layer index of said multiple layers, decoding relationship information based on said digitally coded multi-layer video stream, said decoding relationship information defining a respective layer index of any reference layer of said multiple layers on which said layer directly depends;
- mapping, for each reference layer and for said layer, its layer index to a layer identifier based on mapping information of a hierarchical mapping relationship between layer identifiers and layer indices, wherein said mapping information is retrieved based on said digitally coded multi-layer video stream;
- and
- decoding a picture of said layer based on at least one previously decoded picture in a layer of said multiple layers identified based on said layer identifiers mapped from layer indices.
A device for determining decoding relationship for a digitally coded multi-layer video stream defining multiple layers of pictures, said device comprising:
- a flag retriever configured to retrieve, based on said coded multi-layer video stream, at least one direct decoding flag indicating a direct coding relationship between a layer with layer index i of said multiple layers and a layer with layer index j of said multiple layers, where i is not equal to j;
- and
- an information determiner configured to determine information defining any decoding relationship between said multiple layers based on said at least one direct decoding flag.
A device for determining a decoding relationship for a digitally coded multi-layer video stream defining multiple layers of pictures, said device comprising a non-transitory computer readable medium and an associated processor configured to process computer program instructions stored in the computer readable medium, wherein the stored computer program instructions, when run on said processor, are configured to cause the processor to:
- retrieve, based on said coded multi-layer video stream, at least one direct decoding flag indicating a direct coding relationship between a layer with layer index i of said multiple layers and a layer with layer index j of said multiple layers, where i is not equal to j;
- and
- determine information defining any decoding relationship between said multiple layers based on said at least one direct decoding flag.
A decoder device configured to decode a coded multi-layer video stream defining multiple layers of pictures, each layer of said multiple layers having a respective layer identifier, said decoder comprising:
- a decoding relationship information retriever configured to retrieve, for a layer with a layer index of said multiple layers, decoding relationship information based on said coded multi-layer video stream, said decoding relationship information defining a respective layer index of any reference layer of said multiple layers, on which said layer directly depends;
- an index-to-identifier mapping unit configured to map, for each reference layer and for said layer, its layer index to a layer identifier based on mapping information of a hierarchical mapping relationship between layer identifiers and layer indices, said mapping information is retrieved based on said coded multi-layer video stream;
- and
- a decoding unit configured to decode a picture of said layer based on at least one previously decoded picture in a layer of said multiple layers identified based on said layer identifiers mapped from layer indices.
A decoder device configured to decode a coded multi-layer video stream defining multiple layers of pictures, each layer of said multiple layers having a respective layer identifier, said decoder comprising a non-transitory computer readable medium and an associated processor configured to process computer program instructions stored in the computer readable medium, wherein the stored computer program instructions, when run on said processor, are configured to cause the processor to:
- retrieve, for a layer with a layer index of said multiple layers, decoding relationship information based on said coded multi-layer video stream, said decoding relationship information defining a respective layer index of any reference layer of said multiple layers, on which said layer directly depends;
- map, for each reference layer and for said layer, its layer index to a layer identifier based on mapping information of a hierarchical mapping relationship between layer identifiers and layer indices, said mapping information is retrieved based on said coded multi-layer video stream;
- and
- decode a picture of said layer based on at least one previously decoded picture in a layer of said multiple layers identified based on said layer identifiers mapped from layer indices.
A method of determining coding relationship for a multi-layer video stream defining multiple layers of pictures, said method comprising:
- determining any coding relationship between said multiple layers;
- determining, for a layer with layer index i of said multiple layers and based on said coding relationship, at least one direct decoding flag indicating a direct coding relationship between said layer with layer index i and a layer with layer index j of said multiple layers, where i is not equal to j;
- and
- associating said at least one direct decoding flag with a coded representation of said multi-layer video stream.
A method of encoding a multi-layer video stream defining multiple layers of pictures, each layer of said multiple layers having a respective layer identifier, said method comprises:
- hierarchically mapping, for each layer of said multiple layers a layer identifier of said layer to a layer index based on coding dependencies between said multiple layers;
- determining coding relationship information defining a respective layer index of any reference layer of said multiple layers, on which a layer of said multiple layers directly depends;
- generating a coded multi-layer video stream by encoding said pictures of said multiple layers based on said coding dependencies;
- and
- associating said coding relationship information with said coded multi-layer video stream.
A device for determining a coding relationship for a multi-layer video stream defining multiple layers of pictures, said device comprising:
- a relationship determiner configured to determine any coding relationship between said multiple layers;
- a flag determiner configured to determine, for a layer with layer index i of said multiple layers and based on said coding relationship, at least one direct decoding flag indicating a direct coding relationship between said layer with layer index i and a layer with layer index j of said multiple layers, where i is not equal to j;
- and
- an associating unit configured to associate said at least one direct decoding flag with a coded representation of said multi-layer video stream.
A device for determining a coding relationship for a multi-layer video stream defining multiple layers of pictures, said device comprising a non-transitory computer readable medium and an associated processor configured to process computer program instructions stored in the computer readable medium, wherein the stored computer program instructions, when run on said processor, are configured to cause the processor to:
- determine any coding relationship between said multiple layers;
- determine, for a layer with layer index i of said multiple layers and based on said coding relationship, at least one direct decoding flag indicating a direct coding relationship between said layer with layer index i and a layer with layer index j of said multiple layers, where i is not equal to j;
- and
- associate said at least one direct decoding flag with a coded representation of said multi-layer video stream.
An encoder device configured to digitally encode a multi-layer video stream defining multiple layers of pictures, each layer of said multiple layers having a respective layer identifier, said encoder device comprising:
- a mapping unit configured to hierarchically map, for each layer of said multiple layers, a layer identifier of said layer to a layer index based on coding dependencies between said multiple layers;
- an information determiner configured to determine coding relationship information defining a respective layer index of any reference layer of said multiple layers, on which a layer of said multiple layers directly depends;
- an encoding unit configured to generate a coded multi-layer video stream by encoding said pictures of said multiple layers based on said coding dependencies;
- and
- an associating unit configured to associate said coding relationship information with said coded multi-layer video stream.
An encoder device configured to encode a multi-layer video stream defining multiple layers of pictures, each layer of said multiple layers having a respective layer identifier, said encoder comprising a non-transitory computer readable medium and an associated processor configured to process computer program instructions stored in the computer readable medium, wherein the stored computer program instructions, when run on said processor, are configured to cause the processor to:
- hierarchically map, for each layer of said multiple layers, a layer identifier of said layer to a layer index based on coding dependencies between said multiple layers;
- determine coding relationship information defining a respective layer index of any reference layer of said multiple layers, on which a layer of said multiple layers directly depends;
- generate a coded multi-layer video stream by encoding said pictures of said multiple layers based on said coding dependencies;
- and
- associate said coding relationship information with said coded multi-layer video stream.
Dependencies are inferred from the claim text.