# US 12,192,495 B2 · Scalability using temporal sublayers > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,192,495 B2 - Document ID: US12192495B2 - Status: Granted - Kind: B2 - Application number: 18/013,581 - Filed: 2021-06-30 - Published: 2023-08-03 - Granted: 2025-01-07 - Earliest claimed: 2020-06-30 - Assignees: Telefonaktiebolaget LM Ericsson (publ) - Applicants: Telefonaktiebolaget LM Ericsson (publ) - Inventors: Rickard Sjöberg; Jacob Ström; Martin Pettersson; Mitra Damghanian - Web page: https://patentgrep.com/patent/US12192495B2 ## CPC - H04N 19/30: using hierarchical techniques, e.g. scalability (H04N19/63 takes precedence) - H04N 19/31: in the temporal domain - H04N 19/107: between spatial and temporal predictive coding, e.g. picture refresh - H04N 19/184: the unit being bits, e.g. of the compressed video stream - H04N 19/187: the unit being a scalable video layer - H04N 19/597: specially adapted for multi-view video sequence encoding - H04N 19/70: characterised by syntax aspects related to video coding, e.g. related to compression standards - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract A method and apparatus for decoding and outputting one or more pictures from a bitstream is provided. The method includes obtaining an indication that specifies that the decoder should not output pictures belonging to a temporal layer. The method includes decoding at least one picture from a bitstream wherein picture(s) belong to the temporal layer. The method includes decoding at least one picture from a bitstream wherein picture(s) belong to one temporal layer not equal to. The method includes responsive to receiving the indication, suppressing output of the at least one picture. The method includes outputting the at least one picture. ## Claims ### Claim 1 A method for decoding and outputting one or more pictures from a bitstream, each of the one or more pictures being associated with a temporal layer indicated by a value of a respective temporal layer identifier associated with the picture, the method comprising: obtaining an indication I1 that specifies that the decoder should not output pictures belonging to a temporal layer with identifier value T1; decoding at least one picture P1 from a bitstream wherein picture(s) P1 belong to the temporal layer T1; decoding at least one picture P2 from a bitstream wherein picture(s) P2 belong to one temporal layer with identifier value T2 not equal to T1; responsive to receiving the indication I1, suppressing output of the at least one picture P1; and outputting the at least one picture P2. ### Claim 2 (depends on 1) The method of claim 1 wherein the indication I1 further specifies that the decoder should output pictures belonging to the temporal layer T2. ### Claim 3 (depends on 1) The method of claim 1, wherein all of the at least one picture P1 and the at least one picture P2 belong to one single scalability layer. ### Claim 4 (depends on 1) The method of claim 1, wherein the indication I1 specifies both a temporal layer T1 and a scalability layer S1 and wherein the at least one picture P1 belongs to temporal layer T1 and scalability layer S1. ### Claim 5 (depends on 1) The method of claim 1, wherein the at least one picture P1 is of a lower spatial resolution and the at least one picture P2 is of a higher spatial resolution not equal to the resolution of the at least one picture P1. ### Claim 6 (depends on 1) The method of claim 1, wherein decoding the indication I1 comprises decoding syntax elements to determine a number N temporal layers and decode N flags wherein each flag specifies whether pictures belonging to the corresponding temporal layer are output or not and wherein the flag corresponding to temporal layer T1 specifies that pictures belonging to temporal layer T1 should not be output and the flag corresponding to temporal layer T2 specifies that pictures belonging to temporal layer T2 should be output. ### Claim 7 (depends on 1) The method of claim 1, where the indication I1 is at least in part decoded from a supplemental enhancement information, SEI, message. ### Claim 8 (depends on 1) The method of claim 1, where the indication I1 is at least in part decoded from one or more of a video parameter set, VPS, sequence parameter set, SPS, picture parameter set, PPS, adaptation parameter set, APS, decoding capability information, DCI, picture header or slice header. ### Claim 9 A method for decoding at least two lower spatial resolution pictures A0 and A1 and two corresponding higher spatial resolution pictures B0 and B1 from a bitstream, wherein A0 and B0 share the same content time stamp and A1 and B1 share the same content time stamp, the method comprising: decoding a picture A0 from the bitstream, wherein a temporal ID value equal to A and an output order or timestamp value equal to T0 are decoded from the bitstream for picture A0; decoding a picture B0 from the bitstream, wherein a temporal ID value equal to B and an output order or timestamp value equal to T1 are decoded from the bitstream for picture B0, wherein B represents a higher temporal layer than A, and wherein T1 represents a later output than T0, and wherein picture B0 uses picture A0 for Inter prediction; decoding a picture A1 from the bitstream, wherein a temporal ID value equal to A and an output order or timestamp value equal to T2 are decoded from the bitstream for picture A1, wherein T2 represents a later output than T1, and wherein picture A1 uses picture A0 for Inter prediction; decoding a picture B1 from the bitstream, wherein a temporal ID value equal to B and an output order or timestamp value equal to T3 are decoded from the bitstream for picture B1, wherein T3 represents a later output than T2, and wherein picture B1 uses picture A1 and picture B0 for Inter prediction; and outputting pictures B0 and B1 but not outputting pictures A0 or A1. ### Claim 10 (depends on 9) The method of claim 9 further comprising: decoding scalability layer values from the bitstream for pictures A0, B0, A1, B1 wherein the scalability layer value for all four pictures is the same value. ### Claim 11 An apparatus comprising: processing circuitry; and memory coupled with the processing circuitry, wherein the memory includes instructions that when executed by the processing circuitry causes the apparatus to: obtain an indication I1 that specifies that the decoder should not output pictures belonging to a temporal layer T1; decode at least one picture P1 from a bitstream wherein picture(s) P1 belong to the temporal layer T1; decode at least one picture P2 from a bitstream wherein picture(s) P2 belong to one temporal layer T2 not equal to T1; responsive to receiving the indication I1, suppress output of the at least one picture P1; and output the at least one picture P2. ### Claim 12 (depends on 11) The apparatus of claim 11 wherein the indication I1 further specifies that the decoder should output pictures belonging to the temporal layer T2. ### Claim 13 (depends on 11) The apparatus of claim 11, wherein all of the at least one picture P1 and the at least one picture P2 belong to one single scalability layer. ### Claim 14 (depends on 11) The apparatus of claim 11, wherein the indication I1 specifies both a temporal layer T1 and a scalability layer S1 and wherein the at least one picture P1 belongs to temporal layer T1 and scalability layer S1. ### Claim 15 (depends on 11) The apparatus of claim 11, wherein to decode the indication I1, the memory includes instructions that when executed by the processing circuitry causes the apparatus to: decode syntax elements to determine a number N temporal layers and decode N flags wherein each flag specifies whether pictures belonging to the corresponding temporal layer are output or not and wherein the flag corresponding to temporal layer T1 specifies that pictures belonging to temporal layer T1 should not be output and the flag corresponding to temporal layer T2 specifies that pictures belonging to temporal layer T2 should be output. ### Claim 16 (depends on 11) The apparatus of claim 11, wherein to obtain the indication I1, the memory includes instructions that when executed by the processing circuitry causes the apparatus to decode the indication I1 at least in part from a supplemental enhancement information, SEI, message. ### Claim 17 (depends on 11) The apparatus of claim 11, wherein to obtain the indication I1, the memory includes instructions that when executed by the processing circuitry causes the apparatus to decode the indication I1 at least in part from one or more of a video parameter set, VPS, sequence parameter set, SPS, picture parameter set, PPS, adaptation parameter set, APS, decoding capability information, DCI, picture header or slice header. ### Claim 18 An apparatus comprising: processing circuitry; and memory coupled with the processing circuitry, wherein the memory includes instructions that when executed by the processing circuitry causes the apparatus to: decode a picture A0 from the bitstream, wherein a temporal ID value equal to A and an output order or timestamp value equal to T0 are decoded from the bitstream for picture A0; decode a picture B0 from the bitstream, wherein a temporal ID value equal to B and an output order or timestamp value equal to T1 are decoded from the bitstream for picture B0, wherein B represents a higher temporal layer than A, and wherein T1 represents a later output than T0, and wherein picture B0 uses picture A0 for Inter prediction; decode a picture A1 from the bitstream, wherein a temporal ID value equal to A and an output order or timestamp value equal to T2 are decoded from the bitstream for picture A1, wherein T2 represents a later output than T1, and wherein picture A1 uses picture A0 for Inter prediction; decode a picture B1 from the bitstream, wherein a temporal ID value equal to B and an output order or timestamp value equal to T3 are decoded from the bitstream for picture B1, wherein T3 represents a later output than T2, and wherein picture B1 uses picture A1 and picture B0 for Inter prediction; and output pictures B0 and B1 but not output pictures A0 or A1. ### Claim 19 (depends on 18) The apparatus of claim 18, wherein the memory includes further instructions that when executed by the processing circuitry causes the apparatus to: decode scalability layer values from the bitstream for pictures A0, B0, A1, B1 wherein the scalability layer value for all four pictures is the same value. ### Claim 20 (depends on 1) A computer program product comprising a non-transitory storage medium including program code to be executed by processing circuitry of a communication device, whereby execution of the program code causes the communication device to perform operations according to claim 1.