Decoded picture buffer management
AssigneeVelos Media, LLC
InventorsYe-Kui Wang, Ying Chen
Life of this patent
Estimating the term…
Abstract
Techniques are described related to output and removal of decoded pictures from a decoded picture buffer (DPB). The example techniques may remove a decoded picture from the DPB prior to coding a current picture. For instance, the example techniques may remove the decoded picture if that decoded picture is not identified in the reference picture set of the current picture.
Claims17
A method for coding video data, the method comprising:
- coding information indicative of reference pictures that belong to a reference picture set, wherein the reference picture set identifies the reference pictures that can potentially be used for inter-predicting a current picture and can potentially be used for inter-predicting one or more pictures following the current picture in decoding order;
- constructing a plurality of reference picture subsets that each identifies zero or more of the reference pictures of the reference picture set, wherein the plurality of reference picture subsets comprises:
- a first reference picture subset that identifies short-term reference pictures that are prior to the current picture in decoding order and prior to the current picture in output order and that can potentially be used for inter-predicting the current picture and one or more of the one or more pictures following the current picture in decoding order;
- a second reference picture subset that identifies short-term reference pictures that are prior to the current picture in decoding order and subsequent to the current picture in output order and that can potentially be used for inter-predicting the current picture and one or more of the one or more pictures following the current picture in decoding order;
- and
- a third reference picture subset that identifies long-term reference pictures that are prior to the current picture in decoding order and that can potentially be used for inter-predicting the current picture and one or more of the one or more pictures following the current picture in decoding order;
- adding reference pictures from the first reference picture subset, the second reference picture subset, and the third reference picture subset into a first set of entries in a first reference picture list;
- determining that a number of entries in the first reference picture list is not equal to a maximum number of allowable entries in the first reference picture list after adding reference pictures from the first reference picture subset, the second reference picture subset, and the third reference picture subset into the first set of entries in the first reference picture list;
- in response to determining that the number of entries in the first reference picture list is not equal to the maximum number of allowable entries in the first reference picture list, repeatedly re-adding one or more reference pictures from at least one of the reference picture subsets into entries in the first reference picture list that are subsequent to the first set of entries until the number of entries in the first reference picture list is equal to the maximum number of allowable entries in the first reference picture list;
- adding reference pictures from the first reference picture subset, the second reference picture subset, and the third reference picture subset into a first set of entries in a second reference picture list;
- determining that a number of entries in the second reference picture list is not equal to a maximum number of allowable entries in the second reference picture list after adding reference pictures from the first reference picture subset, the second reference picture subset, and the third reference picture subset into the first set of entries in the second reference picture list;
- in response to determining that the number of entries in the second reference picture list is not equal to the maximum number of allowable entries in the second reference picture list, repeatedly re-adding one or more reference pictures from at least one of the reference picture subsets into entries in the second reference picture list that are subsequent to the first set of entries until the number of entries in the second reference picture list is equal to the maximum number of allowable entries in the second reference picture list;
- and
- coding the current picture based on the first reference picture list and the second reference picture list.
A device for coding video data, the device comprising a video coder configured to:
- code information indicative of reference pictures that belong to a reference picture set, wherein the reference picture set identifies the reference pictures that can potentially be used for inter-predicting a current picture and can potentially be used for inter-predicting one or more pictures following the current picture in decoding order;
- construct a plurality of reference picture subsets that each identifies zero or more of the reference pictures of the reference picture set, wherein the plurality of reference picture subsets comprises:
- a first reference picture subset that identifies short-term reference pictures that are prior to the current picture in decoding order and prior to the current picture in output order and that can potentially be used for inter-predicting the current picture and one or more of the one or more pictures following the current picture in decoding order;
- a second reference picture subset that identifies short-term reference pictures that are prior to the current picture in decoding order and subsequent to the current picture in output order and that can potentially be used for inter-predicting the current picture and one or more of the one or more pictures following the current picture in decoding order;
- and
- a third reference picture subset that identifies long-term reference pictures that are prior to the current picture in decoding order and that can potentially be used for inter-predicting the current picture and one or more of the one or more pictures following the current picture in decoding order;
- add reference pictures from the first reference picture subset, the second reference picture subset, and the third reference picture subset into a first set of entries in a first reference picture list;
- determine that a number of entries in the first reference picture list is not equal to a maximum number of allowable entries in the first reference picture list after adding reference pictures from the first reference picture subset, the second reference picture subset, and the third reference picture subset into the first set of entries in the first reference picture list;
- in response to determining that the number of entries in the first reference picture list is not equal to the maximum number of allowable entries in the first reference picture list, repeatedly re-add one or more reference pictures from at least one of the reference picture subsets into entries in the first reference picture list that are subsequent to the first set of entries until the number of entries in the first reference picture list is equal to the maximum number of allowable entries in the first reference picture list;
- add reference pictures from the first reference picture subset, the second reference picture subset, and the third reference picture subset into a first set of entries in a second reference picture list;
- determine that a number of entries in the second reference picture list is not equal to a maximum number of allowable entries in the second reference picture list after adding reference pictures from the first reference picture subset, the second reference picture subset, and the third reference picture subset into the first set of entries in the second reference picture list;
- in response to determining that the number of entries in the second reference picture list is not equal to the maximum number of allowable entries in the second reference picture list, repeatedly re-add one or more reference pictures from at least one of the reference picture subsets into entries in the second reference picture list that are subsequent to the first set of entries until the number of entries in the second reference picture list is equal to the maximum number of allowable entries in the second reference picture list;
- and
- code the current picture based on the first reference picture list and the second reference picture list.
A non-transitory computer-readable storage medium having stored thereon instructions that, when executed, cause a processor of a device for coding video data to:
- code information indicative of reference pictures that belong to a reference picture set, wherein the reference picture set identifies the reference pictures that can potentially be used for inter-predicting a current picture and can potentially be used for inter-predicting one or more pictures following the current picture in decoding order;
- construct a plurality of reference picture subsets that each identifies zero or more of the reference pictures of the reference picture set, wherein the plurality of reference picture subsets comprises:
- a first reference picture subset that identifies short-term reference pictures that are prior to the current picture in decoding order and prior to the current picture in output order and that can potentially be used for inter-predicting the current picture and one or more of the one or more pictures following the current picture in decoding order;
- a second reference picture subset that identifies short-term reference pictures that are prior to the current picture in decoding order and subsequent to the current picture in output order and that can potentially be used for inter-predicting the current picture and one or more of the one or more pictures following the current picture in decoding order;
- and
- a third reference picture subset that identifies long-term reference pictures that are prior to the current picture in decoding order and that can potentially be used for inter-predicting the current picture and one or more of the one or more pictures following the current picture in decoding order;
- add reference pictures from the first reference picture subset, the second reference picture subset, and the third reference picture subset into a first set of entries in a first reference picture list;
- determine that a number of entries in the first reference picture list is not equal to a maximum number of allowable entries in the first reference picture list after adding reference pictures from the first reference picture subset, the second reference picture subset, and the third reference picture subset into the first set of entries in the first reference picture list;
- in response to determining that the number of entries in the first reference picture list is not equal to the maximum number of allowable entries in the first reference picture list, repeatedly re-add one or more reference pictures from at least one of the reference picture subsets into entries in the first reference picture list that are subsequent to the first set of entries until the number of entries in the first reference picture list is equal to the maximum number of allowable entries in the first reference picture list;
- add reference pictures from the first reference picture subset, the second reference picture subset, and the third reference picture subset into a first set of entries in a second reference picture list;
- determine that a number of entries in the second reference picture list is not equal to a maximum number of allowable entries in the second reference picture list after adding reference pictures from the first reference picture subset, the second reference picture subset, and the third reference picture subset into the first set of entries in the second reference picture list;
- in response to determining that the number of entries in the second reference picture list is not equal to the maximum number of allowable entries in the second reference picture list, repeatedly re-add one or more reference pictures from at least one of the reference picture subsets into entries in the second reference picture list that are subsequent to the first set of entries until the number of entries in the second reference picture list is equal to the maximum number of allowable entries in the second reference picture list;
- and
- code the current picture based on the first reference picture list and the second reference picture list.
A device for coding video data, the device comprising
- means for coding information indicative of reference pictures that belong to a reference picture set, wherein the reference picture set identifies the reference pictures that can potentially be used for inter-predicting a current picture and can potentially be used for inter-predicting one or more pictures following the current picture in decoding order;
- means for constructing a plurality of reference picture subsets that each identifies zero or more of the reference pictures of the reference picture set, wherein the plurality of reference picture subsets comprises:
- a first reference picture subset that identifies short-term reference pictures that are prior to the current picture in decoding order and prior to the current picture in output order and that can potentially be used for inter-predicting the current picture and one or more of the one or more pictures following the current picture in decoding order;
- a second reference picture subset that identifies short-term reference pictures that are prior to the current picture in decoding order and subsequent to the current picture in output order and that can potentially be used for inter-predicting the current picture and one or more of the one or more pictures following the current picture in decoding order;
- and
- a third reference picture subset that identifies long-term reference pictures that are prior to the current picture in decoding order and that can potentially be used for inter-predicting the current picture and one or more of the one or more pictures following the current picture in decoding order;
- means for adding reference pictures from the first reference picture subset, the second reference picture subset, and the third reference picture subset into a first set of entries in a first reference picture list;
- means for determining that a number of entries in the first reference picture list is not equal to a maximum number of allowable entries in the first reference picture list after adding reference pictures from the first reference picture subset, the second reference picture subset, and the third reference picture subset into the first set of entries in the first reference picture list;
- means for repeatedly re-adding, in response to determining that the number of entries in the first reference picture list is not equal to the maximum number of allowable entries in the first reference picture list, one or more reference pictures from at least one of the reference picture subsets into entries in the first reference picture list that are subsequent to the first set of entries until the number of entries in the first reference picture list is equal to the maximum number of allowable entries in the first reference picture list;
- means for adding reference pictures from the first reference picture subset, the second reference picture subset, and the third reference picture subset into a first set of entries in a second reference picture list;
- means for determining that a number of entries in the second reference picture list is not equal to a maximum number of allowable entries in the second reference picture list after adding reference pictures from the first reference picture subset, the second reference picture subset, and the third reference picture subset into the first set of entries in the second reference picture list;
- means for repeatedly re-adding, in response to determining that the number of entries in the second reference picture list is not equal to the maximum number of allowable entries in the second reference picture list, one or more reference pictures from at least one of the reference picture subsets into entries in the second reference picture list that are subsequent to the first set of entries until the number of entries in the second reference picture list is equal to the maximum number of allowable entries in the second reference picture list;
- and
- means for coding the current picture based on the first reference picture list and the second reference picture list.
Dependencies are inferred from the claim text.