Back to results
US 10,542,288 B2Granted
Random access in a video bitstream
AssigneeTelefonaktiebolaget LM Ericsson (publ)
InventorsMartin Pettersson, Jonatan Samuelsson, Rickard Sjöberg, Jacob Ström, Ruoyang Yu
Life of this patent
Estimating the term…
Abstract
The present embodiments introduce a new type of random access point in video bitstreams that can be used for random access operations but can be represented in encoded form at a lower bit-cost as compared to IRAP pictures. The random access point is a dependent random access point (DRAP) picture that is encoded and decoded using an IRAP picture as sole reference picture for the DRAP picture. The DRAP picture is encoded as a trailing picture that may be used for reference and constitutes a random access point in a video bitstream.
Claims40
A method for performing a random access operation in a video bitstream, comprising:
- obtaining a first dependent random access point, DRAP picture, wherein said first DRAP picture is encoded as a trailing picture for use as a reference and constitutes a random access point in said video bitstream and is encoded to solely reference a preceding intra random access point, TRAP, picture of said video bitstream;
- obtaining a second DRAP picture encoded as a trailing picture for use as a reference and constitutes a random access point in said video bitstream and is encoded to solely reference said preceding IRAP picture of said video bitstream, said first DRAP picture preceding said second DRAP picture in said video bitstream;
- obtaining said preceding IRAP picture of said video bitstream;
- decoding said preceding IRAP picture;
- decoding at least one of said first DRAP picture using said preceding IRAP picture as sole reference picture for said first DRAP picture and said second DRAP picture using said preceding IRAP picture as sole reference picture for said second DRAP picture;
- and
- performing a random access operation at one of said decoded first DRAP picture or said decoded second DRAP picture.
4 more elements
A video communication method comprising:
- transmitting a video bitstream comprising at least one intra random access point, IRAP, picture on a communication channel to a user client device;
- receiving a feedback message on a feedback channel from said user client device, said feedback message indicating a position within said video bitstream corresponding to a corrupt or missing picture at said user client device;
- encoding, based on said feedback message, a first dependent random access point, DRAP, picture using a previous IRAP picture in said video bitstream as sole reference picture for said first DRAP picture, said first DRAP picture is encoded as a trailing picture for use as a reference and constitutes a random access point in said video bitstream;
- encoding, based on said feedback message, a second DRAP picture using said previous IRAP picture in said video bitstream as sole reference picture for said second DRAP picture, said second DRAP picture is encoded as a trailing picture for use as a reference and constitutes a random access point in said video bitstream;
- and
- transmitting said first and second DRAP pictures to said user client device, wherein said first DRAP pictures precedes said second DRAP picture in said video bitstream.
3 more elements
A user client device comprising:
- a processor, when executing instructions stored in a memory of the user client device, is operative to:
- obtain a first dependent random access point, DRAP, picture, said first DRAP picture is encoded as a trailing picture that may be used for reference and constitutes a random access point in said video bitstream;
- obtain a second DRAP picture encoded as a trailing picture for use as a reference and constitutes a random access point in said video bitstream and is encoded to solely reference said preceding IRAP picture of said video bitstream, said first DRAP picture preceding said second DRAP picture in said video bitstream;
- obtain said preceding IRAP picture of said video bitstream;
- decode said IRAP picture;
- decode at least one of said first DRAP picture using said preceding IRAP picture as sole reference picture for said first DRAP picture and said second DRAP picture using said preceding IRAP picture as sole reference picture for said second DRAP picture;
- and
- perform a random access operation at one of said first decoded DRAP picture or said decoded second DRAP picture.
5 more elements
A user client device comprising processing circuity configured to:
- obtain a first dependent random access point, DRAP picture, wherein said first DRAP picture is encoded as a trailing picture for use as a reference and constitutes a random access point in said video bitstream and is encoded to solely reference a preceding intra random access point, IRAP, picture of said video bitstream;
- obtain second DRAP picture encoded as a trailing picture for use as a reference and constitutes a random access point in said video bitstream and is encoded to solely reference said preceding IRAP picture of said video bitstream, said first DRAP picture preceding said second DRAP picture in said video bitstream;
- decode said preceding IRAP picture;
- decode at least one of said first DRAP picture using said preceding IRAP picture as sole reference picture for said first DRAP picture and said second DRAP picture using said preceding IRAP picture as sole reference picture for said second DRAP picture;
- and
- perform a random access operation at one of said first decoded DRAP picture or said decoded second DRAP picture.
3 more elements
A video communication server, comprising:
- a processor, when executing instructions stored in a memory of the video communication server, is operative to:
- transmit a video bitstream comprising at least one intra random access point, IRAP, picture on a communication channel to a user client device;
- receive a feedback message on a feedback channel from said user client device, said feedback message indicating a position within said video bitstream corresponding to a corrupt or missing picture at said user client device;
- encode, based on said feedback message, a first dependent random access point, DRAP, picture using a previous IRAP picture in said video bitstream as sole reference picture for said first DRAP picture, said first DRAP picture is encoded as a trailing picture for use as a reference and constitutes a random access point in said video bitstream;
- encode, based on said feedback message, a second DRAP picture using said previous IRAP picture in said video bitstream as sole reference picture for said second DRAP picture, said second DRAP picture is encoded as a trailing picture for use as a reference and constitutes a random access point in said video bitstream;
- and
- transmit said first and second DRAP pictures to said user client device on the communication channel, wherein said first DRAP pictures precedes said second DRAP picture in said video bitstream.
4 more elements
A video communication server, comprising:
- a transmitter that transmits a video bitstream comprising at least one intra random access point, TRAP, picture on a communication channel to a user client device;
- a receiver that receives a feedback message on a feedback channel from said user client device, said feedback message indicating a position within said video bitstream corresponding to a corrupt or missing picture at said user client device;
- and
- an encoder that encodes, based on said feedback message:
- a first dependent random access point, DRAP, picture using a previous IRAP picture in said video bitstream as sole reference picture for said first DRAP picture, said DRAP picture is encoded as a trailing picture for use as a reference and constitutes a random access point in said video bitstream, wherein said transmitter also transmits said first DRAP picture to said user client device;
- and
- a second dependent random access point, DRAP, picture using said previous IRAP picture in said video bitstream as sole reference picture for said second DRAP picture, said DRAP picture is encoded as a trailing picture for use as a reference and constitutes a random access point in said video bitstream, wherein said transmitter also transmits said second DRAP picture to said user client device, wherein said first DRAP pictures precedes said second DRAP picture in said video bitstream.
4 more elements
A computer program product comprising instructions stored on a non-transitory computer-readable medium, which when executed by a processor, causes said processor to:
- obtain a first dependent random access point, DRAP picture, wherein said first DRAP picture is encoded as a trailing picture for use as a reference and constitutes a random access point in said video bitstream and is encoded to solely reference a preceding intra random access point, TRAP, picture of said video bitstream;
- obtain second DRAP picture encoded as a trailing picture for use as a reference and constitutes a random access point in said video bitstream and is encoded to solely reference said preceding IRAP picture of said video bitstream, said first DRAP picture preceding said second DRAP picture in said video bitstream;
- obtain said preceding IRAP picture of said video bitstream;
- decode said preceding IRAP picture;
- decode at least one of said first DRAP picture using said preceding IRAP picture as sole reference picture for said first DRAP picture and said second DRAP picture using said preceding IRAP picture as sole reference picture for said second DRAP picture;
- and
- perform a random access operation at one of said first decoded DRAP picture or said decoded DRAP picture.
4 more elements
A computer program product comprising instructions stored on a non-transitory computer-readable medium, which when executed by a processor, cause said processor to:
- transmit a video bitstream comprising at least one intra random access point, IRAP, picture on a communication channel to a user client device;
- receive a feedback message on a feedback channel from said user client device, said feedback message indicating a position within said video bitstream corresponding to a corrupt or missing picture at said user client device;
- encode, based on said feedback message, a first dependent random access point, DRAP, picture using a previous IRAP picture in said video bitstream as sole reference picture for said first DRAP picture, said first DRAP picture is encoded as a trailing picture for use as a reference and constitutes a random access point in said video bitstream;
- encode, based on said feedback message, a second DRAP picture using said IRAP picture in said video bitstream as sole reference picture for said second DRAP picture, said second DRAP picture is encoded as a trailing picture for use as a reference and constitutes a random access point in said video bitstream;
- and
- transmit said first and second DRAP picture to said user client device, wherein said first DRAP pictures precedes said second DRAP picture in said video bitstream.
3 more elements
A computer program comprising instructions stored on a non-transitory computer-readable medium, which when executed by a processor, cause said processor to:
- encode every nth picture in said video stream as a random access point, RAP, picture and encode the other pictures in said video stream as non-RAP pictures, wherein said processor is caused to encode said every nth picture by encoding every mth RAP picture as an intra random access point, IRAP, picture and encoding the other RAP pictures as dependent random access point, DRAP, pictures using a respective closest preceding, according to a decoding order, IRAP picture as sole reference picture for said DRAP picture, each DRAP picture is encoded as a trailing picture and constitutes a random access point in said video bitstream.
Dependencies are inferred from the claim text.