Concurrent decompression of multiple video streams with constrained decompression resources
AssigneeJupiter Systems
InventorsTzvetan Mikov, Stanislav Angelov, Robert P. Gardyne
Life of this patent
Estimating the term…
Abstract
A method and system for gracefully reducing demands for shared decompression resources required to present multiple video streams concurrently such that their streaming video content is simultaneously available for further processing or display. In particular, it relates to the use of presentation time stamps or incoming frames with reference to a time base dock and a threshold to determine if the decompression resources are falling behind in their ability to process incoming frames in real time. If this occurs then frames are dropped, i.e. discarded without being decompressed, with preference given to dropping incremental frames rather than key frames.
Claims20
A method of reducing demands for shared decompression resources required to present a plurality of video streams concurrently, the method comprising:
- with a processor, executing computer instructions stored in a non-transitory computer readable storage medium, the instructions configured to cause the processor to:
- receive each of a plurality of compressed video streams, and for each of the plurality of compressed video streams received,
- calculate a benchmark delta value of the video stream by determining a difference between a presentation time stamp (PTS) of a first key frame of the video stream and a time base clock;
- calculate a current delta value of the video stream by determining a difference between a PTS of a second key frame of the video stream and the time base clock, the second key frame following the first key frame;
- compare the benchmark delta value and the current delta value;
- and
- responsive to a difference between the benchmark delta value and the current delta value that is greater than a first threshold, drop one or more incremental frames of the video stream until a third key frame that has a time difference between a PTS of the third key frame and the time base clock that is less than or equal to a second threshold.
A method of reducing demands for shared decompression resources required to present one or more video streams concurrently, the method comprising:
- with a processor, executing computer instructions stored in a non-transitory computer readable storage medium, the instructions configured to cause the processor to:
- receive each of one or more compressed video streams, and for each of the one or more compressed video streams received,
- compare a presentation time stamp (PTS) of a first key frame of the video stream to a time base clock to calculate a benchmark delta value of the video stream;
- compare a PTS of a second key frame of the video stream that follows the first key frame to the time base clock to calculate a current delta value of the video stream;
- responsive to a difference between the benchmark delta value and the current delta value that is greater than a first threshold, drop at least one incremental frame of the video stream to reduce demands for the shared decompression resources until a third key frame that has a time difference between a PTS of the third key frame and the time base clock that is less than or equal to a second threshold, and update the benchmark delta value.
A computer system for reducing demands for shared decompression resources required to present a plurality of video streams concurrently, the system including:
- a processor and a non-transitory computer readable storage medium storing computer instructions configured to cause the processor to:
- receive each of a plurality of compressed video streams in a buffer, and for each of the plurality of compressed video streams received in the buffer,
- calculate a benchmark delta value of the video stream by determining a difference between a presentation time stamp (PTS) of a first key frame of the video stream and a time base clock;
- calculate a current delta value of the video stream by determining a difference between a PTS of a second key frame of the video stream and the time base clock, the second key frame following the first key frame;
- compare the benchmark delta value and the current delta value;
- and
- responsive to a difference between the benchmark delta value and the current delta value that is greater than a first threshold, drop one or more incremental frames of the video stream until a third key frame that has a time difference between a PTS of the third key frame and the time base clock that is less than or equal to a second threshold.
Dependencies are inferred from the claim text.