Back to results
US 11,778,211 B2Granted
Parallel video parsing for video decoder processing
AssigneeApple Inc.
InventorsYaxiong Zhou, Felix C. Fernandes, Jeffrey J. Irwin, Liviu R. Morogan, Sorin Constantin Cismas
Life of this patent
Estimating the term…
Abstract
Systems and methods of parallel image parsing and processing for video decoding are provided. Video decoder circuitry may enable an incoming encoded bitstream to be split into multiple bitstreams corresponding to the bitstream compression scheme and processed by multiple parsers corresponding to the bitstream compression scheme in parallel. This enables parallel decoding of the incoming bitstream and, thus, more efficient decoder processing.
Claims20
An electronic device comprising decoder hardware, wherein the decoder hardware comprises:
- a first plurality of video parsers corresponding to a High Efficiency Video Coding (HEVC) compression scheme and a second plurality of video parsers corresponding to an Advanced Video Coding (AVC) compression scheme, wherein the first plurality of video parsers are decoupled from and are greater in number than a decoder pipeline in the decoder hardware and the second plurality of video parsers are decoupled from and are greater in number than the decoder pipeline in the decoder hardware, and wherein the first plurality of video parsers and the second plurality of video parsers are configured to:
- receive a plurality of streams of an encoded bitstream at the first plurality of video parsers or the second plurality of video parsers corresponding to the compression scheme of the encoded bitstream, wherein the encoded bitstream is divided into the plurality of streams to correspond to the first plurality of video parsers or the second plurality of video parsers;
- and
- parse the plurality of the streams of the encoded bitstream in parallel at the first plurality of video parsers or the second plurality of video parsers;
- and
- the decoder pipeline, wherein the decoder pipeline on is configured to receive the parsed bitstreams parsed by the first plurality of video parsers or the second plurality of video parsers and use the parsed bitstreams to decode one or more image frames based on the parsed bitstreams.
3 more elements
An electronic device comprising:
- memory or storage configured to store an encoded bitstream of video data encoded according to a video compression scheme;
- an electronic display configured to display the video data after the video data has been decoded into decoded video data;
- and
- video decoder circuitry configured to decode the encoded bitstream to obtain the decoded video data, wherein the video decoder circuitry comprises:
- a first plurality of video parsers corresponding to a High Efficiency Video Coding (HEVC) compression scheme and a second plurality of video parsers corresponding to an Advanced Video Coding (AVC) compression scheme, wherein the first plurality of video parsers or the second plurality of video parsers are configured to parse different parts of the encoded bitstream in parallel to obtain syntax elements, wherein the parsed encoded bitstream is sent to a direct memory access (DMA), and wherein the parsed encoded bitstream is retrieved from the DMA by one or more processor cores;
- and
- a video decoder pipeline comprising the one or more processor cores, wherein the video decoder pipeline is configured to use the syntax elements to obtain the decoded video data, and wherein the video decoder circuitry has more video parsers than video decoder pipelines.
4 more elements
An article of manufacture comprising one or more tangible, non-transitory, machine-readable media comprising instructions that, when executed by a processor, cause video decoding circuitry to perform operations comprising:
- receiving, at a first plurality of video parsers corresponding to High Efficiency Video Coding (HEVC) and a second plurality of video parsers corresponding to Advanced Video Coding (AVC), a plurality of streams divided from an encoded bitstream of video data encoded according to a video compression scheme;
- parsing syntax elements of the plurality of streams of the encoded bitstream in parallel at the first plurality of video parsers or the second plurality of video parsers to obtain parsed bitstreams, wherein the first plurality of video parsers and the second plurality of video parsers are decoupled from one or more decoder pipelines of the video decoding circuitry;
- and
- sending the parsed bitstreams to a memory associated with the video decoding circuitry;
- and
- decoding, using a decoder pipeline of the one or more video decoder pipelines of the video decoding circuitry, wherein the video decoding circuitry comprises fewer video decoder pipelines than the first plurality of video parsers or the second plurality of video parsers, the encoded video data to obtain decoded video data using the parsed bitstreams.
3 more elements
Dependencies are inferred from the claim text.