Substream multiplexing for display stream compression

An apparatus configured to encode video data, the apparatus comprising:

• a memory configured to store a block of video data;
• and
• one or more processors in communication with the memory, the one or more processors configured to:
• determine that each coding mode within a first set of coding modes of a plurality of coding modes is not useable for encoding a block of video data based on a determination that each coding mode within the first set of coding modes produces a syntax element size greater than a maximum syntax element size for one of a plurality of substreams, wherein the maximum syntax element size refers to a maximum possible size of a single component worth of compressed data for the block of video data;
• determine that each coding mode within a second set of coding modes of the plurality of coding modes is usable for encoding the block of video data based on a determination that each coding mode within the second set of coding modes produces a syntax element size less than or equal to the maximum syntax element size for all of the plurality of substreams;
• determine a coding mode for encoding the block of video data from among the second set of coding modes;
• encode the block of video data in the plurality of substreams according to the determined coding mode to create a plurality of encoded substreams of video data, wherein to encode the block of video data in the plurality of substreams according to the determined coding mode to create the plurality of encoded substreams of video data, the one or more processors are further configured to:
• encode header information in a first substream of the plurality of substreams based on the determined coding mode, the header information indicative of at least one of the determined coding mode or flatness of the block;
• encode a luminance color component of samples of the block of video data in a second substream of the plurality of substreams;
• encode a first chrominance component of the samples of the block of video data in a third substream of the plurality of substreams;
• and
• encode a second chrominance component of the samples of the block of video data in a fourth substream of the plurality of substreams;
• store the plurality of encoded substreams of video data in respective balance first-in, first-out (FIFO) buffers;
• and
• multiplex the plurality of encoded substreams in a bitstream for transmitting to a video decoder.

An apparatus configured to encode video data, the apparatus comprising:

• means for determining that each coding mode within a first set of coding modes of a plurality of coding modes is not useable for encoding a block of video data based on a determination that each coding mode within the first set of coding modes produces a syntax element size greater than a maximum syntax element size for one of a plurality of substreams, wherein the maximum syntax element size refers to a maximum possible size of a single component worth of compressed data for the block of video data;
• means for determining that each coding mode within a second set of coding modes of the plurality of coding modes is usable for encoding the block of video data based on a determination that each coding mode within the second set of coding modes produces a syntax element size less than or equal to the maximum syntax element size for all of the plurality of substreams;
• means for determining a coding mode for encoding a block of video data from among the second set of coding modes;
• means for encoding the block of video data in the plurality of substreams according to the determined coding mode to create a plurality of encoded substreams of video data, wherein the means for encoding the block of video data in the plurality of substreams according to the determined coding mode to create the plurality of encoded substreams of video data comprises:
• means for encoding header information in a first substream of the plurality of substreams based on the determined coding mode, the header information indicative of at least one of the determined coding mode or flatness of the block;
• means for encoding a luminance color component of samples of the block of video data in a second substream of the plurality of substreams;
• means for encoding a first chrominance component of the samples of the block of video data in a third substream of the plurality of substreams;
• and
• means for encoding a second chrominance component of the samples of the block of video data in a fourth substream of the plurality of substreams;
• means for storing the plurality of encoded substreams of video data in respective balance first-in, first-out (FIFO) buffers;
• and
• means for multiplexing the plurality of encoded substreams in a bitstream for transmitting to a video decoder.

A computer-readable storage medium storing instructions that, when executed, cause one or more processors configured to encode video data to:

• determine that each coding mode within a first set of coding modes of a plurality of coding modes is not useable for encoding a block of video data based on a determination that each coding mode within the first set of coding modes produces a syntax element size greater than a maximum syntax element size for one of a plurality of substreams, wherein the maximum syntax element size refers to a maximum possible size of a single component worth of compressed data for the block of video data;
• determine that each coding mode within a second set of coding modes of the plurality of coding modes is usable for encoding the block of video data based on a determination that each coding mode within the second set of coding modes produces a syntax element size less than or equal to the maximum syntax element size for all of the plurality of substreams;
• determine a coding mode for encoding a block of video data from among the second set of coding modes;
• encode the block of video data in the plurality of substreams according to the determined coding mode to create a plurality of encoded substreams of video data, wherein to encode the block of video data in the plurality of substreams according to the determined coding mode to create the plurality of encoded substreams of video data, the instructions further cause the one or more processors to:
• encode header information in a first substream of the plurality of substreams based on the determined coding mode, the header information indicative of at least one of the determined coding mode or flatness of the block;
• encode a luminance color component of samples of the block of video data in a second substream of the plurality of substreams;
• encode a first chrominance component of the samples of the block of video data in a third substream of the plurality of substreams;
• and
• encode a second chrominance component of the samples of the block of video data in a fourth substream of the plurality of substreams;
• store the plurality of encoded substreams of video data in respective balance first-in, first-out (FIFO) buffers;
• and
• multiplex the plurality of encoded substreams in a bitstream for transmitting to a video decoder.