Methods and Systems for a Video Compression Transformer

A computing device, comprising:

• one or more processors;
• and
• data storage, wherein the data storage has stored thereon computer-executable instructions that, when executed by the one or more processors, cause the computing device to carry out functions comprising:
• encoding, by an encoder of a transmitting computing device, a plurality of successive input video frames as a corresponding sequence of quantized representations;
• predicting, by a transformer of the transmitting computing device, a probability mass function (PMF) as a conditional distribution of a given quantized representation in the sequence of quantized representations, wherein the conditional distribution is based on at least one dependency between one or more quantized representations that occur prior to the given quantized representation in the sequence of quantized representations;
• generating, by the transmitting computing device, a plurality of compressed video frames by applying, based on the predicted PMF, an entropy coding to each quantized representation, wherein the entropy coding comprises assigning a smaller number of bits to values that have a higher frequency of occurrence;
• and
• transmitting, by the transmitting computing device, the plurality of compressed video frames.

A decoding device, comprising:

• one or more processors;
• and
• data storage, wherein the data storage has stored thereon computer-executable instructions that, when executed by the one or more processors, cause the decoding device to carry out functions comprising:
• receiving, by a decoder of the decoding device, a plurality of compressed video frames as a corresponding sequence of quantized representations;
• predicting, by a transformer of the decoding device, a probability mass function (PMF) as a conditional distribution of a given quantized representation in the sequence of quantized representations, wherein the conditional distribution is based on at least one dependency between one or more quantized representations that occur prior to the given quantized representation in the sequence of quantized representations;
• generating, by the decoding device, a plurality of decompressed video frames by applying, based on the predicted PMF, an entropy decoding to each quantized representation, wherein the entropy decoding comprises reversing an entropy encoding, and the entropy encoding having assigned a smaller number of bits to values with a higher frequency of occurrence;
• and
• providing, by the decoding device, the plurality of decompressed video frames.