Video inter/intra compression using mixture of experts

A system comprising:

• a memory device;
• and
• one or more processors configured to interact with the memory device and configured to perform operations, including:
• for each frame in a video that includes multiple frames in an order sequence, defining, in the frame, a plurality of blocks in the frame, where each block in the frame is a sub-portion of the frame;
• processing the frames of video in sequential sets, wherein each sequential set is at least a current frame of video and a prior frame of video in the ordered sequence;
• for each sequential set, predicting blocks in the current frame of the video, each respective prediction of a block in the frame of the video comprising providing, as input to a prediction model:
• a first border of a current block of the current frame of the video;
• a second border of a current block of the current frame of the video;
• a first border for a respective current block of the prior frame of the video;
• a second border for the respective current block of the prior frame of the video;
• the respective current block of the prior frame of the video;
• and
• predicting, by the prediction model and based on the input to the prediction model for the sequential set, at least a sub-portion of the current block of the current frame of video.

A non-transitory computer readable medium storing instructions that, when executed by one or more data processing apparatus, cause the one or more data processing apparatus to perform operations comprising:

• for each frame in a video that includes multiple frames in an order sequence, defining, in the frame, a plurality of blocks in the frame, where each block in the frame is a sub-portion of the frame;
• processing the frames of video in sequential sets, wherein each sequential set is at least a current frame of video and a prior frame of video in the ordered sequence;
• for each sequential set, predicting blocks in the current frame of the video, each respective prediction of a block in the frame of the video comprising providing, as input to a prediction model:
• a first border of a current block of the current frame of the video;
• a second border of a current block of the current frame of the video;
• a first border for a respective current block of the prior frame of the video;
• a second border for the respective current block of the prior frame of the video;
• the respective current block of the prior frame of the video;
• and
• predicting, by the prediction model and based on the input to the prediction model for the sequential set, at least a sub-portion of the current block of the current frame of video.