Patch based video coding for machines

A system comprising:

• a memory to store at least a portion of input video;
• and
• processor circuitry coupled to the memory, the processor circuitry to:
• detect a plurality of regions of interest for a machine learning operation in a full frame of the input video;
• form one or more atlases comprising the regions of interest at a first resolution;
• generate metadata corresponding to the one or more atlases and indicative of a size and location of each of the regions of interest in the full frame of video;
• and
• encode the one or more atlases and the metadata into one or more bitstreams, the one or more bitstreams absent a representation of the full frame of video at the first resolution or a resolution higher than the first resolution.

At least one machine readable medium comprising a plurality of instructions that, in response to being executed on a computing device, cause the computing device to code video for machine learning by:

• detecting a plurality of regions of interest for a machine learning operation in a full frame of video;
• forming one or more atlases comprising the regions of interest at a first resolution;
• generating metadata corresponding to the one or more atlases and indicative of a size and location of each of the regions of interest in the full frame of video;
• and
• encoding the one or more atlases and the metadata into one or more bitstreams, the one or more bitstreams absent a representation of the full frame of video at the first resolution or a resolution higher than the first resolution.

A system comprising:

• a memory to store at least a portion of one or more bitstreams comprising one or more atlases representative of a plurality of regions of interest at a first resolution and metadata to locate the of regions of interest in a full frame of video, the one or more bitstreams absent a representation of the full frame of video at the first resolution or a resolution higher than the first resolution;
• and
• processor circuitry coupled to the memory, the processor circuitry to:
• decode the one or more bitstreams to generate the plurality of regions of interest;
• and
• apply machine learning to one or more of the regions of interest based in part on corresponding one or more locations of the one or more of the regions of interest in the full frame to generate a machine learning output.

At least one machine readable medium comprising a plurality of instructions that, in response to being executed on a computing device, cause the computing device to perform machine learning by:

• receiving one or more bitstreams comprising one or more atlases representative of a plurality of regions of interest at a first resolution and metadata to locate the of regions of interest in a full frame of video, the one or more bitstreams absent a representation of the full frame of video at the first resolution or a resolution higher than the first resolution;
• decoding the one or more bitstreams to generate the plurality of regions of interest;
• and
• applying machine learning to one or more of the regions of interest based in part on corresponding one or more locations of the one or more of the regions of interest in the full frame to generate a machine learning output.