Systems and methods for video coding for machines using an autoencoder
AssigneeOP Solutions, LLC
InventorsHari Kalva, Borivoje Furht, Velibor Adzic
Life of this patent
Estimating the term…
Abstract
Systems and methods for encoding and decoding video for machine consumption (video coding for machines) are provided in which an autoencoder is employed. The autoencoder has an encoder portion, a bottleneck portion, and a decoder portion. The autoencoder being distributed between a VCM encoder and VCM decoder such that the VCM encoder includes the encoder portion and bottleneck portion and the VCM decoder includes the bottleneck portion and the decoder portion.
Claims17
An encoder for video for video coding for machine applications, the encoder comprising:
- an autoencoder encoder portion;
- a latent feature encoder coupled to the autoencoder encoder portion;
- and
- an autoencoder description encoder, the autoencoder description encoder being coupled to the autoencoder encoder portion;
- a multiplexor, the multiplexor coupled to the latent feature encoder and the autoencoder description encoder and providing a coded bitstream.
An decoder for encoded video for video coding for machine applications, the decoder comprising:
- a demultiplexor receiving a bitstream encoded with an autoencoder;
- a latent feature decoder coupled tot the demultiplexor;
- an autoencoder description decoder coupled to the demultiplexor;
- an autoencoder decoder portion, the autoencoder decoder portion coupled to the autoencoder description decoder and the latent feature decoder, the autoencoder decoder portion providing decoded video for machine use.
A system for encoding image data in a video coding for machine application, the system comprising:
- a video coding for machine (VCM) encoder, the VCM encoder comprising an autoencoder encoder portion and an autoencoder bottleneck portion, the VCM encoder receiving image information and generating a coded bitstream including feature data of the image information;
- and
- a VCM decoder, the VCM decoder comprising the autoencoder bottleneck portion and an autoencoder decoder portion, the VCM decoder receiving the coded bitstream and reconstructing the image information from the feature data.
Dependencies are inferred from the claim text.