Method and apparatus for substitutional neural residual compression
AssigneeTencent America LLC
InventorsWei JIANG, Wei WANG, Shan LIU
Life of this patent
Estimating the term…
Abstract
A method of substitutional neural residual compression is performed by at least one processor and includes estimating motion vectors, based on a current image frame and a previous reconstructed image frame, obtaining a predicted image frame, based on the estimated motion vectors and the previous reconstructed image frame, and subtracting the obtained predicted image frame from the current image frame to obtain a substitutional residual. The method further includes encoding the obtained substitutional residual, using a first neural network, to obtain an encoded representation, and compressing the encoded representation.
Claims20
A method of substitutional neural residual compression, the method being performed by at least one processor, and the method comprising:
- estimating motion vectors, based on a current image frame and a previous reconstructed image frame;
- obtaining a predicted image frame, based on the estimated motion vectors and the previous reconstructed image frame;
- subtracting the obtained predicted image frame from the current image frame to obtain a substitutional residual;
- encoding the obtained substitutional residual, using a first neural network, to obtain an encoded representation;
- and
- compressing the encoded representation.
An apparatus for substitutional neural residual compression, the apparatus comprising:
- at least one memory configured to store program code;
- and
- at least one processor configured to read the program code and operate as instructed by the program code, the program code comprising:
- estimating code configured to cause the at least one processor to estimate motion vectors, based on a current image frame and a previous reconstructed image frame;
- first obtaining code configured to cause the at least one processor to obtain a predicted image frame, based on the estimated motion vectors and the previous reconstructed image frame;
- subtracting code configured to cause the at least one processor to subtract the obtained predicted image frame from the current image frame to obtain a substitutional residual;
- encoding code configured to cause the at least one processor to encode the obtained substitutional residual, using a first neural network, to obtain an encoded representation;
- and
- compressing code configured to cause the at least one processor to compress the encoded representation.
A non-transitory computer-readable medium storing instructions that, when executed by at least one processor for substitutional neural residual compression, cause the at least one processor to:
- estimate motion vectors, based on a current image frame and a previous reconstructed image frame;
- obtain a predicted image frame, based on the estimated motion vectors and the previous reconstructed image frame;
- subtract the obtained predicted image frame from the current image frame to obtain a substitutional residual;
- encode the obtained substitutional residual, using a first neural network, to obtain an encoded representation;
- and
- compress the encoded representation.
Dependencies are inferred from the claim text.