Neural network based image and video compression method with integer operations
AssigneesDouyin Vision Co., Ltd., Bytedance Inc.
InventorsSemih Esenlik, Zhaobin Zhang, Yaojun Wu, Meng Wang, Kai Zhang, Li Zhang
Life of this patent
Estimating the term…
Abstract
A mechanism for processing video data is disclosed. A determination is made to apply a neural subnetwork to perform a convolution operation using only integer values. The neural subnetwork also performs an activation function on the output of the convolution operation using only integer values. A conversion is performed between a visual media data and a bitstream based on the convolution operation and the activation function.
Claims20
A method for processing video or image data, comprising:
- applying a basic unit to perform a convolution operation on an input and to perform an activation function on an output of the convolution operation, wherein the convolution operation is performed using only integer values;
- and
- performing a conversion between visual media data and a bitstream based on the convolution operation and the activation function.
An apparatus for processing video or image data comprising:
- a processor;
- and
- a non-transitory memory with instructions thereon, wherein the instructions upon execution by the processor, cause the processor to:
- apply a basic unit to perform a convolution operation on an input and to perform an activation function on an output of the convolution operation, wherein the convolution operation is performed using only integer values;
- and
- perform a conversion between visual media data and a bitstream based on the convolution operation and the activation function.
A non-transitory computer readable storage medium storing instructions that cause a processor to:
- apply a basic unit to perform a convolution operation on an input and to perform an activation function on an output of the convolution operation, wherein the convolution operation is performed using only integer values;
- and
- perform a conversion between visual media data and a bitstream based on the convolution operation and the activation function.
A non-transitory computer-readable recording medium storing a bitstream of a video which is generated by a method performed by a video processing apparatus, wherein the method comprises:
- applying a basic unit to perform a convolution operation on an input and to perform an activation function on an output of the convolution operation, wherein the convolution operation is performed using only integer values;
- and
- generating a bitstream of visual media data based on the convolution operation and the activation function.
Dependencies are inferred from the claim text.