Method and apparatus for encoding a picture and decoding a bitstream using a neural network
AssigneeHuawei Technologies Co., Ltd.
InventorsElena Alexandrovna Alshina, Han Gao, Semih Esenlik
Life of this patent
Estimating the term…
Abstract
A method and an apparatus for encoding a picture and decoding a bitstream representing a matrix using a neural network is provided. The method includes obtaining a resizing method out of a plurality of resizing methods. The resizing method is applied to resize an input of size S to a size S. The resized input is processed by the neural network, wherein the neural network comprises one or more downsampling layers. Subsequently, the method provides an output of the neural network, the output having a size P that is smaller than S in the at least one dimension.
Claims10
A method of decoding a bitstream representing a picture using a neural network (NN) to process an input representing a matrix having a size in at least one dimension, wherein the method comprises:
- obtaining a resizing method out of a plurality of resizing methods, wherein obtaining the resizing method is based on one or more indications, wherein the one or more indications comprise a third indication, wherein the third indication has a value that indicates an interpolation filter that is to be used in the interpolation, wherein, the third indication is or comprises an index indicating an entry in a first lookup table (LUT) that has a plurality of entries and each entry in the first LUT specifies the interpolation filter, wherein obtaining the resizing method comprises comparing a larger size with another size and obtaining, based on the comparing, the resizing method, wherein the another size is obtained from a function comprising a combined upsampling parameter of the NN, the upsampling parameter being a product of upsampling ratios of all upsampling layers of the NN, wherein each upsampling layer has a different upsampling ratio;
- processing the input with the size by the NN, wherein the NN comprises one or more upsampling layers, thereby obtaining an intermediate output having the larger size that is larger than the size in the at least one dimension;
- and
- resizing the intermediate output from the larger size to the another size by applying the obtained resizing method, thereby obtaining a decoded picture.
A decoder for decoding a bitstream representing a picture, wherein the decoder comprises one or more processors for implementing a neural network (NN) to process an input representing a matrix having a size in at least one dimension, wherein the one or more processors are adapted to perform a method comprising:
- obtaining a resizing method out of a plurality of resizing methods, wherein obtaining the resizing method is based on one or more indications, wherein the one or more indications comprise a third indication, wherein the third indication has a value that indicates an interpolation filter that is to be used in the interpolation, wherein, the third indication is or comprises an index indicating an entry in a first lookup table (LUT) that has a plurality of entries and each entry in the first LUT specifies the interpolation filter, wherein obtaining the resizing method comprises comparing a larger size with another size and obtaining, based on the comparing, the resizing method, wherein the another size is obtained from a function comprising a combined upsampling parameter of the NN, the upsampling parameter being a product of upsampling ratios of all upsampling layers of the NN, wherein each upsampling layer has a different upsampling ratio;
- processing the input with the size by the NN, wherein the NN comprises one or more upsampling layers, thereby obtaining an intermediate output having the larger size that is larger than the size in the at least one dimension;
- and
- resizing the intermediate output from the larger size to the another size by applying the obtained resizing method, thereby obtaining a decoded picture.
Dependencies are inferred from the claim text.