Back to results
US 12,756,869 B2Granted
Image encoding, decoding method and device, coder-decoder
AssigneeBoe Technology Group Co., Ltd.
InventorsLijie Zhang, Guannan Chen
Life of this patent
Estimating the term…
Abstract
The present disclosure relates to the field of image processing technology, and in particular, to image encoding, decoding methods and devices, an encoder-decoder. The method includes: acquiring a visual saliency heat map of an image of a current frame, and filtering, by using the visual saliency heat map of the image of the current frame, the image of the current frame to obtain a target image; acquiring, by using the target image and an input image of a next frame, a motion estimation vector and a target prediction image of the input image of the next frame; and encoding a difference image between the input image of the next frame and the target prediction image and the motion estimation vector.
Claims14
A computer-implemented image encoding method, comprising:
- acquiring a visual saliency heat map of an image of a current frame, and filtering, by using the visual saliency heat map of the image of the current frame, the image of the current frame to obtain a target image;
- acquiring, by using the target image and an input image of a next frame, a motion estimation vector and a target prediction image of the input image of the next frame;
- and
- encoding a difference image between the input image of the next frame and the target prediction image and the motion estimation vector,
- wherein filtering, by using the visual saliency heat map of the image of the current frame, the image of the current frame to obtain the target image comprises:
- determining a saliency score of each area in the visual saliency heat map of the image of the current frame;
- determining a filtering mechanism of each area of the image of the current frame according to the saliency score;
- and
- filtering the image of the current frame according to the filtering mechanism of each area to obtain the target image,
- wherein acquiring the visual saliency heat map of the image of the current frame comprises:
- acquiring a pre-trained first neural network model of an attention mechanism;
- extracting brightness information of the image of the current frame;
- and
- obtaining the visual saliency heat map by inputting the brightness information into the first neural network model of the attention mechanism.
11 more elements
A computer-implemented image decoding method, comprising:
- acquiring a reference prediction image of a current frame;
- obtaining a decoded difference image by decoding encoded data of a difference image between an input image of the current frame and the reference prediction image;
- obtaining a to-be-processed image according to the decoded difference image and the reference prediction image;
- and
- acquiring a visual saliency heat map of the to-be-processed image of the current frame, and filtering, by using the visual saliency heat map of the to-be-processed image of the current frame, the to-be-processed image to obtain an output image of the current frame,
- wherein filtering, by using the visual saliency heat map of the to-be-processed image of the current frame, the to-be-processed image to obtain the output image of the current frame comprises:
- determining a saliency score of each area in the visual saliency heat map of the to-be-processed image of the current frame;
- determining a filtering mechanism of each area of the to-be-processed image of the current frame according to the saliency score;
- and
- filtering the to-be-processed image of the current frame according to the filtering mechanism of each area to obtain the output image,
- wherein acquiring the visual saliency heat map of the to-be-processed image of the current frame comprises:
- obtaining a pre-trained first neural network model of an attention mechanism;
- extracting brightness information of the to-be-processed image of the current frame;
- and
- obtaining the visual saliency heat map by inputting the brightness information into the first neural network model of the attention mechanism.
12 more elements
An image encoding device, comprising:
- a processor;
- and
- a memory, having a computer program stored thereon that, when being executed by the processor, causes the processor to:
- acquire a visual saliency heat map of an image of a current frame, and filter, by using the visual saliency heat map of the image of the current frame, the image of the current frame to obtain a target image;
- acquire, by using the target image and an input image of a next frame, a motion estimation vector and a target prediction image of the input image of the next frame;
- and
- encode a difference image between the input image of the next frame and the target prediction image and the motion estimation vector,
- wherein filtering, by using the visual saliency heat map of the image of the current frame, the image of the current frame to obtain the target image comprises:
- determining a saliency score of each area in the visual saliency heat map of the image of the current frame;
- determining a filtering mechanism of each area of the image of the current frame according to the saliency score;
- and
- filtering the image of the current frame according to the filtering mechanism of each area to obtain the target image,
- wherein acquiring the visual saliency heat map of the image of the current frame comprises:
- acquiring a pre-trained first neural network model of an attention mechanism;
- extracting brightness information of the image of the current frame;
- and
- obtaining the visual saliency heat map by inputting the brightness information into the first neural network model of the attention mechanism.
14 more elements
Dependencies are inferred from the claim text.