Back to results
US 12,593,040 B2Granted
Method and apparatus for improving performance of neural network filter based video coding
AssigneeMediatek Inc.
InventorsWen-Chun Lin, Ching-Yeh Chen, Tzu-Der Chuang
Life of this patent
Estimating the term…
Abstract
A video decoding method includes: receiving an encoded video bitstream, and decoding a first block. The encoded video bitstream includes data to be decoded as the first block of pixels in a picture, and the first block includes a luma block and at least one chroma block. Decoding the first block includes: determining whether to apply a neural network (NN) filter on the luma block and the at least one chroma block according to an NN filter mode of the luma block and at least one NN filter mode of the at least one chroma block.
Claims19
A video decoding method comprising:
- receiving an encoded video bitstream, wherein the encoded video bitstream comprises data to be decoded as a first block of pixels in a picture, and the first block comprises a luma block and at least one chroma block;
- and
- decoding the first block, comprising:
- determining whether to apply a neural network (NN) filter on the luma block and the at least one chroma block according to an NN filter mode of the luma block and at least one NN filter mode of the at least one chroma block, comprising:
- checking at least one chroma control flag for at least one chroma component, wherein the at least one chroma control flag indicates whether the at least one NN filter mode of the at least one chroma block is forced to align with the NN filter mode of the luma block.
2 more elements
A video decoding method comprising:
- receiving an encoded video bitstream, wherein the encoded video bitstream comprises data to be decoded as a first block of pixels in a picture, and the first block comprises a luma block and at least one chroma block;
- and
- decoding the first block, comprising:
- determining whether to apply a neural network (NN) filter on the luma block and the at least one chroma block according to an NN filter mode of the luma block and at least one NN filter mode of the at least one chroma block;
- wherein the encoded video bitstream further comprises data to be decoded as a second block of pixels in the picture, and the video decoding method further comprises:
- decoding the second block, comprising:
- applying the NN filter on a filter input to generate a filter output, wherein the filter input is generated during a decoding procedure of the second block;
- and
- applying refinement on the filter output to generate a refined filter output as a final filter output of the NN filter.
6 more elements
A video encoding method comprising:
- receiving video data, wherein the video data comprises data to be encoded as a first block of pixels in a picture, and the first block comprises a luma block and at least one chroma block;
- and
- encoding the first block, comprising:
- selecting a neural network (NN) filter mode of the luma block and at least one NN filter mode of the at least one chroma block, to indicate whether an NN filter is applied on the luma block and the at least one chroma block;
- and
- generating at least one chroma control flag for at least one chroma component, wherein the at least one chroma control flag indicates whether the at least one NN filter mode of the at least one chroma block is forced to align with the NN filter mode of the luma block.
3 more elements
A video decoder comprising:
- a video data memory, configured to receive an encoded video stream, wherein the encoded video bitstream comprises data to be decoded as a block of pixels in a picture, wherein the block comprises a luma block and at least one chroma block;
- and
- a decoding circuit, configured to perform decoding of the block, wherein the decoding circuit comprises:
- a neural network (NN) filter;
- and
- a control circuit, configured to determine whether to apply the NN filter on the luma block and the at least one chroma block according to an NN filter mode of the luma block and at least one NN filter mode of the at least one chroma block, comprising:
- checking at least one chroma control flag for at least one chroma component, wherein the at least one chroma control flag indicates whether the at least one NN filter mode of the at least one chroma block is forced to align with the NN filter mode of the luma block.
4 more elements
Dependencies are inferred from the claim text.