Neural network-based video compression with bit allocation
AssigneeLemon Inc.
InventorsZhaobin Zhang, Li Zhang, Yue Li, Kai Zhang
Life of this patent
Estimating the term…
Abstract
A method of video processing includes determining a target bitrate for a current video unit of a video that is based on a rate distortion function in which a rate portion is weighted using lambda, wherein lambda is a rational number and wherein lambda is an adaptively adjusted for each video unit of the video and performing a conversion between the current video unit and a bitstream of the video.
Claims19
A method of video processing, comprising:
- determining, for a conversion between a current video unit of a current video frame of a video and a bitstream of the video, a target bitrate for the current video unit that is based on a rate distortion function in which a rate portion is weighted using lambda, wherein the lambda is a rational number, wherein the lambda is adaptively adjusted for each video unit of the video, and wherein the lambda is adjusted using multiple neural networks, and different neural networks in the multiple neural networks are trained for determining values of lambda for different video units;
- and
- performing the conversion based on the determining.
An apparatus for processing video data comprising a processor and a non-transitory memory with instructions thereon, wherein the instructions upon execution by the processor, cause the processor to:
- determine, for a conversion between a current video unit of a current video frame of a video and a bitstream of the video, a target bitrate for the current video unit that is based on a rate distortion function in which a rate portion is weighted using lambda, wherein the lambda is a rational number, wherein the lambda is adaptively adjusted for each video unit of the video, and wherein the lambda is adjusted using multiple neural networks, and different neural networks in the multiple neural networks are trained for determining values of lambda for different video units;
- and
- perform the conversion based on the determining.
A non-transitory computer-readable recording medium storing a bitstream of a video which is generated by a method performed by a video processing apparatus, wherein the method comprises:
- determining, for a current video unit of a current video frame of a video, a target bitrate for the current video unit that is based on a rate distortion function in which a rate portion is weighted using lambda, wherein the lambda is a rational number, wherein the lambda is adaptively adjusted for each video unit of the video, and wherein the lambda is adjusted using multiple neural networks, and different neural networks in the multiple neural networks are trained for determining values of lambda for different video units;
- and
- generating the bitstream based on the determining.
Dependencies are inferred from the claim text.