Sub-region based determination of motion information refinement
AssigneesBeijing Bytedance Network Technology Co., Ltd., Bytedance Inc.
InventorsHongbin LIU, Li ZHANG, Kai ZHANG, Yue WANG
Life of this patent
Estimating the term…
Abstract
Devices, systems and methods for video processing are described. In one aspect, a video processing method is provided to include determining, for a conversion between a current video block of a video and a coded representation of the video, that a motion information of the current video block is refined using an optical flow-based method in which at least one motion vector offset is derived for a region within the current video block; clipping the at least one motion vector offset to a range [−N,M], wherein N and M are integers based on a rule; and performing the conversion based on at least one clipped motion vector offset.
Claims20
A method of processing video data, comprising:
- determining, for a first conversion between a first bi-predicted video block of a video and a bitstream of the video, that a motion information of the first bi-predicted video block is refined using a first optical flow-based method in which at least one first motion vector offset is derived to refine prediction samples of a region within the first bi-predicted video block;
- clipping the at least one first motion vector offset to a first range;
- performing the first conversion based on at least one clipped first motion vector offset;
- determining, for a second conversion between a second affine video block of the video and the bitstream, that a motion information of the second affine video block is refined using a second optical flow-based method in which at least one second motion vector offset is derived to refine prediction samples of a region within the second affine video block;
- clipping the at least one second motion vector offset to a second range;
- and
- performing the second conversion based on at least one clipped second motion vector offset;
- wherein the first range is different from the second range.
An apparatus for processing video data comprising a processor and a non-transitory memory with instructions thereon, wherein the instructions upon execution by the processor, cause the processor to:
- determine, for a first conversion between a first bi-predicted video block of a video and a bitstream of the video, that a motion information of the first bi-predicted video block is refined using a first optical flow-based method in which at least one first motion vector offset is derived to refine prediction samples of a region within the first bi-predicted video block;
- clip the at least one first motion vector offset to a first range;
- perform the first conversion based on at least one clipped first motion vector offset;
- determine, for a second conversion between a second affine video block of the video and the bitstream, that a motion information of the second affine video block is refined using a second optical flow-based method in which at least one second motion vector offset is derived to refine prediction samples of a region within the second affine video block;
- clip the at least one second motion vector offset to a second range;
- and
- perform the second conversion based on at least one clipped second motion vector offset;
- wherein the first range is different from the second range.
A non-transitory computer-readable storage medium storing instructions that cause a processor to:
- determine, for a first conversion between a first bi-predicted video block of a video and a bitstream of the video, that a motion information of the first bi-predicted video block is refined using a first optical flow-based method in which at least one first motion vector offset is derived to refine prediction samples of a region within the first bi-predicted video block;
- clip the at least one first motion vector offset to a first range;
- and
- perform the first conversion based on at least one clipped first motion vector offset;
- determine, for a second conversion between a second affine video block of the video and the bitstream, that a motion information of the second affine video block is refined using a second optical flow-based method in which at least one second motion vector offset is derived to refine prediction samples of a region within the second affine video block;
- clip the at least one second motion vector offset to a second range;
- perform the second conversion based on at least one clipped second motion vector offset;
- wherein the first range is different from the second range.
A non-transitory computer-readable recording medium storing a bitstream of a video which is generated by a method performed by a video processing apparatus, wherein the method comprises:
- determining, for a first bi-predicted video block of the video that a motion information of the first bi-predicted video block is refined using a first optical flow-based method in which at least one first motion vector offset is derived to refine prediction samples of a region within the first bi-predicted video block;
- clipping the at least one first motion vector offset to a first range;
- and
- generating the bitstream based on at least one clipped first motion vector offset;
- determining, for a second affine video block of the video, that a motion information of the second affine video block is refined using a second optical flow-based method in which at least one second motion vector offset is derived to refine prediction samples of a region within the second affine video block;
- clipping the at least one second motion vector offset to a second range;
- generating the bitstream based on at least one clipped second motion vector offset;
- wherein the first range is different from the second range.
Dependencies are inferred from the claim text.