LTR frame updating in video encoding
AssigneeAxis AB
InventorsMichael Ambrus, Viktor Edpalm
Life of this patent
Estimating the term…
Abstract
Techniques for Long Term Reference (LTR) frame updating in a video encoding process are performed by an image processing device as part of the video encoding process. The method comprises encoding a first LTR frame. The method comprises encoding a plurality of frames referencing directly or indirectly to the first LTR frame. The method comprises sequentially updating the first LTR frame by evaluating a cost for encoding a block of image data in one of the plurality of frames and by updating an image area in the first LTR frame when the cost fulfils a cost criterion. The image area is updated based on the block of image data in at least one of the plurality of frames. The method comprises encoding the sequentially updated first LTR frame as a second LTR frame.
Claims11
A method performed by an image processing device for long-term reference (LTR) frame updating in a video encoding process, the method comprising:
- encoding a first LTR frame;
- encoding a plurality of frames referencing directly or indirectly to the first LTR frame;
- sequentially updating the first LTR frame by:
- evaluating a cost for encoding a block of image data in one of the plurality of frames;
- and
- updating an image area in the first LTR frame when the cost fulfils a cost criterion, wherein the image area is updated based on the block of image data in at least one of the plurality of frames;
- and
- encoding the sequentially updated first LTR frame as a second LTR frame;
- wherein the cost criterion fails to be fulfilled when an amount of the cost is either above a first threshold value or below a second threshold value, where the second threshold value is lower than the first threshold value, and a pace at which the cost increases or decreases from one evaluation of the cost to a next evaluation of the cost, or over a range of adjacent evaluations evaluation of the cost, is within a predetermined distance to zero.
A method performed by an image processing device for long-term reference (LTR) frame updating in a video encoding process, the method comprising:
- encoding a first LTR frame;
- encoding a plurality of frames referencing directly or indirectly to the first LTR frame;
- sequentially updating the first LTR frame by:
- evaluating a cost for encoding a block of image data in one of the plurality of frames;
- and
- updating an image area in the first LTR frame when the cost fulfils a cost criterion, wherein the image area is updated based on the block of image data in at least one of the plurality of frames;
- and
- encoding the sequentially updated first LTR frame as a second LTR frame;
- wherein the cost criterion fails to be fulfilled when a pace at which the cost increases or decreases from one evaluation of the cost to a next evaluation of the cost, or over a range of adjacent evaluations of the cost, flickers between a first value and a second value, where the first value and the second value are distanced from each other more than a predetermined distance.
A method performed by an image processing device for long-term reference (LTR) frame updating in a video encoding process, the method comprising:
- encoding a first LTR frame;
- encoding a plurality of frames referencing directly or indirectly to the first LTR frame;
- sequentially updating the first LTR frame by:
- evaluating a cost for encoding a block of image data in one of the plurality of frames;
- and updating an image area in the first LTR frame when the cost fulfils a cost criterion,
- wherein the image area is updated based on the block of image data in at least one of the plurality of frames;
- and
- encoding the sequentially updated first LTR frame as a second LTR frame;
- wherein the cost for encoding the block of image data is based on a prioritization of the block of image data, and the cost for encoding the block of image data also pertains to whether or not the first LTR frame has been updated with image data corresponding to another block of image data that neighbors the block of image data, and wherein the more neighboring blocks of image data having image data that the first LTR frame has been updated with, the higher the block of image data is prioritized for encoding.
A method performed by an image processing device for long-term reference (LTR) frame updating in a video encoding process, the method comprising:
- encoding a first LTR frame;
- encoding a plurality of frames referencing directly or indirectly to the first LTR frame;
- sequentially updating the first LTR frame by:
- evaluating a cost for encoding a block of image data in one of the plurality of frames;
- and
- updating an image area in the first LTR frame when the cost fulfils a cost criterion,
- wherein the image area is updated based on the block of image data in at least one of the plurality of frames;
- and encoding the sequentially updated first LTR frame as a second LTR frame;
- wherein said evaluating and said updating are sequentially performed per each set of the plurality of frames using a sliding window that for each occurrence of said evaluating and said updating covers one respective set of the frames.
Dependencies are inferred from the claim text.