Systems, methods, and non-transitory computer-readable media for transforming raw image data into a video stream comprising a plurality of encoded image frames
AssigneeAxis AB
InventorsBjörn ARDÖ, Johan NYSTRÖM, Viktor EDPALM, Song YUAN, Johan FÖRBERG
Life of this patent
Estimating the term…
Abstract
Systems, methods and non-transitory computer-readable media transform raw image data into a video stream comprising a plurality of encoded image frames. To reduce memory bandwidth and power consumption, compression rates of sets of imaging data temporarily stored in memory during the transformation of raw image data into the video stream are adapted based on encoding configurations, on a pixel block level.
Claims15
A system for transforming raw image data into a video stream comprising a plurality of encoded image frames, the system comprising:
- an image sensor configured to continuously capture raw image data;
- an image signal processor, ISP, configured to process the raw image data into a plurality of processed image frames;
- a video encoder configured to encode the processed image frames into the video stream comprising the plurality of encoded image frames;
- a memory configured to temporarily store sets of imaging data during the transformation of raw image data into the video stream, each set of imaging data comprising one of:
- raw image data, partially processed raw image data, or at least a portion of a processed image frame, wherein the sets of imaging data comprise a first set of imaging data;
- a memory bandwidth compressor configured to compress the first set of imaging data when being written to the memory and decompress the first set of imaging data when being read from the memory;
- the system further comprising an encoding analyser configured to associate the first set of imaging data with encoding parameters, wherein the encoding parameters comprises at least one of:
- first data indicating that the video encoder will disregard the first set of imaging data, or data derived therefrom, when encoding the video stream;
- or
- second data indicating a quantization parameter (QP) that will be used by the video encoder when encoding the first set of imaging data, or data derived therefrom, as a block of pixels in an encoded image frame of the plurality of encoded image frames;
- wherein the memory bandwidth compressor is configured to compress the first set of imaging data based on the encoding parameters associated with the first set of imaging data.
A method for transforming raw image data into a video stream comprising a plurality of encoded image frames, the method comprising the steps of:
- continuously capturing raw image data;
- processing the raw image data into a plurality of processed image frames;
- encoding the processed image frames into the video stream comprising the plurality of encoded image frames;
- temporarily storing sets of imaging data during the transformation of raw image data into the video stream, each set of imaging data comprising one of:
- raw image data, partially processed raw image data, or at least a portion of a processed image frame, wherein the sets of imaging data comprise a first set of imaging data;
- associating the first set of imaging data with encoding parameters, the encoding parameters comprises at least one of:
- first data indicating that the video encoder will disregard the first set of imaging data, or data derived therefrom, when encoding the video stream;
- or
- second data indicating a quantization parameter (QP) that will be used by the video encoder when encoding the first set of imaging data, or data derived therefrom, as a block of pixels in an encoded image frame of the plurality of encoded image frames;
- and
- compressing the first set of imaging data when being written to the memory and decompress the first set of imaging data when being read from the memory, wherein compressing the first set of imaging data being based on the encoding parameters associated with the first set of imaging data.
One or more non-transitory computer-readable media storing instructions executable by one or more processors, wherein the instructions, when executed, cause the one or more processors to perform operations comprising:
- continuously capturing raw image data;
- processing the raw image data into a plurality of processed image frames;
- encoding the processed image frames into the video stream comprising the plurality of encoded image frames;
- temporarily storing sets of imaging data during the transformation of raw image data into the video stream, each set of imaging data comprising one of:
- raw image data, partially processed raw image data, or at least a portion of a processed image frame, wherein the sets of imaging data comprising a first set of imaging data;
- associating the first set of imaging data with encoding parameters, the encoding parameters comprises at least one of:
- first data indicating that the video encoder will disregard the first set of imaging data, or data derived therefrom, when encoding the video stream;
- or
- second data indicating a quantization parameter (QP) that will be used by the video encoder when encoding the first set of imaging data, or data derived therefrom, as a block of pixels in an encoded image frame of the plurality of encoded image frames;
- and
- compressing the first set of imaging data when being written to the memory and decompress the first set of imaging data when being read from the memory, wherein compressing the first set of imaging data being based on the encoding parameters associated with the first set of imaging data.
Dependencies are inferred from the claim text.