Video stream encoding both overview and region-of-interest(s) of a scene

A device for encoding a video stream, comprising:

• a processor, and
• a memory storing instructions that, when executed by the processor, cause the device to:
• obtain one or more subsequent images of a scene captured by at least one camera, and
• for each of the one or more images:
• identify one or more regions of interest (ROIs) in the image;
• add a set of video frames to an encoded video stream, the set comprising at least three separate video frames comprising:
• a first video frame encoding at least part of the scene in the image at a lower resolution than a resolution of the at least part of the scene in the image, wherein the at least part of the scene includes the one or more ROIs, and a third video frame encoding the one or more ROIs at a higher resolution than a resolution of the one or more ROIs encoded in the first video frame of the set,
• wherein, for a purpose of creating a reference video frame for encoding of the third video frame, the set of video frames further comprises:
• a second video frame being an inter-frame referencing the first video frame and including motion vectors between the second video frame and the first video frame for upscaling of the one or more ROIs to a resolution higher than a resolution of the one or more ROIs in the first video frame, wherein the second video frame is marked as a no-display frame, and wherein the third video frame is an inter-frame referencing the second video frame.

A computer program product comprising a non-transitory computer-readable storage medium storing instructions for encoding a video stream, the instructions configured to, when executed by a processor of a device, cause the device to:

• obtain one or more subsequent images of a scene captured by at least one camera, and
• for each of the one or more images:
• identify one or more regions of interest (ROIs) in the image;
• add a set of video frames to an encoded video stream, the set comprising at least three separate video frames comprising:
• a first video frame encoding at least part of the scene in the image at a lower resolution than a resolution of the at least part of the scene in the image, wherein the at least part of the scene includes the identified one or more ROIs, and
• a third video frame encoding the one or more ROIs of the image at a higher resolution than a resolution of the one or more ROIs encoded in the first video frame of the set,
• wherein, for a purpose of creating a reference video frame for encoding of the third video frame, the set of video frames further comprises:
• a second video frame being an inter-frame referencing the first video frame and including motion vectors between the second video frame and the first video frame for upscaling of the one or more ROIs to a resolution higher than a resolution of the one or more ROIs in the first video frame, wherein the second video frame is marked as a no-display frame, and wherein the third video frame is an inter-frame referencing the second video frame.