Back to results
US 2015/0319375 A1Published application
Apparatus and method for creating real-time motion (stroboscopic) video from a streaming video
AssigneeSony Corporation
InventorSabri Gurbuz
Life of this patent
Estimating the term…
Abstract
Real-time generation of motion (stroboscopic) video is described which utilizes an object tracking process operating on downsized images in a circular buffer. Utilizing object information from the tracking, a background static scene is extracted into which multiple temporally displaced object images are inserted to create a stroboscopic video frame. Due to its low processing overhead, the apparatus and method is particularly well-suited for implementation on portable devices, such as cameras and cellular phones.
Claims20
An apparatus for generating stroboscopic output from a video input, comprising:
- (a) a computer processor configured for receiving and processing a video input;
- (b) a circular set of tracking buffers configured for object tracking;
- (c) a set of full size frame buffers configured for use during full size frame stroboscopic generation;
- and
- (d) programming in a non-transitory computer readable medium and executable on the computer processor for performing steps comprising:
- (i) downsizing frames of said video input and storing in said circular set of tracking buffers;
- (ii) storing full size frames in a set of full size frame buffers;
- (iii) performing object tracking routines to determine object mask and bounding box information about objects moving in frames of the video input;
- (iv) upsizing object mask and bounding box information back to full image size for use with said set of full size frame buffers;
- (v) performing background extraction in response to upsized object mask and bounding box information in relation to said full size frame buffers, so that a background is generated without moving objects;
- and
- (vi) generating spatially displaced object positions in a frame, or frames, of stroboscopic output, based on said upsized object mask and bounding box information.
9 more elements
An apparatus for generating stroboscopic output from a video input, comprising:
- (a) a computer processor configured for receiving and processing a video input;
- (b) a circular set of tracking buffers configured for object tracking, and comprising at least three tracking buffers for storing a downsized version of at least a previous, current and next frame;
- (c) a set of full size frame buffers configured for use during full size frame stroboscopic generation;
- and
- (d) programming in a non-transitory computer readable medium and executable on the computer processor for performing steps comprising:
- (i) downsizing frames of said video input and storing in said circular set of tracking buffers;
- (ii) storing full size frames in a set of full size frame buffers;
- (iii) performing object tracking routines to determine object mask and bounding box information about objects moving in frames of the video input;
- (iv) upsizing object mask and bounding box information back to full image size for use with said set of full size frame buffers;
- (v) performing background extraction in response to upsized object mask and bounding box information in relation to said full size frame buffers, so that a background is generated without moving objects;
- and
- (vi) generating spatially displaced object positions in a frame, or frames, of stroboscopic output, based on said upsized object mask and bounding box information, with positions of spatially displaced moving objects depicting an actual moving object position as well as a trail of separated previous positions of that object, and repeating stroboscopic output generation for every incoming image frame until a desired frame or frames of stroboscopic output is created.
9 more elements
A method for generating stroboscopic output from a video input, comprising:
- (a) receiving a video input within a processor equipped device configured for executing said method;
- (b) storing downsized frames from the video input into a circular set of tracking buffers configured for object tracking;
- (c) storing full sized frames from the video input into a set of full size frame buffers configured for use during full size frame stroboscopic generation;
- (d) performing object tracking to determine object mask and bounding box information about objects moving in frames of the video input;
- (e) upsizing object mask and bounding box information back to full image size for use with said set of full size frame buffers;
- (f) performing background extraction in response to upsized object mask and bounding box information in relation to said full size frame buffers, so that a background is generated without moving objects;
- and
- (g) generating spatially displaced object positions in a frame, or frames, of stroboscopic output, based on said upsized object mask and bounding box information.
5 more elements
Dependencies are inferred from the claim text.