Methods and systems for generating a high-rate video for a camera in motion
AssigneeThales Defense & Security, Inc.
InventorsRichard Madison, Olegs Mise
Life of this patent
Estimating the term…
Abstract
A method, medium and system for generating a high-rate video for displaying to a user on a display device. The method, medium and system may generate and display the high-rate video by: capturing images for a video at a first frame rate, capturing movement of a display device via a motion sensor, estimating a motion of the camera based on images of the video captured at the first frame rate and the movement of the display device captured via the motion sensor, generating the high-rate video at a second frame rate by up-sampling the video captured at the first frame rate, and displaying the high-rate video to the user.
Claims10
An apparatus for generating a high-rate video for displaying to a user on a display device, the apparatus comprising:
- a camera for capturing a video at a first frame rate;
- a motion sensor for capturing movement of a display device;
- a motion tracker for estimating motion of the camera based on images of the video captured at the first frame rate and the motion reported by the motion sensor;
- an image generator for generating the high-rate video at a second frame rate by up-sampling the video captured at the first frame rate, wherein images of the high-rate video are output emulating a video captured at the second frame rate, and wherein the up-sampling comprises:
- extrapolating images of the video captured at the first frame rate using geometrical warping thereby causing content of the high-rate video to be displayed counteracting the movement of the display device;
- and
- a display for displaying the high-rate video to the user.
A method for generating high-rate video for displaying to a user on a display device, the method comprising:
- capturing, by a camera, images for a video at a first frame rate;
- capturing, by a motion sensor, movement of a display device;
- estimating, by a motion tracker, motion of the camera based on images of the video captured at the first frame rate and the movement of the display device;
- generating, by an image generator, the high-rate video at a second frame rate by up-sampling the video captured at the first frame rate, wherein images of the high-rate video are output emulating a video captured at the second frame rate, wherein the up-sampling comprises:
- extrapolating images of the video captured at the first frame rate using geometrical warping thereby causing content of the high-rate video to be displayed counteracting the movement of the display device;
- and
- displaying, via a display, the high-rate video to the user.
A method for displaying a high-rate video emulating a camera in motion while capturing images at a low frame rate, the method comprising:
- for a current frame to be displayed, determining whether or not an image captured by a camera is available;
- and
- when an image captured by the camera is available for the current frame, displaying the image captured by the camera and proceeding to a next frame;
- when the image captured by the camera is not available for the current frame,
- determining, for the current frame, whether or not an image is received from an image generator, wherein the image is generated by extrapolating images using a geometrical warping algorithm based on input received from a motion sensor;
- when the image is received from the image generator, displaying the image received from the image generator;
- and
- proceeding to process the next frame.
Dependencies are inferred from the claim text.