Systems and methods for motion estimation
AssigneeThruwave Inc.
InventorsElina B. Richards, Daniel Arnitz, Andreas Pedross-Engel, Matthew S. Reynolds
Life of this patent
Estimating the term…
Abstract
The present application is directed to a video-based motion extraction system that uses mmWave imaging. In one example, an object velocity is extracted in real time from at least one motion vector obtained from a compressed video. The velocity information is combined with distance information obtained from a distance sensor. The combination of distance and velocity is used to calculate a position of the object at each time instance. A velocity profile may be generated. The velocity profile may then be used to reconstruct an image of an object passing in front of an mmWave antenna array.
Claims18
A system for producing millimeter wave images, comprising:
- a video camera operative to capture video frames of a moving object;
- a millimeter wave antenna array proximate to the video camera and operative to capture millimeter wave data frames;
- a motion vector processor configured to calculate one or more motion vectors using the video frames, wherein the one or more motion vectors represent relative motion between the video camera and the object;
- at least one of a position processor and a velocity processor, wherein the position processor is configured to calculate one or more position estimates, and the velocity processor is configured to calculate one or more velocity estimates, of the object relative to the millimeter wave antenna array using the one or more motion vectors;
- and
- an image reconstruction processor configured to calculate a millimeter wave image of the object using the millimeter wave data frames and at least one of the corresponding position and velocity estimates.
A method for producing a millimeter wave image of a moving object, the method comprising:
- capturing two or more video frames of the moving object using a video camera proximate to a millimeter wave antenna array;
- capturing two or more millimeter wave data frames using the millimeter wave antenna array;
- calculating one or more motion vectors representing the relative motion between the video camera and the object;
- calculating at least one of one or more position estimates and one or more velocity estimates of the object relative to the millimeter wave antenna array using the motion vectors;
- and
- calculating the millimeter wave image using the millimeter wave data frames and the corresponding at least one of the position estimates and the velocity estimates using an image reconstruction algorithm.
A method for estimating motion of an object in a video, comprising:
- receiving at least one recording of an object passing in front of an mmWave antenna array;
- calculating at least one velocity associated with the object, wherein the velocity is calculated based on at least one motion vector;
- receiving, from a distance sensor, at least one distance indicator associated with the object;
- combining the at least one velocity and the at least one distance indicator;
- based on the combination of the at least one velocity and the at least one distance indicator, generating a velocity profile of the object;
- and
- constructing at least one image based on the velocity profile of the object.
Dependencies are inferred from the claim text.