Adaptive camera control for reducing motion blur during real-time image capture
AssigneeMagic Leap, Inc.
InventorsAlexander Ilic, Manuel Werlberger
Life of this patent
Estimating the term…
Abstract
A method of forming a visual representation of an object from a plurality of image frames acquired using a portable electronic device, the method comprising the steps of determining at least one parameter of motion of the portable electronic device; determining at least one capture condition for at least one first image frame of the plurality of image frames; computing, based on the at least one parameter of motion and the at least one capture condition, an indication of blur in the image frame; based on the indication of blur, conditionally taking a corrective action.
Claims25
A portable electronic device, comprising:
- a camera;
- a user interface;
- and
- a processor configured to:
- form a representation of an object from a plurality of image frames captured with the camera by sequentially processing image frames of the plurality of image frames, wherein the processing comprises creating a set of points for each image frame, with at least one feature extracted from the plurality of image frames, and associating the set of points for each image frame to a common plane;
- determine motion of the portable electronic device;
- selectively exclude from the sequential processing image frames of the plurality of image frames for which the motion of the portable electronic device between capture of the image frame and a preceding image frame is below a threshold;
- determine at least one capture condition for the camera for at least one first image frame of the plurality of image frames;
- compute, based on the motion and the at least one capture condition, at least one indication of blur in the at least one first image frame;
- and
- based on the indication of blur, conditionally take a corrective action, wherein conditionally taking the corrective action comprises taking the corrective action based on a comparison of the indication of blur to a threshold.
A method of forming a representation of an object from a plurality of image frames captured with a camera of a portable electronic device, the method being performed by at least one processor of the portable electronic device and comprising:
- sequentially processing image frames of the plurality of image frames, wherein the processing comprises creating a set of points for each image frame with at least one feature extracted from the plurality of image frames, and associating the set of points of each image frame to a common plane;
- determining motion of the portable electronic device;
- selectively excluding from the sequential processing image frames of the plurality of image frames for which the motion of the portable electronic device between capture of the image frame and a preceding image frame is below a threshold;
- determining at least one capture condition for the camera for at least one first image frame of the plurality of image frames;
- computing, based on the motion and the at least one capture condition, at least one indication of blur in the at least one first image frame;
- and
- based on the indication of blur, conditionally taking a corrective action, wherein conditionally taking the corrective action comprises taking the corrective action based on a comparison of the indication of blur to a threshold.
At least one non-transitory computer-readable storage medium storing processor-executable instructions that, when executed by at least one computer hardware processor, cause the at least one computer hardware processor to perform a method of forming a representation of an object from a plurality of image frames captured with a camera of a portable electronic device, the method comprising:
- sequentially processing image frames of the plurality of image frames, wherein the processing comprises creating a set of points for each image frame with at least one feature extracted from the plurality of image frames, and associating the set of points of each image frame to a common plane;
- determining motion of the portable electronic device;
- selectively excluding from the sequential processing image frames of the plurality of image frames for which the motion of the portable electronic device between capture of the image frame and a preceding image frame is below a threshold;
- determining at least one capture condition for the camera for at least one first image frame of the plurality of image frames;
- computing, based on the motion and the at least one capture condition, at least one indication of blur in the at least one first image frame;
- and
- based on the indication of blur, conditionally taking a corrective action, wherein conditionally taking the corrective action comprises taking the corrective action based on a comparison of the indication of blur to a threshold.
Dependencies are inferred from the claim text.