System and method for constructing optical flow fields
AssigneeSz Dji Technology Co., Ltd.
InventorYannan Wu
Life of this patent
Estimating the term…
Abstract
A system constructs an optical flow field that corresponds with a selected video frame. The optical flow field is constructed based on a first motion of a mobile platform having an imaging device and a status of the imaging device. The first motion and the status are determined with measurements of sensors installed on the mobile platform and/or the imaging device installed on the mobile platform. The first motion includes at least one of a first rotation, a horizontal movement, or a vertical movement of the mobile platform. The status includes a rotation of the imaging device and/or an orientation of the imaging device relative to the mobile platform.
Claims19
A method for constructing an optical flow field, comprising:
- classifying motions of a mobile platform carrying an imaging device and statuses of the imaging device into elementary scenarios;
- constructing a plurality of optical flow fields each corresponding to one of the elementary scenarios;
- combining two or more of the elementary scenarios to generate a combined scenario, and applying vector operations on the optical flow fields corresponding to the two or more of the elementary scenarios to construct an optical flow field corresponding to the combined scenario;
- acquiring, by one or more first motion sensors, a motion of the mobile platform;
- obtaining, by one or more second motion sensors, a status of the imaging device relative to the mobile platform;
- and
- selecting a corresponding optical flow field from the constructed optical flow fields corresponding to the elementary scenarios and the combined scenario for the imaging device to capture a frame at a shooting direction based upon the motion of the mobile platform and the status of the imaging device.
A method for constructing an optical flow field, comprising:
- classifying motions of a mobile platform and statuses of an imaging device attached to the mobile platform into elementary scenarios;
- constructing a plurality of optical flow fields each corresponding to one of the elementary scenarios;
- combining two or more of the elementary scenarios to generate a combined scenario, and applying vector operations the optical flow fields corresponding to the two or more of the elementary scenarios to construct an optical flow field corresponding to the combined scenario;
- acquiring, by one or more first motion sensors, at least one of a first motion of the mobile platform or acquiring, by one or more second motion sensors, a second motion of the imaging device;
- obtaining, by the one or more second motion sensors, a position of the imaging device relative to the mobile platform;
- and
- selecting a corresponding optical flow field from the constructed optical flow fields corresponding to the elementary scenarios and the combined scenario for the imaging device to capture a frame at a shooting direction based upon the first motion, the second motion, and the position.
An apparatus for constructing an optical flow field, comprising a processor configured to:
- classify motions of a mobile platform carrying an imaging device and statuses of the imaging device into elementary scenarios;
- construct a plurality of optical flow fields each corresponding to one of the elementary scenarios;
- combine two or more of the elementary scenarios to generate a combined scenario, and apply vector operations on the optical flow fields corresponding to the two or more of the elementary scenarios to construct an optical flow field corresponding to the combined scenario;
- acquire, via one or more first motion sensors, a motion of the mobile platform;
- obtain, via one or more second motion sensors, a status of the imaging device relative to the mobile platform;
- and
- select a corresponding optical flow field from the constructed optical flow fields corresponding to the elementary scenarios and the combined scenarios for the imaging device to capture a frame at a shooting direction based upon the motion of the mobile platform and the status of the imaging device.
Dependencies are inferred from the claim text.