Multi-camera 3d content creation
AssigneeOutward, Inc.
InventorClarence Chui
Life of this patent
Estimating the term…
Abstract
Techniques for generating three-dimensional content from the recordings of one or more independently operated cameras that are not constrained to fixed positions and orientations are disclosed. In some embodiments, data associated with a camera recording a scene is received, wherein camera pose with respect to the scene is not known; camera pose with respect to the scene is determined based on received image data captured by the camera and received sensor data associated with the camera; and the received data and determined camera pose are used to facilitate generation of at least a portion of a point cloud corresponding to the scene.
Claims20
A method, comprising:
- receiving data from a plurality of cameras configured to capture a scene;
- for each of the plurality of cameras, determining a relative pose of a given camera with respect to the scene for a frame based at least in part on image data captured by that camera and sensor data associated with that camera for the frame;
- determining relative poses of cameras with respect to one or more other cameras comprising the plurality of cameras for the frame based on independently determined relative poses of individual cameras with respect to the scene for the frame;
- and
- generating at least a partial three-dimensional reconstruction of the scene for the frame based on received image data and determined relative camera poses for the frame.
A system, comprising:
- a processor configured to:
- receive data from a plurality of cameras configured to capture a scene;
- for each of the plurality of cameras, determine a relative pose of a given camera with respect to the scene for a frame based at least in part on image data captured by that camera and sensor data associated with that camera for the frame;
- determine relative poses of cameras with respect to one or more other cameras comprising the plurality of cameras for the frame based on independently determined relative poses of individual cameras with respect to the scene for the frame;
- and
- generate at least a partial three-dimensional reconstruction of the scene for the frame based on received image data and determined relative camera poses for the frame;
- and
- a memory coupled to the processor and configured to provide instructions to the processor.
A computer program product embodied in a non-transitory computer readable medium and comprising computer instructions for:
- receiving data from a plurality of cameras configured to capture a scene;
- for each of the plurality of cameras, determining a relative pose of a given camera with respect to the scene for a frame based at least in part on image data captured by that camera and sensor data associated with that camera for the frame;
- determining relative poses of cameras with respect to one or more other cameras comprising the plurality of cameras for the frame based on independently determined relative poses of individual cameras with respect to the scene for the frame;
- and
- generating at least a partial three-dimensional reconstruction of the scene for the frame based on received image data and determined relative camera poses for the frame.
Dependencies are inferred from the claim text.