Back to results
US 10,122,996 B2Granted
Method for 3D multiview reconstruction by feature tracking and model registration
AssigneeSony Corporation
InventorsKo-Kai Albert Huang, Ming-Chang Liu
Life of this patent
Estimating the term…
Abstract
A 3D multiview reconstruction method takes a sequence of 2D stereo images from a narrow field-of-view imager (e.g., camera) and reconstructs a 3D representation of the wide field-of-view object or scene. The 3D multiview reconstruction method tracks 2D image pixels across neighboring frames and constraints for frame integration via 3D model construction.
Claims21
A method programmed in a non-transitory memory of a device comprising:
- acquiring one or more 2D stereo images;
- reconstructing a 3D multiview image using the one or more 2D stereo images, wherein reconstructing the 3D multiview image includes:
- rectifying the one or more images;
- estimating a disparity between images;
- implementing 2D pixel tracking across neighboring frames;
- estimating a 3D pose by mapping tracked 2D pixels to 3D coordinates;
- and
- constructing a 3D model based on the 3D pose;
- and
- displaying the 3D multiview image.
7 more elements
An apparatus comprising:
- a non-transitory memory for storing an application, the application for:
- acquiring one or more 2D stereo images;
- reconstructing a 3D multiview image using the one or more 2D stereo images, wherein reconstructing the 3D multiview image includes:
- rectifying the one or more images;
- estimating a disparity between images;
- implementing 2D pixel tracking across neighboring frames;
- estimating a 3D pose by mapping tracked 2D pixels to 3D coordinates;
- and
- constructing a 3D model based on the 3D pose;
- and
- displaying the 3D multiview image;
- and
- a processing component coupled to the memory, the processing component configured for processing the application.
10 more elements
A system comprising:
- a plurality of cameras for acquiring one or more 2D stereo images;
- and
- a computing device configured for:
- receiving the one or more 2D stereo images;
- reconstructing a 3D multiview image using the one or more 2D stereo images, wherein reconstructing the 3D multiview image includes:
- rectifying the one or more images;
- estimating a disparity between images;
- implementing 2D pixel tracking across neighboring frames;
- estimating a 3D pose by mapping tracked 2D pixels to 3D coordinates;
- and
- constructing a 3D model based on the 3D pose;
- and
- displaying the 3D multiview image.
10 more elements
Dependencies are inferred from the claim text.