Back to results
US 2014/0192158 A1Published application
Stereo Image Matching
AssigneeMicrosoft Corporation
InventorsOliver Whyte, Adam G. Kirk, Shahram Izadi, Carsten Rother, Michael Bleyer, Christoph Rhemann
Life of this patent
Estimating the term…
Abstract
The description relates to stereo image matching to determine depth of a scene as captured by images. More specifically, the described implementations can involve a two-stage approach where the first stage can compute depth at highly accurate but sparse feature locations. The second stage can compute a dense depth map using the first stage as initialization. This improves accuracy and robustness of the dense depth map.
Claims21
A system, comprising:
- a processor configured to receive corresponding images of a scene from a pair of cameras, the corresponding images including features added to the scene at wavelengths of light not visible to the human eye;
- the processor configured to implement a sparse component configured to employ a sparse location-based matching algorithm to locate the features in the corresponding images and to determine depths of individual features;
- and,
- the processor configured to implement a dense component configured to employ a nearest neighbor field (NNF) stereo matching algorithm to the corresponding images utilizing the depths of the individual features to find corresponding pixels in the corresponding images.
1 more element
A method, comprising:
- determining three-dimensional (3-D) locations of a set of points in a scene with a first technique;
- initializing a second technique with the 3-D locations of the set of points;
- and,
- propagating the second technique to determine 3-D locations of other points in the scene.
1 more element
A device, comprising:
- an infrared (IR) projector configured to project features onto a scene in a random pattern;
- at least first and second IR cameras configured to capture corresponding images of the scene;
- a first component configured to determine depths of the features in the corresponding images;
- and,
- a second component configured to utilize the determined depths of the features to construct a disparity map between the corresponding images.
2 more elements
A system, comprising:
- an infrared (IR) projector configured to project random features on a scene;
- a pair of IR cameras configured to capture corresponding IR images of the scene and the random features;
- a pair of visible light cameras configured to capture corresponding visible light images of the scene;
- a sparse component configured to employ a sparse location-based matching algorithm to locate the features in the corresponding IR images and to determine depths of individual random features;
- and,
- a dense component configured to employ a nearest neighbor field (NNF) stereo matching algorithm to the corresponding visible images utilizing the depths of the individual random features to determine depths of pixels in the corresponding visible light images.
3 more elements
Dependencies are inferred from the claim text.