US 2018/0007344 A1Published application

Stereoscopic image capture

AssigneeFacebook, Inc.

InventorsMichael F. Cohen, Richard Szeliski, Bryce Alan Evans, Johannes Peter Kopf

Life of this patent

Estimating the term…

Loading patent…

Abstract

An assembly includes a pair of image capture devices that capture 360-degree, stereo cubemap representation images of a scene. A controller generates a representation of the scene by correcting errors caused by placement of the image capture devices relative to each other in the assembly. The controller rotates an image from the image capture device to align objects in the image with objects in an image from the additional image capture device. Additionally, the controller replaces portions of an image from the image capture device including the additional image capture device with portions of an image from the additional image capture device. Additionally, the controller uses optical flow to cancel horizontal disparity and vertical disparity between images captured by the image capture device and by the additional image capture device.

Claims21

Dependent claims

A system comprising:

a first image capture device coupled to a connecting member, the first image capture device configured to capture images of a 360 degree field of view surrounding the first image capture device;
a second image capture device coupled to the connecting member so the first image capture device and the second image capture device are in a common plane parallel to the connecting member, the second image capture device configured to capture images of a 360 field of view surrounding the second image capture device;
and
a controller coupled to the image capture device and to the second image capture device, the controller configured to:
receive images captured by the first image capture device;
receive additional images captured by the second image capture device;
align images captured by the first image capture device with additional images captured by the second image capture device;
equalize horizontal disparity between the aligned images captured by the first image capture device and the additional images captured by the second image capture device;
and
generate one or more equirectangular images by combining the equalized aligned images and the equalized aligned additional images.

7 more elements

A method comprising:

receiving images from a first image capture device coupled to a connecting member, the images describing a 360 degree field of view surrounding the first image capture device;
receiving additional images from a second image capture device coupled to the connecting member so the first image capture device and the second image capture device are in a common plane parallel to the connecting member, the additional images describing a 360 field of view surrounding the second image capture device;
aligning images received from the first image capture device with additional images received from the second image capture device;
equalizing horizontal disparity between the aligned images received from the first image capture device and the additional images received from the second image capture device;
and
generating one or more equirectangular images by combining the equalized aligned images and the equalized aligned additional images.

3 more elements

Dependencies are inferred from the claim text.

Facts

Application: 15/639,030Filed 30 Jun 2017
Priority: 1 Jul 2016
Published: 4 Jan 2018
Term ends: Not estimatedThe source records don’t support an estimate.

Classification8 codes

H04N 13/239
Using stereoscopic image cameras: using two two-dimensional [2D] image sensors having a relative position equal to or related to the interocular…
G06T 3/4038
Scaling of whole images or parts thereof, e.g. expanding or contracting: image mosaicing, e.g. composing plane images from plane sub-images
H04N 13/106
Processing, recording or transmission of stereoscopic or multi-view image signals: processing image signals
H04N 13/128
Processing image signals: adjusting depth or disparity