Camera system utilizing auxiliary image sensors
AssigneeMine One GmbH
InventorsJames A. Mccombe, Christoph Birkhold
Life of this patent
Estimating the term…
Abstract
Methods, devices, systems and computer software/program code products include techniques for creating a deep frame buffer, such techniques being implementable in conjunction with an apparatus comprising a main camera and an array of buddy cameras, the main camera and the buddy cameras being operable to capture images; and techniques for creating at least one depth buffer, such techniques being implementable in conjunction with an apparatus comprising at least two cameras.
Claims20
In an apparatus comprising a main camera and an array of buddy cameras, the main camera and the buddy cameras being operable to capture images, a method for creating a deep frame buffer, the method comprising:
- A. receiving at least two images from the array of buddy cameras;
- B. rectifying and un-distorting the at least two images received from the array of buddy cameras into at least one common coordinate system;
- C. computing at least one disparity solution based on the rectified and undistorted images;
- D. reconstructing a frame buffer utilizing parameter information, the parameter information comprising:
- (i) relative orientation information relating the main camera to the buddy camera array, and
- (ii) relative lens information relating the main camera lens configuration to the undistorted buddy camera images;
- and
- E. merging at least one reconstructed frame buffer with at least one frame buffer captured from a main camera.
A system operable to create a deep frame buffer, the system comprising:
- a main camera and an array of buddy cameras, the main camera and the buddy cameras being operable to capture images;
- and
- a digital processing resource comprising at least one digital processor, the digital processing resource being operable to:
- A. receive at least two images from the array of buddy cameras;
- B. rectify and un-distort the at least two images received from the array of buddy cameras into one or more common coordinate systems;
- C. compute at least one disparity solution based on the rectified and undistorted images;
- D. reconstruct a frame buffer utilizing parameter information, the parameter information comprising:
- (i) relative orientation information relating the main camera to the buddy camera array, and
- (ii) relative lens information relating the main camera lens configuration to the undistorted buddy camera images;
- and
- E. merge at least one reconstructed frame buffer with at least one frame buffer captured from a main camera.
A non-transitory digital processor-readable medium useable in a digital processing system, the digital processing system comprising at least one digital processor and operable to receive images from an apparatus comprising a main camera and an array of buddy cameras, the main camera and the buddy cameras being operable to capture images, the digital processor-readable medium comprising digital processor-executable program instructions, which, when executed in the digital processing system, cause the digital processing system to:
- execute a method for creating a deep frame buffer, the method comprising:
- A. receiving at least two images from the array of buddy cameras;
- B. rectifying and un-distorting the at least two images received from the array of buddy cameras into at least one common coordinate system;
- C. computing at least one disparity solution based on the rectified and undistorted images;
- D. reconstructing a frame buffer utilizing parameter information, the parameter information comprising:
- (i) relative orientation information relating the main camera to the buddy camera array, and
- (ii) relative lens information relating the main camera lens configuration to the undistorted buddy camera images;
- and
- E. merging at least one reconstructed frame buffer with at least one frame buffer captured from a main camera.
Dependencies are inferred from the claim text.