Back to results
US 10,119,809 B2Granted
Simulating multi-camera imaging systems
AssigneeIntel Corporation
InventorsRamkumar Narayanswamy, Ginni Grover, Ram C. Nalla
Life of this patent
Estimating the term…
Abstract
Camera simulation is extended to multi-camera systems. One aspect relates combine computer-graphics, single-camera simulation, multi-camera image signal processor (ISP) are combined to simulate and optimize a multi-camera system. Scene modeling is performed using synthetic computer generated scenes. The computer-graphics images are generated, taking into account the camera-intrinsic and camera-extrinsic parameters.
Claims31
A method comprising:
- generating a 2D projection of a virtual scene using a computer;
- converting the 2D projection into an optical image using an image propagation method via the computer;
- processing the virtual scene to form a de-magnified image of the virtual scene on a sensor plane and imparting lens aberration and diffraction effects to the virtual scene on the sensor plane to produce a raw image via the computer;
- processing the raw image using a camera image signal processing pipe to create virtual images that correspond to images from different real cameras;
- processing the virtual images in a multi-camera image signal processing pipe;
- developing a three-dimensional model of the virtual scene and then to render the virtual scene for each of a plurality of virtual cameras of a virtual multi-camera system using ray tracing;
- and
- providing field of view and parallax for each of the plurality of virtual cameras of said virtual multi-camera system, according to position of each of said plurality of virtual cameras.
5 more elements
One or more non-transitory computer readable media storing instructions executed by a processor to perform a sequence comprising:
- generating a 2D projection of a virtual scene using a computer;
- converting the 2D projection into an optical image using an image propagation method via the computer;
- processing the virtual scene to form a de-magnified image of the virtual scene on a sensor plane and imparting lens aberration and diffraction effects to the virtual scene on the sensor plane to produce a raw image via the computer;
- processing the raw image using a camera image signal processing pipe to create virtual images that correspond to images from different real cameras;
- processing the virtual images in a multi-camera image signal processing pipe;
- developing a three-dimensional model of the virtual scene and then to render the virtual scene for each of a plurality of virtual cameras of a virtual multi-camera system using ray tracing;
- and
- providing field of view and parallax for each of the plurality of virtual cameras of said virtual multi-camera system, according to position of each of said plurality of virtual cameras.
5 more elements
An apparatus comprising:
- a hardware processor to generate a 2D projection of a virtual scene using a computer, convert the 2D projection into an optical image using an image propagation method via the computer, process the virtual scene to form a de-magnified image of the virtual scene on a sensor plane and
- impart lens aberration and diffraction effects to the virtual scene on the sensor plane to produce a raw image via the computer, process the raw image using a camera image signal processing pipe to create virtual images that correspond to images from different real cameras, develop a three-dimensional model of the virtual scene and then to render the virtual scene for each of a plurality of virtual cameras of a virtual multi-camera system using ray tracing, and provide field of view and parallax for each of the plurality of virtual cameras of said virtual multi-camera system, according to position of each of said plurality of virtual cameras;
- and
- a storage coupled to said processor.
1 more element
Dependencies are inferred from the claim text.