Vehicle camera model for simulation using deep neural networks
AssigneeMagna Electronics Inc.
InventorAnuj S. Potnis
Life of this patent
Estimating the term…
Abstract
A camera simulation system or method or process for simulating performance of a camera for a vehicle includes providing a camera having a lens and imager and providing a learning algorithm. Image data is captured from a raw image input of the camera and the captured image data and raw image input are output from the camera. The output image data and the raw image input are provided to the learning algorithm. The learning algorithm is trained to simulate performance of the lens and/or the imager using the output captured image data and the raw image data input. The performance of the lens and/or the imager is simulated responsive to the learning algorithm receiving raw images.
Claims20
A method for simulating performance of a vehicular camera, said method comprising:
- providing a control comprising a data processor that is operable to execute a learning algorithm;
- providing a vehicular camera comprising a lens and imager;
- providing an actual target in a field of view of the vehicular camera;
- capturing, via the vehicular camera, image data representative of the actual target as imaged by the vehicular camera;
- providing the captured image data to the control;
- providing actual target data to the control, wherein the actual target data represents the actual target provided in the field of view of the vehicular camera;
- generating, via the learning algorithm, a learning algorithm output;
- processing, at the control, the captured image data and the learning algorithm output, wherein processing the captured image data and the learning algorithm output comprises comparing the captured image data to the learning algorithm output;
- responsive to the processing of the captured image data and the learning algorithm output, training the learning algorithm to simulate performance of the lens and/or the imager using the captured image data and the actual target data;
- and
- simulating, based on the training of the learning algorithm, the performance of the lens and/or the imager.
A method for simulating performance of a vehicular camera, said method comprising:
- providing a control comprising a data processor that is operable to execute a generative adversarial network;
- providing a vehicular camera comprising a lens and imager;
- providing an actual target in a field of view of the vehicular camera;
- capturing, via the vehicular camera, image data representative of the actual target as imaged by the vehicular camera;
- providing the captured image data to the control;
- providing actual target data to the control, wherein the actual target data represents the actual target provided in the field of view of the vehicular camera;
- generating, via the generative adversarial network, a generative adversarial network output;
- processing, at the control, the captured image data and the generative adversarial network output, wherein processing the captured image data and the generative adversarial network output comprises comparing the captured image data to the generative adversarial network output;
- responsive to the processing of the captured image data and the generative adversarial network output, training the generative adversarial network to simulate performance of the imager using the captured image data and the actual target data;
- simulating, based on the training of the generative adversarial network, the performance of the imager;
- and
- wherein simulating the performance of the imager comprises simulating a performance that is selected from the group consisting of (i) noise, (ii) contrast, (iii) white balance, and (iv) gamma correction.
A method for simulating performance of a vehicular camera, said method comprising:
- providing a control comprising a data processor that is operable to execute a learning algorithm;
- providing a vehicular camera comprising a lens and imager;
- providing an actual target in a field of view of the vehicular camera;
- capturing, via the vehicular camera, image data representative of the actual target as imaged by the vehicular camera;
- providing the captured image data to the control;
- providing actual target data to the control, wherein the actual target data represents the actual target provided in the field of view of the vehicular camera;
- generating, via the learning algorithm, a learning algorithm output;
- processing, at the control, the captured image data and the learning algorithm output, wherein processing the captured image data and the learning algorithm output comprises comparing the captured image data to the learning algorithm output;
- responsive to the processing of the captured image data and the learning algorithm output, training the learning algorithm to simulate performance of the lens and the imager using the captured image data and the actual target data;
- simulating, based on the training of the learning algorithm, the performance of the lens and the imager;
- wherein simulating the performance of the lens and the imager comprises simulating a performance of the lens that is selected from the group consisting of (i) distortion of images by the lens and (ii) a field of view provided by the lens;
- and
- wherein simulating the performance of the lens and the imager comprises simulating a performance of the imager that is selected from the group consisting of (i) noise, (ii) contrast, (iii) white balance, and (iv) gamma correction.
Dependencies are inferred from the claim text.