Back to results
US 11,637,998 B1Granted
Determination of luminance values using image signal processing pipeline
AssigneeNVIDIA Corporation
InventorsSean Midthun Pieper, Robin Brian Jenkin
Life of this patent
Estimating the term…
Abstract
Apparatuses, systems, and techniques to receive, at one or more processors associated with an image signal processing (ISP) pipeline for a camera, an image generated using an image sensor of the camera, wherein the image comprises a plurality of channels associated with color information of the image; process, by the one or more processors, the plurality of channels of the image to generate a plurality of luminance and/or radiance values; generate, by the one or more processors, an updated version of the image using the plurality of luminance and/or radiance values; and output the updated version of the image.
Claims30
A method comprising:
- receiving, at one or more processors associated with an image signal processing (ISP) pipeline for a camera, an image generated using an image sensor of the camera, wherein the image comprises a plurality of channels associated with color information of the image;
- processing, by the one or more processors, the plurality of channels of the image to generate a second plurality of channels associated with corrected color information in a corrected color space;
- determining, by the one or more processors, an exposure value of the camera based on a set of exposure parameters of the camera, wherein each of the set of exposure parameters is at least one of a configuration parameter of the camera or a physical property of the camera;
- determining, by the one or more processors, a plurality of luminance values based at least in part on the second plurality of channels associated with corrected color information and the exposure value;
- generating, by the one or more processors, an updated version of the image using the plurality of luminance values;
- and
- outputting the updated version of the image.
4 more elements
A system comprising:
- a camera operatively coupled to an image signal processing (ISP) pipeline;
- and
- one or more processors associated with the ISP pipeline to:
- receive an image generated using an image sensor of the camera, wherein the image comprises a plurality of channels associated with color information of the image;
- process the plurality of channels of the image to generate a second plurality of channels associated with corrected color information in a corrected color space;
- determine an exposure value of the camera based on a set of exposure parameters of the camera, wherein each of the set of exposure parameters is at least one of a configuration parameter of the camera or a physical property of the camera;
- determine a plurality of luminance values based at least in part on the second plurality of channels associated with corrected color information and the exposure value;
- generate an updated version of the image using the plurality of luminance values;
- and
- output the updated version of the image.
7 more elements
A system comprising:
- a camera operatively coupled to an image signal processing (ISP) pipeline;
- and
- one or more processors associated with the ISP pipeline to:
- receive, by the one or more processors, an image generated using an image sensor of the camera, wherein the image comprises a plurality of channels associated with color information of the image;
- process, by the one or more processors, the plurality of channels of the image to generate a second plurality of channels associated with corrected color information in a corrected color space;
- determine, by the one or more processors, an exposure value of the camera based on a set of exposure parameters of the camera, wherein each of the set of exposure parameters is at least one of a configuration parameter of the camera or a physical property of the camera;
- determine, by the one or more processors, a plurality of radiance values based at least in part on the second plurality of channels associated with corrected color information and the exposure value;
- generate, by the one or more processors, an updated version of the image using the plurality of radiance values;
- and
- output, by the one or more processors, the updated version of the image.
7 more elements
An imaging device comprising:
- one or more image sensors;
- and
- one or more processors operatively coupled to the one or more image sensors, the one or more processors coupled to an image signal processing (ISP) pipeline to:
- receive an image generated using an image sensor of the imaging device, wherein the image comprises a plurality of channels associated with color information of the image;
- process the plurality of channels of the image to generate a second plurality of channels associated with corrected color information in a corrected color space;
- determine an exposure value of the camera based on a set of exposure parameters of the camera, wherein each of the set of exposure parameters is at least one of a configuration parameter of the camera or a physical property of the camera;
- determine a plurality of luminance values based at least in part on the second plurality of channels associated with corrected color information and the exposure value;
- generate an updated version of the image using the plurality of luminance values;
- and
- output the updated version of the image.
7 more elements
An autonomous vehicle comprising:
- a plurality of cameras;
- and
- one or more processors operatively coupled to the plurality of cameras, the one or more processors associated with an image signal processing (ISP) pipeline, wherein the one or more processors are to:
- receive one or more images from the plurality of cameras of the autonomous vehicle, each image of the one or more images comprising a plurality of channels associated with color information;
- process the one or more images to generate, for each image of the one or more images, a second plurality of channels associated with corrected color information in a corrected color space;
- determine, for each camera of the plurality of cameras, an exposure value of the camera based on a set of exposure parameters of the camera, wherein each of the set of exposure parameters is at least one of a configuration parameter of the camera or a physical property of the camera;
- determine, for each image of the one or more images, a plurality of luminance values based at least in part on the second plurality of channels associated with corrected color information and an exposure value of a camera from which the image was received, wherein the plurality of luminance values of the one or more images are normalized across the one or more images;
- and
- output, for each image of the one or more images, an updated version of the image comprising the plurality of luminance values for that image.
6 more elements
A method comprising:
- receiving, at one or more processors associated with an image signal processing (ISP) pipeline for a camera, an image generated using an image sensor of the camera, wherein the image comprises a plurality of channels associated with color information of the image;
- processing, by the one or more processors, the plurality of channels of the image to generate a second plurality of channels associated with corrected color information in a corrected color space;
- determining an exposure value of the camera based on a set of exposure parameters of the camera, wherein each of the set of exposure parameters is at least one of a configuration parameter of the camera or a physical property of the camera;
- determining, by the one or more processors, a plurality of radiance values based at least in part on the second plurality of channels associated with corrected color information and the exposure value;
- generating, by the one or more processors, an updated version of the image using the plurality of radiance values;
- and
- outputting the updated version of the image.
4 more elements
Dependencies are inferred from the claim text.