Back to results
US 12,627,904 B2Granted
Simultaneous subsampling and high dynamic range imaging in colour filter arrays
AssigneeVarjo Technologies Oy
InventorMikko Ollila
Life of this patent
Estimating the term…
Abstract
Image data from an image sensor (102, 202, 302, 402) is read out, wherein when reading out, processor(s) (104, 204, 304, 404) is/are configured to employ subsampling. The image data is processed, using neural network(s), to generate an image.
Claims3
An imaging system comprising:
- an image sensor comprising:
- a plurality of photo-sensitive cells arranged on a photo-sensitive surface of the image sensor;
- and
- a colour filter array comprising a plurality of smallest repeating units arranged sequentially, wherein a given smallest repeating unit comprises one array of red colour filters, one array of blue colour filters and two arrays of green colour filters;
- and
- at least one processor configured to:
- read out image data from the image sensor, wherein when reading out, the at least one processor is configured to employ subsampling in at least a region of the photo-sensitive surface, by:
- reading out the image data from those photo-sensitive cells that correspond to at most 75 percent of each array of colour filters in smallest repeating units, wherein at least two different settings pertaining to at least one of:
- an exposure time, a sensitivity, an aperture size, are used for different colour filters in a given array of a same colour, and wherein the at least two different settings comprises at least one first setting and at least one second setting, wherein an order in which the at least one first setting and the at least one second setting are used for different colour filters in a given array of a same colour is different from an order in which the at least one first setting and the at least one second setting are used for different colour filters in a neighbouring array of the same colour;
- and
- skipping read out from those photo-sensitive cells that correspond to a remainder of each array of colour filters in the smallest repeating units;
- and
- process the image data, using at least one neural network, to generate a high dynamic range (HDR) image.
10 more elements
A method comprising:
- reading out image data from an image sensor, by employing subsampling in at least a region of a photo-sensitive surface of the image sensor, wherein the image sensor comprises a plurality of photo-sensitive cells arranged on the photo-sensitive surface, and a colour filter array comprising a plurality of smallest repeating units arranged sequentially, wherein a given smallest repeating unit comprises one array of red colour filters, one array of blue colour filters and two arrays of green colour filters, and wherein the step of reading out the image data comprises:
- reading out the image data from those photo-sensitive cells that correspond to at most 75 percent of each array of colour filters in smallest repeating units, wherein at least two different settings pertaining to at least one of:
- an exposure time, a sensitivity, an aperture size, are used for different colour filters in a given array of a same colour, and wherein the at least two different settings comprises at least one first setting and at least one second setting, wherein an order in which the at least one first setting and the at least one second setting are used for different colour filters in a given array of a same colour is different from an order in which the at least one first setting and the at least one second setting are used for different colour filters in a neighbouring array of the same colour;
- and
- skipping read out from those photo-sensitive cells that correspond to a remainder of each array of colour filters in the smallest repeating units;
- and
- processing the image data, using at least one neural network, for generating a high dynamic range (HDR) image.
4 more elements
Dependencies are inferred from the claim text.