Back to results
US 12,713,144 B2Granted
Alternate subsampling in colour filter arrays
AssigneeVarjo Technologies Oy
InventorMikko Ollila
Life of this patent
Estimating the term…
Abstract
Image data from an image sensor is read out, wherein when reading out, processor(s) is/are configured to employ subsampling by: reading out the image data from photo-sensitive cells that correspond to a first set of lines in a colour filter array (CFA), wherein a given line in the first set has colour filters of each of at least three different colours, the given line being a row (R1-R8) or a column (C1-C8) of the CFA; and skipping read out from photo-sensitive cells that correspond to a second set of lines in the CFA, wherein the first set of lines has one of: odd lines in the CFA, even lines in the CFA, while the second set of lines has another of: the odd lines, the even lines. The image data is processed to generate an image.
Claims6
An imaging system comprising:
- an image sensor comprising:
- a plurality of photo-sensitive cells arranged on a photo-sensitive surface of the image sensor;
- and
- a colour filter array comprising colour filters of at least three different colours;
- and
- at least one processor configured to:
- read out image data from the image sensor, wherein when reading out, the at least one processor is configured to employ subsampling in at least a region of the photo-sensitive surface, by:
- reading out the image data from those photo-sensitive cells that correspond to a first set of lines in the colour filter array, wherein a given line in the first set comprises colour filters of each of the at least three different colours;
- and
- skipping read out from those photo-sensitive cells that correspond to a second set of lines in the colour filter array, wherein the first set of lines comprises one of:
- odd lines in the colour filter array, even lines in the colour filter array, while the second set of lines comprises another of:
- the odd lines, the even lines;
- obtaining information indicative of a gaze direction of a user;
- determining a gaze region and a peripheral region in the photo-sensitive surface of the image sensor, based on the gaze direction;
- and
- while reading out the image data from those photo-sensitive cells that correspond to a first set of lines in the colour filter array and skipping read out from those photo-sensitive cells that correspond to a second set of lines in the colour filter array, further employing the subsampling with a first subsampling density in the gaze region and with a second subsampling density in the peripheral region, the first subsampling density being higher than the second subsampling density;
- the at least one processor further configured to process the image data to generate an image;
- wherein the given line in the first set is a row of the colour filter array, and wherein another given line in the first set comprising colour filters of each of the at least three different colours is a column of the colour filter array.
15 more elements
A method comprising:
- reading out image data from an image sensor, wherein the image sensor comprises a plurality of photo-sensitive cells arranged on a photo-sensitive surface of the image sensor, and a colour filter array comprising colour filters of at least three different colours, and wherein the step of reading out comprises employing subsampling in at least a region of the photo-sensitive surface, by:
- reading out the image data from those photo-sensitive cells that correspond to a first set of lines in the colour filter array, wherein a given line in the first set comprises colour filters of each of the at least three different colours;
- and
- skipping read out from those photo-sensitive cells that correspond to a second set of lines in the colour filter array, wherein the first set of lines comprises one of:
- odd lines in the colour filter array, even lines in the colour filter array, while the second set of lines comprises another of:
- the odd lines, the even lines;
- obtaining information indicative of a gaze direction of a user;
- determining a gaze region and a peripheral region in the photo-sensitive surface of the image sensor, based on the gaze direction;
- and
- while reading out the image data from those photo-sensitive cells that correspond to a first set of lines in the colour filter array and skipping read out from those photo-sensitive cells that correspond to a second set of lines in the colour filter array, further employing the subsampling with a first subsampling density in the gaze region and with a second subsampling density in the peripheral region, the first subsampling density being higher than the second subsampling density;
- and
- processing the image data to generate an image;
- wherein the given line in the first set is a row of the colour filter array, and wherein another given line in the first set comprising colour filters of each of the at least three different colours is a column of the colour filter array.
10 more elements
An imaging system comprising:
- an image sensor comprising:
- a plurality of photo-sensitive cells arranged on a photo-sensitive surface of the image sensor;
- and
- a colour filter array comprising sets of repeating rows or columns, wherein a given set of repeating rows or columns comprises N rows or columns that repeat consecutively;
- and
- at least one processor configured to:
- read out image data from the image sensor, wherein when reading out, the at least one processor is configured to employ subsampling in at least a region of the photo-sensitive surface, by:
- reading out the image data from those photo-sensitive cells that correspond to at most N-1 rows or columns out of the N rows or columns in each set of repeating rows or columns;
- and
- skipping read out from those photo-sensitive cells that correspond to a remainder of the N rows or columns in each set of repeating rows or columns;
- obtaining information indicative of a gaze direction of a user;
- determining a gaze region and a peripheral region in the photo-sensitive surface of the image sensor, based on the gaze direction;
- and
- while reading out the image data from those photo-sensitive cells that correspond to a first set of lines in the colour filter array and skipping read out from those photo-sensitive cells that correspond to a second set of lines in the colour filter array, employing the subsampling with a first subsampling density in the gaze region and with a second subsampling density in the peripheral region, the first subsampling density being higher than the second subsampling density;
- the at least one processor further configured to process the image data to generate an image.
12 more elements
A method comprising:
- reading out image data from an image sensor, wherein the image sensor comprises a plurality of photo-sensitive cells arranged on a photo-sensitive surface of the image sensor, and a colour filter array comprising sets of repeating rows or columns, wherein a given set of repeating rows or columns comprises N rows or columns that repeat consecutively, and wherein the step of reading out comprises employing subsampling in at least a region of the photo-sensitive surface, by:
- reading out the image data from those photo-sensitive cells that correspond to at most N-1 rows or columns out of the N rows or columns in each set of repeating rows or columns;
- and
- skipping read out from those photo-sensitive cells that correspond to a remainder of the N rows or columns in each set of repeating rows or columns;
- obtaining information indicative of a gaze direction of a user;
- determining a gaze region and a peripheral region in the photo-sensitive surface of the image sensor, based on the gaze direction, and
- while reading out the image data from those photo-sensitive cells that correspond to a first set of lines in the colour filter array and skipping read out from those photo-sensitive cells that correspond to a second set of lines in the colour filter array, further employing the subsampling with a first subsampling density in the gaze region and with a second subsampling density in the peripheral region, the first subsampling density being higher than the second subsampling density;
- and
- processing the image data to generate an image.
6 more elements
Dependencies are inferred from the claim text.