Imaging device, camera and image processing method
AssigneeNikon Corporation
InventorYosuke Kusaka
Life of this patent
Estimating the term…
Abstract
An imaging device includes an image sensor and an estimating circuit. The image sensor includes a plurality of pixel units disposed in a two-dimensional array, each equipped with a plurality of imaging pixels with varying spectral sensitivity characteristics set regularly, and focus detection pixels with sensitivity over a range encompassing the spectral sensitivity of the pixel units. The estimating circuit determines an image output structure corresponding to the position of each focus detection pixel based upon outputs from the imaging pixels present around the focus detection pixel and estimates the image output at the focus detection pixel based upon the image output structure and the output from the focus detection pixel.
Claims23
An imaging device, comprising:
- an image sensor that includes a plurality of pixel units disposed in a two-dimensional array, each equipped with a plurality of imaging pixels with varying spectral sensitivity characteristics set regularly, and focus detection pixels with sensitivity over a range encompassing the spectral sensitivity of the pixel units, which are set in the array of the pixel units;
- and
- an estimating circuit that determines an image output structure corresponding to the position of each focus detection pixel based upon outputs from the imaging pixels present around the focus detection pixel and estimates an image output at the focus detection pixel based upon the image output structure and an output from the focus detection pixel.
An imaging device, comprising:
- an image sensor that includes a plurality of imaging pixels with varying spectral sensitivity characteristics and focus detection pixels;
- an arithmetic operation circuit that determines through arithmetic operation an image output structure corresponding to a position of each focus detection pixel based upon outputs from the imaging pixels;
- and
- an output circuit that outputs an image corresponding to the position of the focus detection pixel based upon the image output structure and an output from the focus detection pixel.
An imaging device, comprising:
- an image sensor that includes a plurality of pixel units each equipped with three different types of pixels set in a Bayer array with sensitivity to red, green and blue, and focus detection pixels disposed in the array of the plurality of pixel units, with sensitivity to all the colors to which the plurality of pixel units are sensitive;
- an arithmetic operation circuit that determines through arithmetic operation an image color structure corresponding to a position of each focus detection pixel based upon outputs from imaging pixels present around the focus detection pixel;
- and
- an output circuit that outputs an image corresponding to the position of the focus detection pixel based upon the image color structure and an output from the focus detection pixel.
An imaging device, comprising:
- an image sensor that includes a plurality of pixel units disposed in a two-dimensional array, each equipped with a plurality of imaging pixels with varying spectral sensitivity characteristics set regularly, and focus detection pixels with sensitivity over a range encompassing the spectral sensitivity of the pixel units, which are set in the array of the pixel units;
- and
- an estimating circuit that determines an image output structure corresponding to the position of each focus detection pixel based upon outputs from the imaging pixels present around the focus detection pixel and estimates an image output at the focus detection pixel based upon the image output structure and an output from the focus detection pixel, wherein:
- the estimating circuit estimates the image output at the focus detection pixel by dividing the output from the focus detection pixel in correspondence to the image output structure.
An imaging device, comprising:
- an image sensor that includes a plurality of imaging pixels with varying spectral sensitivity characteristics and focus detection pixels;
- an arithmetic operation circuit that determines through arithmetic operation an image output structure corresponding to a position of each focus detection pixel based upon outputs from the imaging pixels;
- and
- an output circuit that outputs an image corresponding to the position of the focus detection pixel based upon the image output structure and an output from the focus detection pixel, wherein:
- the output circuit outputs the image corresponding to the position of the focus detection pixel, which is obtained by multiplying the output from the focus detection pixel by a ratio corresponding to the image output structure.
An image processing method, comprising:
- output structure ratio calculation processing for determining through arithmetic operation an image output structure corresponding to a position of each focus detection pixel in an image sensor that includes a plurality of pixel units disposed in a two-dimensional array, each equipped with a plurality of imaging pixels with varying spectral sensitivity characteristics set regularly, and focus detection pixels with sensitivity over a range encompassing the spectral sensitivity of the pixel units, which are disposed in the array of the pixel units, based upon outputs from the imaging pixels present around the focus detection pixel;
- and
- image output estimation processing for estimating an image output at the focus detection pixel based upon the image output structure and an output from the focus detection pixel.
An image processing method, comprising:
- determining an image output structure corresponding to the position of each focus detection pixel based upon outputs from imaging pixels in an image sensor that includes a plurality of imaging pixels with varying spectral sensitivity characteristics and focus detection pixels;
- and
- determining an image output at the focus detection pixel based upon the image output structure and an output from the focus detection pixel.
An imaging device, comprising:
- an image sensor that includes a plurality of pixel units disposed in a two-dimensional array, each equipped with a plurality of imaging pixels with varying spectral sensitivity characteristics set regularly, and focus detection pixels with sensitivity over a range encompassing the spectral sensitivity of the pixel units, which are set in the array of the pixel units;
- and
- an estimating circuit that corrects outputs from the imaging pixels disposed at low arraying density based upon outputs from the imaging pixels disposed at high arraying density among the imaging pixels present around each focus detection pixel and estimates an image output at the focus detection pixel based upon the corrected outputs from the imaging pixels disposed at low arraying density.
An imaging device, comprising:
- an image sensor that includes a plurality of imaging pixels with varying spectral sensitivity characteristics and focus detection pixels;
- a correction circuit that corrects outputs from the imaging pixels with spectral sensitivity characteristics corresponding to low arraying density based upon outputs from the imaging pixels with spectral sensitivity characteristics corresponding to high arraying density among the imaging pixels present around each focus detection pixels;
- and
- an output circuit that outputs an image at the focus detection pixel based upon the outputs from the imaging pixels with the spectral sensitivity characteristics corresponding to the low arraying density, which have been corrected by the correction circuit.
An imaging device, comprising:
- an image sensor that includes a plurality of pixel units each equipped with three different types of pixels set in a Bayer array with sensitivity to red, green and blue, and focus detection pixels disposed in the array of the plurality of pixel units, sensitive to all the colors to which the plurality of pixel units are sensitive;
- a correction circuit that corrects outputs from the imaging pixels set with low arraying density based upon outputs from the imaging pixels set with high arraying density among the imaging pixels present around each focus detection pixel;
- and
- an output circuit that outputs an image at the focus detection pixel based upon the output from the imaging pixels set with the low arraying density, which have been corrected by the correction circuit.
An imaging device, comprising:
- an image sensor that includes a plurality of pixel units disposed in a two-dimensional array, each equipped with a plurality of imaging pixels with varying spectral sensitivity characteristics set regularly, and focus detection pixels with sensitivity over a range encompassing the spectral sensitivity of the pixel units, which are set in the array of the pixel units;
- and
- an estimating circuit that converts outputs from the imaging pixels set with low arraying density to outputs from pixels near each of the focus detection pixel based upon outputs from the imaging pixels set with high arraying density, which are present near the imaging pixels set with the low arraying density, among the imaging pixels present around the focus detection pixel and outputs from the imaging pixels set with the high arraying density, which assume positions closer to the focus detection pixel than the imaging pixels set with the low arraying density, and estimates an image output at the focus detection pixel based upon the converted pixel output.
An imaging device, comprising:
- an image sensor that includes a plurality of imaging pixels with varying spectral sensitivity characteristics and focus detection pixels;
- a conversion circuit that converts outputs from the imaging pixels with spectral sensitivity characteristics corresponding to low arraying density to an output at each focus detection pixel based upon outputs from the imaging pixels with spectral sensitivity characteristics corresponding to a high arraying density, which are present near the imaging pixels with spectral sensitivity characteristics corresponding to low arraying density, among the imaging pixels present around the focus detection pixel and outputs from the imaging pixels set with the high arraying density, which assume positions closer to the focus detection pixel than the imaging pixels with the spectral sensitivity characteristics corresponding to the low arraying density;
- and
- an output circuit that outputs an image at the focus detection pixel based upon the outputs from the imaging pixels with the spectral sensitivity characteristics corresponding to the low arraying density, having been converted by the conversion circuit.
An image processing method, comprising:
- correction processing for correcting outputs from imaging pixels set at low arraying density based upon outputs from imaging pixels set at high arraying density among imaging pixels present around each focus detection pixel in an image sensor that includes a plurality of pixel units disposed in a two-dimensional array, each equipped with a plurality of imaging pixels with varying spectral sensitivity characteristics set regularly, and focus detection pixels with sensitivity over a range encompassing the spectral sensitivity of the pixel units, which are disposed in the array of the pixel units;
- and
- estimation processing for estimating an image output at the focus detection pixel based upon the outputs from the imaging pixels set at the low arraying density, which have been corrected through the correction processing.
An image processing method, comprising:
- correcting outputs from imaging pixels with spectral sensitivity characteristics corresponding to low arraying density based upon outputs from imaging pixels with spectral sensitivity characteristics corresponding to high arraying density among imaging pixels present around each focus detection pixel in an image sensor that includes a plurality of imaging pixels with varying spectral sensitivity characteristics and focus detection pixels;
- and
- determining an image output at the focus detection pixel based upon the corrected outputs from the imaging pixels with the spectral sensitivity characteristics corresponding to the low arraying density.
Dependencies are inferred from the claim text.