# US 2021/0280618 A1 · Image pickup apparatus having image sensor equipped with polarizing element and control method therefor > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2021/0280618 A1 - Document ID: US20210280618A1 - Status: Published application - Kind: A1 - Application number: 17/176,631 - Filed: 2021-02-16 - Published: 2021-09-09 - Earliest claimed: 2020-03-05 - Assignees: Canon Kabushiki Kaisha - Applicants: Canon Kabushiki Kaisha - Inventors: Yusuke Yamashita; Tokuro Nishida; Kazuya Kitamura; Hiroyuki Hasegawa; Takenori Kobuse; Yoshikazu Ishikawa; Takayuki Kimura - Web page: https://patentgrep.com/patent/US20210280618A1 ## CPC - H10F 39/805: {Coatings} - H10F 39/8053: {Colour filters} - H04N 23/45: for generating image signals from two or more image sensors being of different type or operating in different modes, e.g. with a CMOS sensor for moving images in combination with a charge-coupled device [CCD] for still images - H04N 23/55: Optical parts specially adapted for electronic image sensors; Mounting thereof - H04N 23/81: for suppressing or minimising disturbance in the image signal generation - H04N 25/134: {based on three different wavelength filter elements} - H10F 39/803: {Pixels having integrated switching, control, storage or amplification elements} - H10F 39/806: {Optical elements or arrangements associated with the image sensors} - H10F: INORGANIC SEMICONDUCTOR DEVICES SENSITIVE TO INFRARED RADIATION, LIGHT, ELECTROMAGNETIC RADIATION OF SHORTER WAVELENGTH OR CORPUSCULAR RADIATION - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract An image pickup apparatus that enables to quickly capture an image from which a predetermined reflected light component is removed with desired sensitivity. A polarizing filter two-dimensionally arranges a plurality of sets each of which includes polarizing filter elements having different polarization directions. A first image sensor has pixels that respectively correspond to polarizing filter elements of the polarizing filter. A polarization calculation unit detects a polarized component of light that enters into a region in which one set of polarizing filter elements are arranged based on signals output from pixels in the region of the first image sensor for each region. A correction unit corrects a pixel signal output from a pixel of a second image sensor corresponding to the region based on a calculation result by the polarization calculation unit for each pixel of the second image sensor. ## Claims ### Claim 1 An image pickup apparatus comprising: a polarizing filter configured to two-dimensionally arrange a plurality of sets each of which includes polarizing filter elements having different polarization directions; a first image sensor configured to have pixels that respectively correspond to polarizing filter elements of the polarizing filter; a second image sensor; a polarization calculation unit configured to detect a polarized component of light that enters into a region in which one set of polarizing filter elements are arranged based on signals output from pixels in the region of the first image sensor for each region; and a correction unit configured to correct a pixel signal output from a pixel of the second image sensor corresponding to the region based on a calculation result by the polarization calculation unit for each pixel of the second image sensor. ### Claim 2 (depends on 1) The image pickup apparatus according to claim 1, wherein one set of the polarizing filter elements are arranged so as to change the polarization directions mutually, and wherein the correction unit corrects a pixel signal output from a pixel of the second image sensor corresponding to the region using the signals output from pixels in the region of the first image sensor in a case where the polarized component is larger than a predetermined threshold. ### Claim 3 (depends on 1) The image pickup apparatus according to claim 1, further comprising a saturation detection unit configured to detect whether a pixel signal output from the second image sensor is saturated for each pixel, and wherein the correction unit replaces the saturated pixel signal with a signal of a corresponding pixel of the first image sensor in a case where the saturation detection unit detects that the pixel signal from the second image sensor is saturated. ### Claim 4 (depends on 1) The image pickup apparatus according to claim 1, further comprising a frequency detection unit configured to detect a frequency component of the object, and wherein the correction unit does not correct pixel signals output from the second image sensor in a case where the frequency detection unit detects that the object has a high frequency component more than a certain frequency. ### Claim 5 (depends on 1) The image pickup apparatus according to claim 1, wherein the set of polarizing filter elements include at least three polarizing filter elements of which polarization directions are mutually different. ### Claim 6 (depends on 1) The image pickup apparatus according to claim 1, wherein the correction unit corrects a luminance value obtained from the second image sensor by multiplying a value that is obtained by dividing a luminance value of a non-polarized component obtained from the first image sensor by a luminance value obtained from the first image sensor in a case where a phase of the polarized component is zero by a luminance value obtained from the second image sensor for each pixel of the second image sensor. ### Claim 7 (depends on 1) The image pickup apparatus according to claim 1, further comprising: a first optical system configured to guide light from the object to the first image sensor; a second optical system configured to guide light from the object to the second image sensor; and an alignment unit configured to correct pixel signals obtained from at least one of the first and second image sensors so as to eliminate deviation between a position of an object image obtained from the first image sensor and a position of an object image obtained from the second image sensor. ### Claim 8 (depends on 1) The image pickup apparatus according to claim 1, wherein a color filter that is configured by arranging red filter elements, green filter elements, and blue filter element in a Bayer arrangement is provided to each of the first and second image sensors. ### Claim 9 (depends on 1) The image pickup apparatus according to claim 1, wherein a pixel size of the second image sensor is identical to a size of a region corresponding to the set of polarizing filter elements of the first image sensor. ### Claim 10 A control method for an image pickup apparatus including a polarizing filter that two-dimensionally arranges a plurality of sets each of which includes polarizing filter elements having different polarization directions, a first image sensor that has pixels that respectively correspond to polarizing filter elements of the polarizing filter, and a second image sensor, the control method comprising: detecting a polarized component of light that enters into a region in which one set of polarizing filter elements are arranged based on signals output from pixels in the region of the first image sensor for each region; determining whether the polarized component is larger than a predetermined threshold; correcting a pixel signal of a pixel of the second image sensor corresponding to the region based on signals output from pixels in the region of the first image sensor in a case where the polarized component is larger than the predetermined threshold; and generating a pickup image using pixel signals of the second image sensor corresponding to regions where polarized components are not larger than the predetermined threshold and signals that are corrected.