# US 9,438,771 B2 · Image processing apparatus, image pickup apparatus, image pickup system, image processing method, and non-transitory computer-readable storage medium > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 9,438,771 B2 - Document ID: US9438771B2 - Status: Granted - Kind: B2 - Application number: 14/507,207 - Filed: 2014-10-06 - Published: 2015-04-09 - Granted: 2016-09-06 - Earliest claimed: 2013-10-08 - Assignees: Canon Kabushiki Kaisha - Applicants: Canon Kabushiki Kaisha - Inventors: Takayoshi Yokoyama; Koshi Hatakeyama; Takashi Oniki - Web page: https://patentgrep.com/patent/US9438771B2 ## CPC - H04N 23/81: for suppressing or minimising disturbance in the image signal generation - H04N 25/11: Arrangement of colour filter arrays [CFA]; Filter mosaics - H04N 25/61: the noise originating only from the lens unit, e.g. flare, shading, vignetting or "cos4" - H04N 25/611: Correction of chromatic aberration - H04N 25/615: involving a transfer function modelling the optical system, e.g. optical transfer function [OTF], phase transfer function [PhTF] or modulation transfer function [MTF] - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract An image processing apparatus (100) includes a detection unit (102) configured to detect a first region in which one of a signal level of a color plane corresponding to at least one color filter of an image acquired from an image pickup element including a plurality of color filters and a signal level of a brightness plane generated from the image monotonically increases or monotonically decreases in a first direction in a predetermined section, a determination unit (103) configured to determine a second region in which color bleeding occurs, based on optical information on the color bleeding of an image pickup optical system and information on the first region, and a correction unit (104) configured to correct the image so as to reduce the color bleeding. ## Claims ### Claim 1 An image processing apparatus comprising: a detection unit configured to detect a first region in which one of a signal level of a color plane corresponding to at least one color filter of an image acquired from an image pickup element including a plurality of color filters and a signal level of a brightness plane generated from the image monotonically increases or monotonically decreases in a first direction within a predetermined section; a determination unit configured to determine a second region in which color bleeding of an image pickup optical system occurs, based on optical information on the color bleeding and information on the first region; and a correction unit configured to correct the image so as to reduce the color bleeding, wherein the optical information is information on a second direction in which the color bleeding of the image pickup optical system occurs, and wherein the determination unit is configured to compare the first direction with the second direction to determine the second region. ### Claim 2 (depends on 1) The image processing apparatus according to claim 1, wherein the determination unit is configured to determine that the first region is the second region when the first direction and the second direction match with each other. ### Claim 3 (depends on 2) The image processing apparatus according to claim 2, wherein the correction unit is configured to calculate information on the color bleeding in a plurality of directions to correct the image when the first direction and the second direction match with each other in the plurality of directions. ### Claim 4 (depends on 3) The image processing apparatus according to claim 3, wherein the correction unit is configured to use the information on the intensity of the color bleeding in a centroid direction of the plurality of directions to correct the image when the first direction and the second direction match with each other in the plurality of directions. ### Claim 5 (depends on 1) The image processing apparatus according to claim 1, wherein the optical information is information on an intensity of the color bleeding of the image pickup optical system. ### Claim 6 (depends on 5) The image processing apparatus according to claim 5, wherein the correction unit is configured to change a strength of correcting the image based on the information on the intensity of the color bleeding. ### Claim 7 (depends on 1) The image processing apparatus according to claim 1, further comprising a storage unit configured to store optical information for each of at least one or more shooting conditions. ### Claim 8 (depends on 7) The image processing apparatus according to claim 7, wherein the at least one or more shooting conditions include one of a focal length, an object distance, or an aperture value of the image pickup optical system. ### Claim 9 An image pickup apparatus comprising: an image pickup element configured to photoelectrically convert an optical image; a detection unit configured to detect a first region in which one of a signal level of a color plane corresponding to at least one color filter of an image acquired from the image pickup element including a plurality of color filters and a signal level of a brightness plane generated from the image monotonically increases or monotonically decreases in a first direction within a predetermined section; a determination unit configured to determine a second region in which color bleeding of an image pickup optical system occurs, based on optical information on the color bleeding and information on the first region; and a correction unit configured to correct the image so as to reduce the color bleeding, wherein the optical information is information on a second direction in which the color bleeding of the image pickup optical system occurs, and wherein the determination unit is configured to compare the first direction with the second direction to determine the second region. ### Claim 10 An image pickup system comprising: a lens apparatus including an image pickup optical system; and an image pickup apparatus, wherein the image pickup apparatus includes: an image pickup element configured to photoelectrically convert an optical image; a detection unit configured to detect a first region in which one of a signal level of a color plane corresponding to at least one color filter of an image acquired from the image pickup element including a plurality of color filters and a signal level of a brightness plane generated from the image monotonically increases or monotonically decreases in a first direction within a predetermined section; a determination unit configured to determine a second region in which color bleeding of the image pickup optical system occurs, based on optical information on the color bleeding and information on the first region; and a correction unit configured to correct the image so as to reduce the color bleeding, wherein the optical information is information on a second direction in which the color bleeding of the image pickup optical system occurs, and wherein the determination unit is configured to compare the first direction with the second direction to determine the second region. ### Claim 11 An image processing method comprising the steps of: detecting a first region in which one of a signal level of a color plane corresponding to at least one color filter of an image acquired from an image pickup element including a plurality of color filters and a signal level of a brightness plane generated from the image monotonically increases or monotonically decreases in a first direction within a predetermined section; determining a second region in which color bleeding of an image pickup optical system occurs, based on optical information on the color bleeding and information on the first region; and correcting the image so as to reduce the color bleeding, wherein the optical information is information on a second direction in which the color bleeding of the image pickup optical system occurs, and wherein the determination unit is configured to compare the first direction with the second direction to determine the second region. ### Claim 12 A non-transitory computer-readable storage medium storing an image processing program configured to cause a computer to execute a process comprising the steps of: detecting a first region in which one of a signal level of a color plane corresponding to at least one color filter of an image acquired from an image pickup element including a plurality of color filters and a signal level of a brightness plane generated from the image monotonically increases or monotonically decreases in a first direction within a predetermined section; determining a second region in which color bleeding of an image pickup optical system occurs, based on optical information on the color bleeding and information on the first region; and correcting the image so as to reduce the color bleeding, wherein the optical information is information on a second direction in which the color bleeding of the image pickup optical system occurs, and wherein the determination unit is configured to compare the first direction with the second direction to determine the second region. ### Claim 13 An image processing method comprising the steps of: correcting a chromatic aberration of magnification of a shot image; detecting a first region in which a level of at least one of a color signal and a brightness signal of the shot image in which the chromatic aberration of magnification has been corrected monotonically increases or monotonically decreases in a first direction within a predetermined section; determining a second region in which color bleeding of an image pickup optical system occurs, based on optical information on the color bleeding and information on the first region; and correcting the shot image in which the chromatic aberration of magnification has been corrected, so as to reduce the color bleeding, wherein the optical information is information on a second direction in which the color bleeding of the image pickup optical system occurs, and wherein the determination unit is configured to compare the first direction with the second direction to determine the second region. ### Claim 14 (depends on 13) The image processing method according to claim 13, wherein the step of correcting the chromatic aberration of magnification includes the steps of: detecting the chromatic aberration of magnification based on the shot image; and determining a correction amount of the chromatic aberration of magnification based on the detected chromatic aberration of magnification. ### Claim 15 (depends on 13) The image processing method according to claim 13, wherein the step of correcting the chromatic aberration of magnification includes the step of determining a correction amount of the chromatic aberration of magnification based on correction information of a previously-stored chromatic aberration of magnification. ### Claim 16 (depends on 13) The image processing method according to claim 13, wherein the step of correcting the chromatic aberration of magnification includes the step of correcting a first chromatic aberration of magnification contained as a design value of the image pickup optical system. ### Claim 17 (depends on 16) The image processing method according to claim 16, wherein the step of correcting the chromatic aberration of magnification includes the steps of: detecting an edge region of the shot image; acquiring a color shift amount in the edge region; creating correction data based on an image height of the edge region and the color shift amount; and using the correction data to correct the first chromatic aberration of magnification. ### Claim 18 (depends on 13) The image processing method according to claim 13, wherein the step of correcting the chromatic aberration of magnification includes the step of correcting a second chromatic aberration of magnification corresponding to a difference from a design value of the image pickup optical system. ### Claim 19 (depends on 18) The image processing method according to claim 18, wherein the step of correcting the chromatic aberration of magnification includes the steps of: detecting an edge region of the shot image; calculating a first correction amount with respect to each of a plurality of divided regions of the shot image based on a color shift amount of the edge region; and correcting the second chromatic aberration of magnification by using a second correction amount in a direction different from a radial direction with respect to a center of the shot image, the second correction amount being calculated based on the first correction amount. ### Claim 20 (depends on 19) The image processing method according to claim 19, wherein the step of correcting the second chromatic aberration of magnification includes the step of correcting the second chromatic aberration of magnification by using the second correction amount of the shot image in each of a horizontal direction and a vertical direction, the second correction amount being calculated based on the first correction amount. ### Claim 21 (depends on 19) The image processing method according to claim 19, wherein the first correction amount at a first position and the first correction amount at a second position are different from each other, the first and second positions being symmetrical to the center of the shot image. ### Claim 22 An image processing apparatus comprising: a first correction unit configured to correct a chromatic aberration of magnification of a shot image; a detection unit configured to detect a first region in which a level of at least one of a color signal and a brightness signal of the shot image in which the chromatic aberration of magnification has been corrected monotonically increases or monotonically decreases in a first direction within a predetermined section; a determination unit configured to determine a second region in which color bleeding of an image pickup optical system occurs, based on optical information on the color bleeding and information on the first region; and a second correction unit configured to correct the shot image in which the chromatic aberration of magnification has been corrected, so as to reduce the color bleeding, wherein the optical information is information on a second direction in which the color bleeding of the image pickup optical system occurs, and wherein the determination unit is configured to compare the first direction with the second direction to determine the second region. ### Claim 23 An image pickup apparatus comprising: an image pickup element configured to photoelectrically convert an optical image to output a shot image; a first correction unit configured to correct a chromatic aberration of magnification of the shot image; a detection unit configured to detect a first region in which a level of one of a color signal and a brightness signal of the shot image in which the chromatic aberration of magnification has been corrected monotonically increases or monotonically decreases in a first direction within a predetermined section; a determination unit configured to determine a second region in which color bleeding of an image pickup optical system occurs, based on optical information on the color bleeding and information on the first region; and a second correction unit configured to correct the shot image in which the chromatic aberration of magnification has been corrected, so as to reduce the color bleeding, wherein the optical information is information on a second direction in which the color bleeding of the image pickup optical system occurs, and wherein the determination unit is configured to compare the first direction with the second direction to determine the second region. ### Claim 24 A non-transitory computer-readable storage medium storing an image processing program configured to cause a computer to execute a process comprising the steps of: correcting a chromatic aberration of magnification of a shot image; detecting a first region in which a level of at least one of a color signal and a brightness signal of the shot image in which the chromatic aberration of magnification has been corrected monotonically increases or monotonically decreases in a first direction within a predetermined section; determining a second region in which color bleeding of an image pickup optical system occurs, based on optical information on the color bleeding and information on the first region; and correcting the shot image in which the chromatic aberration of magnification has been corrected, so as to reduce the color bleeding, wherein the optical information is information on a second direction in which the color bleeding of the image pickup optical system occurs, and wherein the determination unit is configured to compare the first direction with the second direction to determine the second region.