# US 10,122,950 B2 · Imaging device, imaging method, and image processing program > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 10,122,950 B2 - Document ID: US10122950B2 - Status: Granted - Kind: B2 - Application number: 15/498,497 - Filed: 2017-04-27 - Published: 2017-08-10 - Granted: 2018-11-06 - Earliest claimed: 2014-11-20 - Assignees: FUJIFILM Corporation - Applicants: FUJIFILM Corporation - Inventors: Shuji Ono - Web page: https://patentgrep.com/patent/US10122950B2 ## CPC - H04N 25/615: involving a transfer function modelling the optical system, e.g. optical transfer function [OTF], phase transfer function [PhTF] or modulation transfer function [MTF] - G02B 13/001: {Miniaturised objectives for electronic devices, e.g. portable telephones, webcams, PDAs, small digital cameras (G02B23/243 takes precedence)} - G02B 13/0085: {employing wafer level optics} - G02B 13/06: Panoramic objectives; So-called "sky lenses" {including panoramic objectives having reflecting surfaces} - G03B 5/00: Adjustment of optical system relative to image or object surface other than for focusing - G03B 19/023: {Multi-image cameras} - H04N 23/55: Optical parts specially adapted for electronic image sensors; Mounting thereof - H04N 23/60: Control of cameras or camera modules - H04N 23/90: Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums - G03B 17/17: with reflectors arranged in beam forming the photographic image, e.g. for reducing dimensions of camera - G03B 17/28: Locating light-sensitive material within camera - G03B 2205/00: Adjustment of optical system relative to image or object surface other than for focusing - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION - G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS - G03B: APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR (optical parts of such apparatus G02B; photosensitive materials or processes for photographic purposes G03C; apparatus for processing exposed photographic materials G03D) ## Abstract The imaging device includes a multiple-property lens that includes a first area having a first property and a second area having a second property different from the first property, an image sensor in which a first light receiving element 25A and a second light receiving element 25B having a different opening size of a light receiving section from the first light receiving element 25A are two-dimensionally arranged, and a crosstalk removal processing unit that removes a crosstalk component from each of a first crosstalk image acquired from the first light receiving element 25A of the image sensor and a second crosstalk image acquired from the second light receiving element to generate a first image and a second image respectively having the first property and the second property of the multiple-property lens. ## Claims ### Claim 1 An imaging device comprising: a multiple-property lens that includes a first area having a first property and a second area having a second property different from the first property; an image sensor that has a first light receiving element and a second light receiving element having a different opening size of a light receiving section from the first light receiving element, the first light receiving element on which a luminous flux passing the first area of the multiple-property lens and a luminous flux passing the second area of the multiple-property lens are incident in crosstalk with each other and the second light receiving element having a different crosstalk ratio due to having the different opening size from the first light receiving element and on which the luminous flux passing the first area of the multiple-property lens and the luminous flux passing the second area of the multiple-property lens are incident in crosstalk with each other being two-dimensionally arranged; and a crosstalk removal processing unit that removes a crosstalk component from each of a first crosstalk image acquired from the first light receiving element of the image sensor and a second crosstalk image acquired from the second light receiving element to generate a first image and a second image respectively having the first property and the second property of the multiple-property lens. ### Claim 2 (depends on 1) The imaging device according to claim 1, wherein the crosstalk removal processing unit calculates the first image and the second image on the basis of the first crosstalk image, the second crosstalk image, and an inverse matrix of a matrix configured of a detected gain distribution and a crosstalk gain distribution of each of the first crosstalk image and the second crosstalk image. ### Claim 3 (depends on 2) The imaging device according to claim 2, wherein one microlens is disposed in each first light receiving element and in each second light receiving element in the image sensor. ### Claim 4 (depends on 3) The imaging device according to claim 3, wherein the microlens disposed in each first light receiving element and in each second light receiving element has the same radius of curvature and has a constant distance from a light receiving surface of the first light receiving element and from a light receiving surface of the second light receiving element. ### Claim 5 (depends on 2) The imaging device according to claim 2, wherein the image sensor is a rear surface irradiation image sensor. ### Claim 6 (depends on 2) The imaging device according to claim 2, wherein the multiple-property lens includes a first optical system corresponding to the first area having the first property and a second optical system corresponding to the second area having the second property. ### Claim 7 (depends on 6) The imaging device according to claim 6, wherein the first optical system and the second optical system have a common optical axis. ### Claim 8 (depends on 7) The imaging device according to claim 7, wherein the first optical system is a circular central optical system, and the second optical system is an annular optical system that is concentrically arranged with respect to the central optical system. ### Claim 9 (depends on 1) The imaging device according to claim 1, wherein one microlens is disposed in each first light receiving element and in each second light receiving element in the image sensor. ### Claim 10 (depends on 9) The imaging device according to claim 9, wherein the microlens disposed in each first light receiving element and in each second light receiving element has the same radius of curvature and has a constant distance from a light receiving surface of the first light receiving element and from a light receiving surface of the second light receiving element. ### Claim 11 (depends on 1) The imaging device according to claim 1, wherein the image sensor is a rear surface irradiation image sensor. ### Claim 12 (depends on 1) The imaging device according to claim 1, wherein the multiple-property lens includes a first optical system corresponding to the first area having the first property and a second optical system corresponding to the second area having the second property. ### Claim 13 (depends on 12) The imaging device according to claim 12, wherein the first optical system and the second optical system have a common optical axis. ### Claim 14 (depends on 13) The imaging device according to claim 13, wherein the first optical system is a circular central optical system, and the second optical system is an annular optical system that is concentrically arranged with respect to the central optical system. ### Claim 15 (depends on 12) The imaging device according to claim 12, wherein the first optical system and the second optical system are different from each other in terms of at least one of a focal length, a focal distance, or a modulation transfer function. ### Claim 16 (depends on 13) The imaging device according to claim 13, wherein the first optical system and the second optical system are different from each other in terms of at least one of a focal length, a focal distance, or a modulation transfer function. ### Claim 17 An imaging method in an imaging device including a multiple-property lens that includes a first area having a first property and a second area having a second property different from the first property, and an image sensor that has a first light receiving element and a second light receiving element having a different opening size of a light receiving section from the first light receiving element, the first light receiving element on which a luminous flux passing the first area of the multiple-property lens and a luminous flux passing the second area of the multiple-property lens are incident in crosstalk with each other and the second light receiving element having a different crosstalk ratio due to having the different opening size from the first light receiving element and on which the luminous flux passing the first area of the multiple-property lens and the luminous flux passing the second area of the multiple-property lens are incident in crosstalk with each other being two-dimensionally arranged, the method comprising: a step of acquiring a first crosstalk image and a second crosstalk image that are imaged by the imaging device at the same time, the first crosstalk image being photoelectrically converted by the first light receiving element of the image sensor, and the second crosstalk image being photoelectrically converted by the second light receiving element; and a step of generating a first image and a second image respectively having the first property and the second property of the multiple-property lens by removing a crosstalk component from each of the first crosstalk image and the second crosstalk image acquired. ### Claim 18 (depends on 17) The imaging method according to claim 17, wherein in the step of generating the first image and the second image, the first image and the second image are calculated on the basis of the first crosstalk image, the second crosstalk image, and an inverse matrix of a matrix configured of a detected gain distribution and a crosstalk gain distribution of each of the first crosstalk image and the second crosstalk image. ### Claim 19 A non-transitory computer readable recording medium storing an image processing program of an imaging device including a multiple-property lens that includes a first area having a first property and a second area having a second property different from the first property, and an image sensor that has a first light receiving element and a second light receiving element having a different opening size of a light receiving section from the first light receiving element the first light receiving element on which a luminous flux passing the first area of the multiple-property lens and a luminous flux passing the second area of the multiple-property lens are incident in crosstalk with each other and the second light receiving element having a different crosstalk ratio due to having the different opening size from the first light receiving element and on which the luminous flux passing the first area of the multiple-property lens and the luminous flux passing the second area of the multiple-property lens are incident in crosstalk with each other being two-dimensionally arranged, the program causing a computer to realize: a step of acquiring a first crosstalk image and a second crosstalk image that are imaged by the imaging device at the same time, the first crosstalk image being photoelectrically converted by the first light receiving element of the image sensor, and the second crosstalk image being photoelectrically converted by the second light receiving element; and a step of generating a first image and a second image respectively having the first property and the second property of the multiple-property lens by removing a crosstalk component from each of the first crosstalk image and the second crosstalk image acquired. ### Claim 20 (depends on 19) The non-transitory computer readable recording medium storing the image processing program according to claim 19, wherein in the step of generating the first image and the second image, the first image and the second image are calculated on the basis of the first crosstalk image, the second crosstalk image, and an inverse matrix of a matrix configured of a detected gain distribution and a crosstalk gain distribution of each of the first crosstalk image and the second crosstalk image.