# US 10,771,668 B2 · Multi-aperture imaging device, imaging system and method for capturing an object area > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 10,771,668 B2 - Document ID: US10771668B2 - Status: Granted - Kind: B2 - Application number: 16/035,548 - Filed: 2018-07-13 - Published: 2019-04-04 - Granted: 2020-09-08 - Earliest claimed: 2016-01-13 - Assignees: Fraunhofer-Gesellschaft zur Foerderung der angewandten Forschung e.V. - Applicants: Fraunhofer-Gesellschaft zur Foerderung der angewandten Forschung e.V. - Inventors: Frank Wippermann; Andreas Brueckner; Andreas Reimann - Web page: https://patentgrep.com/patent/US10771668B2 ## CPC - H04N 23/45: for generating image signals from two or more image sensors being of different type or operating in different modes, e.g. with a CMOS sensor for moving images in combination with a charge-coupled device [CCD] for still images - G02B 13/0015: {characterised by the lens design} - H04N 13/239: using two two-dimensional [2D] image sensors having a relative position equal to or related to the interocular distance (H04N13/243 takes precedence) - H04N 23/55: Optical parts specially adapted for electronic image sensors; Mounting thereof - H04N 23/67: Focus control based on electronic image sensor signals - H04N 23/698: for achieving an enlarged field of view, e.g. panoramic image capture - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION - G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS ## Abstract A multi-aperture imaging device includes at least one image sensor and an array of juxtaposed optical channels. Each optical channel includes optics for imaging of projecting at least one partial area of an object area on an image sensor area of the image sensor. A first optics of a first optical channel is configured to project a first partial area of the object area on a first image sensor area and to project a second partial area of the object area on a second image sensor area. A second optics of a second optical channel is configured to project at least a third partial area of the object area on a third image sensor area. The first partial area and the second partial area are disjoint in the object area. The third partial area overlaps incompletely with the first partial area. ## Claims ### Claim 1 Multi-aperture imaging device comprising: at least one image sensor; and an array of juxtaposed optical channels, wherein each optical channel comprises optics for projecting at least one partial area of an object area on an image sensor area of the image sensor; wherein a first optics of a first optical channel is configured to project a first partial area of the object area on a first image sensor area and a second partial area of the object area on a second image sensor area; wherein a second optics of a second optical channel is configured to project at least a third partial area of the object area on a third image sensor area; and wherein the first partial area and the second partial area are disjoint in the object area, and wherein the third partial area overlaps incompletely with the first partial area; wherein the multi-aperture imaging device comprises at least one of: a configuration in which the third partial area is arranged within the object area between the first partial area and the second partial area; an at least partly opaque structure for reducing stray light between the first image sensor area and the second image sensor area is arranged between the first image sensor area and the second image sensor area; wherein a cross-section of the at least partly opaque structure tapers parallel to the image sensor in the direction of the array; first partial area optics that is exclusively allocated to the first partial area and influences the projection of the first partial area on the first image sensor area wherein the multi-aperture imaging device comprises a partial area diaphragm limiting an optical path through the first partial area optics; and an aperture diaphragm that limits an optical path through the first optics. ### Claim 2 (depends on 1) Multi-aperture imaging device according to claim 1, wherein the second image sensor area differs from the first image sensor area and is arranged adjacent to the first image sensor area. ### Claim 3 (depends on 1) Multi-aperture imaging device according to claim 1, wherein the first partial area and the second partial area further comprise an image gap between them. ### Claim 4 (depends on 1) Multi-aperture imaging device according to claim 1, wherein a total number of the optical channels are configured to fully transfer the total field of view. ### Claim 5 (depends on 1) Multi-aperture imaging device according to claim 1, wherein the first optics of the first optical channel is configured to project the first partial area and the second partial area through a shared lens. ### Claim 6 (depends on 1) Multi-aperture imaging device according to claim 1, wherein the third partial area is arranged within the object area between the first partial area and the second partial area. ### Claim 7 (depends on 1) Multi-aperture imaging device according to claim 1, wherein an area is arranged between the first image sensor area and the second image sensor area, wherein the first image sensor area is arranged directly adjacent to the second image sensor area, and the third image sensor area is arranged directly adjacent to the first or second image sensor areas. ### Claim 8 (depends on 1) Multi-aperture imaging device according to claim 1, wherein a design-related gap is arranged between the first image sensor area and the second image sensor area. ### Claim 9 (depends on 1) Multi-aperture imaging device according to claim 1, wherein the third partial area further overlaps incompletely with the second partial area. ### Claim 10 (depends on 1) Multi-aperture imaging device according to claim 1, wherein a total amount of image sensors comprises the at least one image sensor and each image sensor comprises one image sensor area per projected partial area of the object area, wherein a total amount of image sensor areas comprises the first, second and third image sensor areas. ### Claim 11 (depends on 1) Multi-aperture imaging device according to claim 1, wherein an at least partly opaque structure for reducing stray light between the first image sensor area and the second image sensor area is arranged between the first image sensor area and the second image sensor area. ### Claim 12 (depends on 11) Multi-aperture imaging device according to claim 11, wherein a cross-section of the at least partly opaque structure tapers parallel to the image sensor in the direction of the array. ### Claim 13 (depends on 1) Multi-aperture imaging device according to claim 1, further comprising first partial area optics that is exclusively allocated to the first partial area and influences the projection of the first partial area on the first image sensor area. ### Claim 14 (depends on 13) Multi-aperture imaging device according to claim 13, further comprising second partial area optics that is exclusively allocated to the second partial area and influences the projection of the second partial area on the second image sensor area, wherein the first partial area optics and the second partial area optics are structured identically and mirror-symmetrically to a plane comprising the optical axis of the optics shared by the partial area optics and running perpendicular to a line-extension direction of the array. ### Claim 15 (depends on 14) Multi-aperture imaging device according to claim 14, wherein the first partial area optics and the second partial area optics are mechanically connected to one another. ### Claim 16 (depends on 13) Multi-aperture imaging device according to claim 13 comprising a partial area diaphragm limiting an optical path through the first partial area optics. ### Claim 17 (depends on 1) Multi-aperture imaging device according to claim 1 comprising a transparent substrate arranged between the image sensor and the array and extending across at least two optical channels, wherein optics or partial area optics are arranged on the transparent substrate. ### Claim 18 (depends on 17) Multi-aperture imaging device according to claim 17, wherein the transparent substrate extends across all optical channels. ### Claim 19 (depends on 1) Multi-aperture imaging device according to claim 1, wherein the second optics is configured to project a fourth partial area of the object area on a fourth image sensor area; wherein the third partial area and the fourth partial area are disjoint in the object area. ### Claim 20 (depends on 1) Multi-aperture imaging device according to claim 1 comprising an aperture diaphragm that limits an optical path through the first optics. ### Claim 21 (depends on 1) Multi-aperture imaging device according to claim 1, wherein the first optics of the first channel or a combination of the first optics and the a partial area optics that is exclusively allocated to the first partial area comprises a negative distortion increasing according to amount from a field angle increasing from ZERO with a first gradient of change of the distortion until a first field angle threshold is reached, wherein a second gradient of change of the distortion with a field angle increasing beyond the field angle threshold is lower than the first gradient of change. ### Claim 22 (depends on 21) Multi-aperture imaging device according to claim 21, wherein the second gradient of change is at the most 1/3 of the first gradient of change. ### Claim 23 (depends on 21) Multi-aperture imaging device according to claim 21, wherein the field angle threshold is smaller than or equal to half an angular distance between the first partial area and the second partial area in the object area. ### Claim 24 (depends on 1) Multi-aperture imaging device according to claim 1, wherein the array for capturing the object area is formed in a single line. ### Claim 25 (depends on 1) Multi-aperture imaging device according to claim 1, wherein the first optics of the first channel or a combination of the first optics and a first partial area optics that is exclusively allocated to the first partial area comprises mirror symmetry to a plane comprising the optical axis of the optics shared by the partial area optics and running perpendicular to a line-extension direction of the array, such that refraction of light through the first optics is symmetrical for an optical path towards the first partial area and an optical path towards the second partial area, wherein the symmetry exists in absence of rotational symmetry with respect to the optical axis. ### Claim 26 (depends on 1) Multi-aperture imaging device according to claim 1 comprising beam-deflector that is arranged between the array and the object area and that is configured to deflect an optical path of the optical channels. ### Claim 27 (depends on 26) Multi-aperture imaging device according to claim 26, wherein the beam-deflector comprises a first position and a second position between which the beam-deflector can be moved rotationally or translationally, wherein the beam-deflector is configured to deflect the optical path of each optical channel in a differing direction in the first position and in the second position. ### Claim 28 (depends on 27) Device according to claim 27, wherein the beam-deflector comprises a first reflecting main side and a second reflecting main side, wherein in the first position the first reflecting side is arranged facing an image sensor and in the second position the second reflecting side is arranged facing the image sensor. ### Claim 29 (depends on 26) Multi-aperture imaging device according to claim 26, wherein the beam-deflector is formed as an array of facets that are arranged along a line-extension direction of the array of optical channels and wherein one facet is allocated to each optical channel. ### Claim 30 (depends on 26) Multi-aperture imaging device according to claim 26, wherein the beam-deflector is formed as an array of facets that are arranged along a line-extension direction of the array of optical channels, and a first optical path of a first optical channel and at least a further optical path of a further optical channel are allocated to a facet. ### Claim 31 (depends on 1) Device according to claim 1, further comprising an optical image stabilizer exhibiting a joint effect for two, a plurality or all optical paths of the optical channels for image stabilization along a first image axis and a second image axis by generating a translational relative movement between an image sensor and the array or a beam-deflector, wherein the translational movement runs parallel to a first image axis and a second image axis of an image captured by the multi-aperture imaging device. ### Claim 32 (depends on 1) Device according to claim 1, further comprising an optical image stabilizer exhibiting a joint effect for two, a plurality or all optical paths of the optical channels for image stabilization along a first image axis by generating a translational relative movement between an image sensor and the array and for image stabilization along a second image axis by generating a rotational movement of a beam-deflector. ### Claim 33 (depends on 31) Multi-aperture imaging device according to claim 31, wherein the optical image stabilizer includes at least one actuator and is arranged such that the same is arranged at least partly between two planes that are spanned by sides of a cuboid, wherein the sides of the cuboid are aligned parallel to one another as well as to a line-extension direction of the array and a part of the optical path of the optical channels between the image sensor and the optics and whose volume is minimum and still comprises the image sensor and the array. ### Claim 34 (depends on 33) Multi-aperture imaging device according to claim 33, wherein the image stabilizer projects out of an area between the planes by 50% at most. ### Claim 35 (depends on 1) Multi-aperture imaging device according to claim 1 further comprising a focusing unit that comprises at least one actuator for adjusting a focus of the multi-aperture imaging device that is configured to provide relative movement between at least one optics of one of the optical channels and the image sensor. ### Claim 36 (depends on 35) Multi-aperture imaging device according to claim 35, wherein the focusing unit is arranged such that same is arranged at least partly between two planes that are spanned by sides of a cuboid, wherein the sides of the cuboid are aligned parallel to one another as well as to a line-extension direction of the array and a part of the optical path of the optical channels between an image sensor and the optics and whose volume is minimum and still comprises the image sensor and the array. ### Claim 37 (depends on 35) Multi-aperture imaging device according to claim 35, wherein the focusing unit is configured to jointly adjust the focus for all optical channels. ### Claim 38 (depends on 1) Multi-aperture imaging device according to claim 1, wherein each partial area of the object area is projected on at least two image sensor areas by at least two optical channels. ### Claim 39 (depends on 1) Multi-aperture imaging device according to claim 1, wherein a total amount of the optical channels of the array projects a total amount of partial areas of the object area on a total amount of image sensor areas of the at least one image sensor and wherein the total amount of the partial areas completely projects the object area to be captured. ### Claim 40 Imaging system exhibiting at least a first and at least a second multi-aperture imaging device, each a multi-aperture imaging device comprising: at least one image sensor; and an array of juxtaposed optical channels, wherein each optical channel comprises optics for projecting at least one partial area of an object area on an image sensor area of the image sensor; wherein a first optics of a first optical channel is configured to project a first partial area of the object area on a first image sensor area and a second partial area of the object area on a second image sensor area; wherein a second optics of a second optical channel is configured to project at least a third partial area of the object area on a third image sensor area; and wherein the first partial area and the second partial area are disjoint in the object area, and wherein the third partial area overlaps incompletely with the first partial area; further comprising, for the first and second multi-aperture imaging devices, at least one of: a common image sensor; a common focusing unit comprising at least one actuator for jointly adjusting a focus of the first and second multi-aperture imaging devices; an optical image stabilizer exhibiting a joint effect for an optical path of the first multi-aperture imaging device and for an optical path of the second multi-aperture imaging device for image stabilization along a first image axis and a second image axis by generating a translational relative movement between the image sensor and the array or the beam-deflector of the first or second multi-aperture imaging devices; and a common beam-deflector arranged between the array of the first and second multi-aperture imaging devices and the object area and configured to deflect an optical path of the optical channels of the first and second multi-aperture imaging devices. ### Claim 41 (depends on 40) Imaging system according to claim 40 which is configured as mobile phone, smartphone, tablet or monitor. ### Claim 42 Method for capturing an object area with an image sensor, comprising: projecting an object area with an array of juxtaposed optical channels, wherein each optical channel comprises optics for projecting at least one partial area of an object area on an image sensor area of the image sensor; projecting a first partial area of the object area on a first image sensor area and projecting a second partial area of the object area on a second image sensor area by a first optics of a first optical channel; and projecting a third partial area of the object area by a second optics of a second optical channel; such that the first partial area and the second partial area are disjoint in the object area and such that the third partial area incompletely overlaps with the first partial area; and such that the multi-aperture imaging device is implemented to at least one of: a configuration in which the third partial area is arranged within the object area between the first partial area and the second partial area; having an at least partly opaque structure for reducing stray light between the first image sensor area and the second image sensor area is arranged between the first image sensor area and the second image sensor area; such that a cross-section of the at least partly opaque structure tapers parallel to the image sensor in the direction of the array; having first partial area optics that is exclusively allocated to the first partial area and influences the projection of the first partial area on the first image sensor area such that the multi-aperture imaging device comprises a partial area diaphragm limiting an optical path through the first partial area optics; and having an aperture diaphragm that limits an optical path through the first optics.