Device, image processing device and method for optical imaging

An image processing device, comprising:

• an image sensor comprising a plurality of image detectors,
• wherein a first plurality of image detectors is associated with a first image detector matrix;
• wherein a second plurality of image detectors is associated with a second image detector matrix;
• and
• wherein the individual images of neighboring channels are interleaved;
• an image processor for correcting image errors and for the reconstruction of an overall image from the images on the image detectors of the image detector matrices;
• wherein the image processor comprises a plurality of processors for correcting distortions;
• wherein the image processor is implemented to execute the correction of the image errors of the individual images of all image detector matrices independently of each other parallel in time and to reconstruct an overall image from the individual images such that the interleaving of the individual images is considered;
• and a unit for receiving a micro lens field which is implemented to mount a micro lens field on the image processing device such that the image sensor is located in the focal plane of the micro lens field.

A method for optical imaging of an object using a micro lens field comprising at least two micro lenses and an image sensor, the image sensor including a plurality of image detector matrices and each image detector matrix including a plurality of image detectors, wherein an image detector matrix is associated with each micro lens so that each micro lens together with the associated image detector matrix forms an optical channel, comprising:

• a) imaging the object through the micro lens field onto the image sensor such that each object cell is imaged onto an image detector,
• wherein neighboring object cells are imaged onto image detectors of neighboring optical channels so that micro images are formed on the image detector matrices of the optical channels, wherein each micro image is interleaved with the micro images of the neighboring channels;
• wherein each micro image comprises a plurality of pixels, wherein each of the plurality of pixels is formed by an imaging of an object cell onto an image detector;
• and
• wherein the micro image of a first optical channel is interleaved with the micro image of a second optical channel such that along a line, neighboring object cells of the overlapping area of the first and the second channel are alternatingly associated to different micro images.

A non-transitory computer readable medium including a computer program comprising a program code for executing a method for optical imaging of an object using a micro lens field comprising at least two micro lenses and an image sensor, the image sensor including a plurality of image detector matrices and each image detector matrix including a plurality of image detectors, wherein an image detector matrix is associated with each micro lens so that each micro lens together with the associated image detector matrix forms an optical channel, the method comprising:

• a) imaging the object through the micro lens field onto the image sensor such that each object cell is imaged onto an image detector,
• wherein neighboring object cells are imaged onto image detectors of neighboring optical channels so that micro images are formed on the image detector matrices of the optical channels, wherein each micro image is interleaved with the micro images of the neighboring channels;
• wherein each micro image comprises a plurality of pixels, wherein each of the plurality of pixels is formed by an imaging of an object cell onto an image detector;
• and
• wherein the micro image of a first optical channel is interleaved with the micro image of a second optical channel such that along a line, neighboring object cells of the overlapping area of the first and the second channel are alternatingly associated to different micro images.

A device for optical imaging, comprising:

• at least one micro lens field comprising at least two micro lenses;
• an image sensor comprising at least two image detector matrices;
• wherein the at least two image detector matrices each comprise a plurality of image detectors;
• wherein one image detector corresponds to one pixel of the image sensor;
• wherein an allocation between the image detector matrices and the micro lenses exists so that each micro lens together with an image detector matrix forms an optical channel;
• wherein center points of different image detector matrices are shifted laterally by different distances, with respect to centroids, projected onto the image detector matrices, of the micro lens apertures of the associated optical channels, so that at least two of the optical channels comprise different partially overlapping detection areas and so that an overlapping area of the detection areas of two channels is imaged onto the image detector matrices offset with respect to an image detector raster of the image detector matrices;
• wherein the overlapping area comprises a plurality of object cells, wherein each of the object cells may be imaged onto at least one image detector of the image sensor;
• and wherein a sampling grid is associated with each optical channel;
• wherein a sampling grid of the first optical channel describes which object cells of the overlapping area are to be imaged onto which image detectors of the image detector matrix of the first optical channel;
• and
• wherein a sampling grid of the second optical channel describes which object cells of the overlapping area are to be imaged onto which image detectors of the image detector matrix of the second optical channel;
• and wherein the sampling grid of the first optical channel is selected such that a first object cell is imaged onto a first image detector of the image detector matrix of the first optical channel and that a second object cell neighboring the first object cell is imaged onto a gap between the first image detector of the first image detector matrix of the first optical channel and a second image detector, neighboring the first image detector, of the image detector matrix of the first optical channel;
• and wherein the sampling grid of the second optical channel is selected such that the second object cell is imaged onto a first image detector of the image detector matrix of the second optical channel and that the first object cell is imaged onto a gap between the first image detector of the image detector matrix of the second optical channel and a second image detector, neighboring the first image detector, of the image detector matrix of the second optical channel.

A device for optical imaging, comprising:

• at least one micro lens field comprising at least two micro lenses;
• an image sensor comprising at least two image detector matrices;
• wherein the at least two image detector matrices each comprise a plurality of image detectors;
• wherein an allocation between the image detector matrices and the micro lenses exists, so that each micro lens together with an image detector matrix forms an optical channel;
• wherein center points of different image detector matrices are shifted laterally by different distances, with respect to centroids, projected onto the image detector matrices, of the micro lens apertures of the associated optical channels, so that at least two of the optical channels comprise different partially overlapping detection areas and so that an overlapping area of the detection areas of two channels is imaged onto the image detector matrices offset with respect to an image detector raster of the image detector matrices;
• which comprises a sensor for measuring the distance between the device and an object to be detected;
• wherein the device is implemented to consider an offset of an imaging of a first object cell onto a first image detector of an image detector matrix of a first optical channel with respect to an imaging of a second object cell neighboring the first object cell onto a first image detector of an image detector matrix of a second optical channel, and to consider the lateral distance of the image detector matrix of the first optical channel to the image detector matrix of the second optical channel in the correction.

A method for the optical imaging of an object using a micro lens field comprising at least two micro lenses and an image sensor, the image sensor including a plurality of image detector matrices and each image detector matrix including a plurality of image detectors and an image detector matrix being associated with each micro lens so that each micro lens together with the associated image detector matrix forms an optical channel, comprising:

• a) imaging the object through the micro lens field onto the image sensor such that each object cell is imaged onto an image detector,
• wherein neighboring object cells are imaged onto image detectors of neighboring optical channels so that micro images are formed on the image detector matrices of the optical channels, wherein each micro image is interleaved with the micro images of the neighboring channels;
• b) horizontal and vertical mirroring of the individual micro images of the optical channels, wherein the mirroring of any micro images is executed parallel in time;
• c) converting the pixel values of the micro images of different optical channels from their discrete grid structure by means of a location transformation onto a continuous coordinate plane, wherein a correction of image distortions of the micro images of different optical channels is executed;
• d) imaging the pixel values from the continuous coordinate plane onto a new discrete grid to acquire undistorted micro images, wherein different optical channels are processed parallel in time;
• and
• e) resorting the pixel values of the undistorted micro images into an image matrix according to a predefined scheme which is given by the interleaving of the micro images in order to acquire a non-interleaved overall image.

Device for optical imaging, comprising:

• at least one micro lens field comprising at least two micro lenses;
• an image sensor comprising at least two image detector matrices;
• wherein the at least two image detector matrices each comprise a plurality of image detectors;
• wherein an image detector corresponds to one pixel of the image sensor;
• wherein an allocation between the image detector matrices and the micro lenses exists, so that each micro lens together with an image detector matrix forms an optical channel;
• wherein center points of different image detector matrices are shifted laterally by different distances, with respect to centroids, projected onto the image detector matrices, of the micro lens apertures of the associated optical channels, so that at least two of the optical channels comprise different partially overlapping detection areas and so that an overlapping area of the detection areas of two channels is imaged onto the image detector matrices offset with respect to an image detector raster of the image detector matrices;
• wherein a plurality of the optical channels comprise different spectral transmission fields, so that in each of the optical channels one associated micro image results, wherein micro images of different channels are associated with different spectral colors;
• wherein the optical channels are separated by channel separation structures to suppress color crosstalk;
• wherein neighboring channels comprise different spectral transmission fields and the micro images of the neighboring channels are interleaved such that along a line, neighboring object cells of the overlapping area of the optical channels are alternatingly associated with the different spectral micro images.

Device for optical imaging, comprising:

• at least one micro lens field comprising at least two micro lenses;
• an image sensor comprising at least two image detector matrices;
• wherein the at least two image detector matrices each comprise a plurality of image detectors;
• wherein an image detector corresponds to one pixel of the image sensor;
• wherein an allocation between the image detector matrices and the micro lenses exists, so that each micro lens together with an image detector matrix forms an optical channel;
• wherein center points of different image detector matrices are shifted laterally by different distances, with respect to centroids, projected onto the image detector matrices, of the micro lens apertures of the associated optical channels, so that at least two of the optical channels comprise different partially overlapping detection areas and so that an overlapping area of the detection areas of two channels is imaged onto the image detector matrices offset with respect to an image detector raster of the image detector matrices;
• wherein the device is implemented such that in each optical channel a micro image with a plurality of pixels results;
• wherein the device comprises an image processor arranged and programmed to correct distortion of the micro images and to reconstruct an overall image from the micro images of the optical channels;
• wherein the image processor is implemented to execute the correction of the distortion for each micro image separately and parallel in time;
• and
• wherein the image processor is implemented to execute the reconstruction of the overall image by alternatingly arranging the pixels of the interleaved micro images in order to thus acquire the overall image.