3D multi-aperture imaging devices, multi-aperture imaging device, method for providing an output signal of a 3D multi-aperture imaging device and method for capturing a total field of view

A non-transitory storage medium having stored thereon information representing a signal, the signal comprising:

• a data header comprising information regarding a structure of a 3D multi-aperture imaging device, wherein the data header comprises information regarding a pressure of an atmosphere surrounding the 3D multi-aperture imaging optics, an environmental temperature of the 3D multi-aperture imaging optics and/or an operating temperature of the 3D multi-aperture imaging optics;
• and
• payload data comprising image information acquired from pixels of first image sensor areas and second image sensor areas of the 3D multi-aperture imaging device, wherein the image information of the first and second image sensor areas each relate to a plurality of partial fields of view of a total field of view;
• wherein the signal comprises at least one of:
• in the data header, information regarding a number of the first plurality or the second plurality of optical channels;
• in the data header, information regarding a segmentation of the total field of view into the first or second partial fields of view;
• in the data header, information regarding the base distance;
• in the data header, information regarding a defective pixel of the image sensor;
• in the payload data, information regarding compressed image data;
• in the payload data, information regarding a total image being acquired by processing information on first and second partial fields of view projected on first and second plurality of image sensor areas;
• and
• in the data header or in the payload data, pixel by pixel or for pixel clusters, depth data, an indication on a segmentation of pixels towards pixel clusters and/or an indication of depth information and/or distance information regarding pixel clusters.

A device for processing an input signal comprising a data header and payload data, wherein the data header comprises information regarding a structure of a 3D multi-aperture imaging device, wherein the data header comprises information regarding a pressure of an atmosphere surrounding the 3D multi-aperture imaging optics, an environmental temperature of the 3D multi-aperture imaging optics and/or an operating temperature of the 3D multi-aperture imaging optics and wherein the payload data comprise image information acquired from pixels of first image sensor areas and second image sensor areas, wherein the image information of the first and second image sensor areas each relate to a plurality of partial fields of view of a total field of view, the device comprising:

• an input interface for receiving the input signal;
• and
• a processor for processing the payload data by considering the information regarding the structure of the 3D multi-aperture imaging device for at least first image sensor information of a first partial field of view of the partial fields of view and a second partial field of view of the partial fields of view;
• wherein the processor is implemented for at least one of:
• that the processor is configured to form the output signal such that the data header comprises information regarding a number of the first plurality or the second plurality of optical channels;
• that the processor is configured to form the output signal such that the data header comprises information regarding a segmentation of the total field of view into the first or second partial fields of view;
• that the processor is configured to consider information regarding the base distance contained in the data header;
• that the processor is configured to consider information regarding a defective pixel of the image sensor contained in the data header;
• that the processor is configured to consider information regarding compressed image data contained in the payload data;
• that the processor is configured to consider information regarding a total image contained in the payload data, the total image being acquired based on first and second partial fields of view projected on first and second plurality of image sensor areas;
• and
• that the processor is configured to consider pixel by pixel or for pixel clusters, depth data, an indication on a segmentation of pixels towards pixel clusters and/or an indication of depth information and/or distance information regarding pixel clusters contained in the data header or the payload data.

A method for providing an output signal of a 3D multi-aperture imaging device comprising:

• providing an image sensor with a plurality of image sensor areas, wherein each image sensor area comprises a plurality of pixels;
• providing a first plurality of optical channels for projecting overlapping first partial fields of view of a total field of view on first image sensor areas of the image sensor;
• providing a second plurality of optical channels for projecting second partial fields of view of the total field of view overlapping each other and the first partial fields of view on second image sensor areas of the image sensor, wherein the first and the second plurality of optical channels are arranged such that the same are laterally offset from one another by a base distance;
• receiving image sensor data from the image sensor that comprise information on the first and second partial fields of view projected on the first and second plurality of image sensor areas;
• and
• generating the output signal, such that the output signal comprises a data header and payload data, such that the data header comprises information regarding the structure of the 3D multi-aperture imaging device and such that the payload data comprise image information acquired from the pixels of the first image sensor area and the second image sensor area;
• wherein the data header comprises information regarding a pressure of an atmosphere surrounding the 3D multi-aperture imaging optics, an environmental temperature of the 3D multi-aperture imaging optics and/or an operating temperature of the 3D multi-aperture imaging optics;
• wherein the output signal is provided according to at least one of:
• such that the data header comprises information regarding a number of the first plurality or the second plurality of optical channels;
• such that the data header comprises information regarding a segmentation of the total field of view into the first or second partial fields of view;
• such that the data header comprises information regarding the base distance;
• such that the data header comprises information regarding a defective pixel of the image sensor;
• information on the first and second partial fields of view projected on the first and second plurality of image sensor areas is compressed to acquire compressed image data and that the output signal is formed such that the payload data comprise information regarding the compressed image data;
• information on the first and second partial fields of view projected on the first and second plurality of image sensor areas is processed to acquire a total image, and the output signal is formed such that the payload data comprise information regarding the total image;
• and
• that the data header or the payload data comprise, pixel by pixel or for pixel clusters, depth data, an indication on a segmentation of pixels towards pixel clusters and/or an indication of depth information and/or distance information regarding pixel clusters.