Method and apparatus for image capturing and simultaneous depth extraction

A method of image capturing and depth extraction, the method comprising:

• recording at least two shifted spectrum channels of a light field to form an image captured from a video;
• converting the captured image into an image of a processing basis;
• estimating a disparity based on a correlation between pixels of the spectrum channels in the processing basis to extract a disparity map;
• restoring the captured image based on the extracted disparity map;
• and
• converting the disparity map into a depth map.

A mobile device for image capturing and depth extraction in ultraviolet light, infrared light, or visible light, the mobile device comprising:

• a lens system;
• at least one spectrum coded aperture including at least two regions that pass spectrum channels of an incident light field which are different from each other;
• a sensor configured to record the at least two spectrum channels to form an image captured in a sensor basis;
• and
• a coded aperture fixture configured to move at least one spectrum coded aperture relatively with respect to the lens system;
• and
• a data processor configured to convert the image captured in the sensor basis into an image of a processing basis, extract a disparity from the image of the processing basis, and convert the disparity into depth information.