# US 2020/0404248 A1 · System and method for compressed sensing light field camera

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2020/0404248 A1
- Document ID: US20200404248A1
- Status: Published application
- Kind: A1
- Application number: 16/971,385
- Filed: 2019-02-14
- Published: 2020-12-24
- Earliest claimed: 2018-02-20
- Assignees: Technology Innovation Momentum Fund (Israel) Limited Partnership
- Applicants: Technology Innovation Momentum Fund (Israel) Limited Partnership
- Inventors: David MENDLOVIC; Ariel RAZ; Ido YOVEL
- Web page: https://patentgrep.com/patent/US20200404248A1

## CPC

- G06T 7/557: from light fields, e.g. from plenoptic cameras
- H04N 13/282: for generating image signals corresponding to three or more geometrical viewpoints, e.g. multi-view systems
- G06T 5/50: using two or more images, e.g. averaging or subtraction
- H04N 13/106: Processing image signals (for multi-view video sequence encoding H04N19/597)
- H04N 23/957: Light-field or plenoptic cameras or camera modules
- G02B 5/201: {in the form of arrays}
- G06T 2207/10052: Images from lightfield camera
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS

## Abstract

A light field imaging system and method are presented. The light-field imaging system comprises an optical arrangement configured for collecting an input light field from a scene and projecting collected light on a pixel matrix of a detector unit, the optical arrangement comprising” an optical coder configured for applying angular coding to the light being collected to produce angularly coded light by separating the light being collected into an array of u angular light components corresponding to u different discrete viewpoints of the scene and projecting light from all of said u angular light components onto each of at least some of the pixels in the pixel matrix thereby causing in-pixel summation of the u angular light components on the pixel matrix of the sensor unit. A color filter unit is provided being located in a filtering plane in an optical path of the u angular light components of the angularly coded light and being configured to apply predetermined color coding to the angularly coded light propagating to the pixel matrix to thereby form on the pixel matrix an image of the input light field in a spectro-angular space.

## Claims

### Claim 1

A light-field imaging system, comprising:
a detector having a pixel matrix;
an optical arrangement configured for collecting an input light field from a scene and projecting collected light on the pixel matrix,
wherein the optical arrangement
separating the collected light into u angular light components corresponding to u different discrete viewpoints of the scene and project light from the u angular light components onto each of a plurality of pixel regions of the pixel matrix;
wherein all the u angular light components are collected by the detector on each of the plurality of pixel regions; and
a color filter:
located in a filtering plane in an optical path of the u angular light components of the collected light,
having a plurality of filter elements including a plurality of transparent filter elements and a plurality of filter elements of at least two wavelength bands selected from a group comprising: red wavelength, green wavelength, blue wavelength, cyan wavelength, magenta wavelength, and yellow wavelength; and
configured to filter the light propagating to the pixel matrix, thereby forming on the pixel matrix an image of the input light field in a spectro-angular space;
wherein the plurality of transparent filter elements are transparent to visible spectrum and distributed in the in filtering plane such that a probability of one of the plurality of color filters to be a transparent filter element is at least about −40 percent.

### Claim 2 (depends on 1)

The light-field imaging system of claim 1, wherein each pixel of each of the plurality of pixel regions receives the light collected from all the u discrete viewpoints with a certain intensity and wavelength profile.

### Claim 3 (depends on 1)

The light-field imaging system of claim 1, wherein output of the detector comprises compressed measured data indicative of spatial compression and wavelength compression of the light field being collected.

### Claim 4 (depends on 1)

The light-field imaging system of claim 1, wherein the detector is a monochromatic detector.

### Claim 5 (depends on 4)

The light-field imaging system of claim 4, wherein output of the detector comprises compressed measured data indicative of spatial compression and wavelength compression of the light field being collected on the monochromatic detector.

### Claim 6 (depends on 1)

The light-field imaging system of claim 1, wherein the optical arrangement comprises an array of optical windows arranged in a spaced apart relationship in a plane in an optical path of the input light field propagation.

### Claim 7 (depends on 1)

The light-field imaging system of claim 1, wherein the optical arrangement comprises a microlens array; wherein each of the microlens having an aperture.

### Claim at position 8

8-11. (canceled)

### Claim 12 (depends on 1)

The light-field imaging system of claim 1, wherein the plurality of color filter are arranged in a predetermined spatial pattern.

### Claim at position 10

13-15. (canceled)

### Claim 16 (depends on 131)

The light-field imaging system of claim 131, wherein one of the plurality of filter elements comprises a plurality of filter elements of infrared (IR) band.

### Claim 17 (depends on 1)

The light-field imaging system of claim 1, wherein the color filter comprises the plurality of filter elements are configured in a binary pattern with respect to a certain wavelength range.

### Claim 18 (depends on 17)

The light-field imaging system of claim 17, wherein the certain wavelength range includes a single IR band.

### Claim 19

(canceled)

### Claim 20 (depends on 1)

The light-field imaging system of claim 1, wherein the at least two wavelength bands include red, green, and blue (RGB) color bands.

### Claim 21 (depends on 1)

The light-field imaging system of claim 1, wherein the plurality of color filter elements are arranged in a random binary pattern for maximizing separation between the u different discrete viewpoints.

### Claim 22 (depends on 1)

The light-field imaging system according to claim 1, wherein the optical arrangement is configured such that each of the angular light components carries and projects on the pixel matrix a different spatial pattern and, having a modulated effective sensing matrix ϕ, eliminating averaging of the viewpoints.

### Claim 23 (depends on 22)

The light-field imaging system according to claim 22, wherein the modified effective sensing matrix ϕ is defined as:
φ
=
1
mn
-
[
φ
1
…
φ
mn
]
where ϕi is a diagonal matrix (i=1, 2, . . . nm; n and m being the size of the angular and wavelength channels), which contains measured data from a column of pixels in the pixel matrix, when the color filter projects light collected by the i-th optical window or lens.

### Claim 24 (depends on 1)

The light-field imaging system according to claim 1, further comprising a data processor configured and operable to receive, from the detector unit, the measured compressed data indicative of raw image data of a scene and process the measured compressed data in accordance with data indicative of the modified effective sensing matrix, and generated data indicative of reconstructed image of the scene.

### Claim 25

(canceled)

### Claim 26

A light field imaging method comprising:
collecting an input light field from a scene,
separating the collected light into u angular light components corresponding to u different discrete viewpoints of the scene;
projecting light from the u angular light components onto each of a plurality of pixel regions of the pixel matrix;
wherein all the u angular light components are collected by a detector on each of the plurality of pixel regions; and
wherein the projecting comprises using a plurality of filter elements including a plurality of transparent filter elements and a plurality of filter elements of at least two wavelength bands selected from a group comprising: red wavelength, green wavelength, blue wavelength, cyan wavelength, magenta wavelength, and yellow wavelength for filtering the collected light at a filtering plane in an optical path of the u angular light components thereby forming on the pixel matrix an image of the input light field in a spectro-angular space;
wherein the plurality of transparent filter elements are transparent to visible spectrum and distributed in the in filtering plane such that a probability of one of the plurality of color filters to be a transparent filter element is at least 40 about percent.
