# US 2014/0192225 A1 · Methods and appartus for using multiple optical chains in parallel with multiple different exposure times

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2014/0192225 A1
- Document ID: US20140192225A1
- Status: Published application
- Kind: A1
- Application number: 14/147,579
- Filed: 2014-01-05
- Published: 2014-07-10
- Earliest claimed: 2013-01-05
- Assignees: Tinz Optics, Inc.
- Applicants: Tinz Optics, Inc.
- Inventors: Rajiv Laroia
- Web page: https://patentgrep.com/patent/US20140192225A1

## CPC

- G02B 13/16: for use in conjunction with image converters or intensifiers {, or for use with projectors, e.g. objectives for projection TV}
- G02B 7/18: for prisms; for mirrors
- G02B 13/0065: {having a beam-folding prism or mirror}
- G02B 13/22: Telecentric objectives or lens systems
- G02B 17/008: {Systems specially adapted to form image relays or chained systems}
- G02B 17/0896: {with variable magnification or multiple imaging planes, including multispectral systems (systems with only refractive elements G02B15/14)}
- G03B 17/17: with reflectors arranged in beam forming the photographic image, e.g. for reducing dimensions of camera
- G06T 11/60: Creating or editing images; Combining images with text
- H04N 5/265: Mixing
- H04N 23/45: for generating image signals from two or more image sensors being of different type or operating in different modes, e.g. with a CMOS sensor for moving images in combination with a charge-coupled device [CCD] for still images
- H04N 23/54: Mounting of pick-up tubes, electronic image sensors, deviation or focusing coils
- H04N 23/55: Optical parts specially adapted for electronic image sensors; Mounting thereof
- H04N 23/57: Mechanical or electrical details of cameras or camera modules specially adapted for being embedded in other devices
- H04N 23/73: by influencing the exposure time
- H04N 23/741: by increasing the dynamic range of the image compared to the dynamic range of the electronic image sensors
- H04N 23/75: by influencing optical camera components
- G02B 3/0056: {arranged along two different directions in a plane, e.g. honeycomb arrangement of lenses (G02B3/0043 takes precedence; miniaturised objectives for electronic devices employing wafer level optics G02B13/0085)}
- G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G03B: APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR (optical parts of such apparatus G02B; photosensitive materials or processes for photographic purposes G03C; apparatus for processing exposed photographic materials G03D)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

Methods and apparatus for capturing or generating images using multiple optical chains operating in parallel are described. Pixel values captured by individual optical chains corresponding to the same scene area are combined to provide an image with at least some of the benefits which would have been provided by capturing an image of the scene using a larger lens than that of the individual lenses of the optical chain modules. By using multiple optical chains in parallel at least some benefits normally obtained from using a large lens can be obtained without the need for a large lens. Furthermore in at least some embodiments, a wide dynamic range can be supported through the use of multiple sensors with the overall supported dynamic range being potentially larger than that of the individual sensors. Some lens and/or optical chain configurations are designed for use in small handheld devices, e.g., cell phones.

## Claims

### Claim 1

A method of producing at least one image of a first scene area, the method comprising:
operating a plurality of optical chain modules in parallel to capture images of the first scene area, the step of operating a plurality of optical chain modules including:
operating a first optical chain module to capture a first image of the first scene area using a first exposure time; and
operating a second optical chain module to capture a second image of said first scene area using a second exposure time, at least said first and second exposure times being of different durations but overlapping in time; and
processing said first and second images to generate a first combined image of said first scene area.

### Claim 2 (depends on 1)

The method of claim 1,
wherein processing said first and second images to generate a first combined image of said first scene area includes weighting pixel values of said first and second images corresponding to the same portion of said first scene area as a function of said first and second exposure times, respectively, and summing the weighted pixel values.

### Claim 3 (depends on 1)

The method of claim 1, further comprising:
operating a third optical chain module to capture a third image of said first scene area using a third exposure time; and
processing said third image to generate said first combined image of said first scene area from the third image in addition to said first and second images.

### Claim 4 (depends on 3)

The method of claim 3, wherein said third exposure time is different than said first and second exposure times.

### Claim 5 (depends on 3)

The method of claim 3, further comprising:
operating one of said first, second or third optical chain modules to capture a fourth image of the first scene area prior to capture of said first, second and third images; and
displaying said fourth image on a display of a camera device including said first, second, third optical chain modules.

### Claim 6 (depends on 3)

The method of claim 3, further comprising:
operating one of said first, second and third optical chain modules to capture a fourth image of the first scene area after capturing one of said first, second and third images; and
displaying said fourth image on a display of a device including said first, second, and third optical chain modules; and
wherein the combined image is generated in the device after the display of the fourth image on the camera device.

### Claim 7 (depends on 6)

The method of claim 6, wherein said operating one of said first, second and third optical chain modules to capture said fourth image of the first scene area uses a fourth exposure time different from said first, second and third exposure times.

### Claim 8 (depends on 5)

The method of claim 5, wherein said operating one of said first, second and third optical chain modules to capture a fourth image of the first scene area uses a fourth exposure time different from said first, second and third exposure times.

### Claim 9 (depends on 5)

The method of claim 5, wherein at least some optical chain modules in said plurality of optical chain modules include single color filters at least two optical chain modules being provided for each color for which an single color filter is used.

### Claim 10 (depends on 9)

The method of claim 9, wherein at least some optical chain modules do not include any color filters.

### Claim 11 (depends on 5)

The method of claim 5, wherein different optical chain modules having single color filters corresponding to the same color have different exposure times.

### Claim 12

An apparatus, comprising:
a plurality of optical chain modules that work in parallel to capture images of a first scene area, said plurality of optical chain modules including:
a first optical chain module configured to capture a first image of the first scene area using a first exposure time; and
a second optical chain module configured to capture a second image of said first scene area using a second exposure time, at least said first and second exposure times being of different durations but overlapping in time; and
an image processing module configured to process said first and second images to generate a first combined image of said first scene area.

### Claim 13 (depends on 12)

The apparatus of claim 12,
wherein said image processing module is further configured to weight pixel values of said first and second images corresponding to the same portion of said first scene area as a function of said first and second exposure times, respectively and sum the weighted pixel values, as part of being configured to process said first and second images to generate a first combined image of said first scene area.

### Claim 14 (depends on 12)

The apparatus of claim 12,
wherein said plurality of optical chain modules further comprises a third optical chain module configured to capture a third image of said first scene area using a third exposure time; and
wherein said image processing module is further configured to process said third image to generate said first combined image of said first scene area from the third image in addition to said first and second images.

### Claim 15 (depends on 14)

The apparatus of claim 14, wherein said third exposure time is different than said first and second exposure times.

### Claim 16 (depends on 14)

The apparatus of claim 14, wherein at least one of said first, second or third optical chain modules is further configured to capture a fourth image of the first scene area prior to capture of said first, second and third images, the apparatus further comprising:
a display device configured to display said fourth image.

### Claim 17 (depends on 14)

The apparatus of claim 14,
wherein at least one of said first, second or third optical chain modules is further configured to capture a fourth image of the first scene area after one of said first, second or third images has been captured;
wherein the apparatus further comprises a display device configured to display said fourth image; and
wherein the combined image is generated after the display of the fourth image on the display device.

### Claim 18 (depends on 17)

The apparatus of claim 17, wherein said at least one of said first, second and third optical chain modules uses a fourth exposure time different from said first, second and third exposure times to capture a fourth image of the first scene area.

### Claim 19 (depends on 16)

The apparatus of claim 16, wherein said at least one of said first, second and third optical chain modules uses a fourth exposure time different from said first, second and third exposure times to capture said fourth image of the first scene area.

### Claim 20

A computer readable medium including computer executable instructions which when executed by a processor control an apparatus to:
operate a plurality of optical chain modules in parallel to capture images of a first scene area, wherein operating a plurality of optical chain modules includes controlling a first optical chain module to capture a first image of the first scene area using a first exposure time, and controlling a second optical chain module to capture a second image of said first scene area using a second exposure time, at least said first and second exposure times being of different durations but overlapping in time; and
process said first and second images to generate a first combined image of said first scene area.