# US 2022/0035160 A1 · Camera System

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2022/0035160 A1
- Document ID: US20220035160A1
- Status: Published application
- Kind: A1
- Application number: 17/276,476
- Filed: 2019-09-27
- Published: 2022-02-03
- Earliest claimed: 2018-09-28
- Assignees: Apple Inc.
- Applicants: Apple Inc.
- Inventors: Noah D. Bedard; Ricardo J. Motta; Emanuele Mandelli; Daniel R. Hennigan; Kathrin Berkner Cieslicki; Branko Petljanski; Brett D. Miller; Kenichi Saito
- Web page: https://patentgrep.com/patent/US20220035160A1

## CPC

- G02B 27/0075: {with means for altering, e.g. increasing, the depth of field or depth of focus}
- G02B 27/0172: {characterised by optical features}
- G02B 3/0056: {arranged along two different directions in a plane, e.g. honeycomb arrangement of lenses (G02B3/0043 takes precedence; miniaturised objectives for electronic devices employing wafer level optics G02B13/0085)}
- G02B 3/0062: {Stacked lens arrays, i.e. refractive surfaces arranged in at least two planes, without structurally separate optical elements in-between}
- G02B 30/29: characterised by the geometry of the lenticular array, e.g. slanted arrays, irregular arrays or arrays of varying shape or size
- G03B 30/00: Camera modules comprising integrated lens units and imaging units, specially adapted for being embedded in other devices, e.g. mobile phones or vehicles
- G03B 35/08: by simultaneous recording
- G03B 37/04: with cameras or projectors providing touching or overlapping fields of view
- H04N 25/41: {Extracting pixel data from a plurality of image sensors simultaneously picking up an image, e.g. for increasing the field of view by combining the outputs of a plurality of sensors}
- G02B 2027/0123: {comprising devices increasing the field of view}
- G02B 2027/0129: {comprising devices for correcting parallax}
- G02B 2027/0134: {of stereoscopic type}
- G02B 2027/0138: {comprising image capture systems, e.g. camera}
- G02B 2027/014: {comprising information/image processing systems}
- G02B 2027/0198: {System for aligning or maintaining alignment of an image in a predetermined direction}
- G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G03B: APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR (optical parts of such apparatus G02B; photosensitive materials or processes for photographic purposes G03C; apparatus for processing exposed photographic materials G03D)
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

A device for MR/VR systems that includes a two-dimensional array of cameras that capture images of respective portions of a scene. The cameras are positioned along a spherical surface so that the cameras have adjacent fields of view. The entrance pupils of the cameras are positioned at or near the user's eye while the cameras also form optimized images at the sensor. Methods for reducing the number of cameras in an array, as well as methods for reducing the number of pixels read from the array and processed by the pipeline, are also described.

## Claims

### Claim 1

A system, comprising:
a device, comprising:
a two-dimensional array of cameras, wherein each camera in the array is configured to capture light from a respective portion of a field of view (FOV) in front of the device;
wherein each camera in the array comprises, from an object side of the camera to an image side of the camera:
a first lens group comprising one or more lens elements;
an aperture stop; and
a second lens group comprising one or more lens elements; and
a plurality of image sensors configured to capture images formed by the cameras at image planes at or near surfaces of the image sensors;
wherein the entrance pupils of at least some of the cameras in the array are formed at a common plane located behind the image planes formed at the image sensors.

### Claim 2 (depends on 1)

The system as recited in claim 1, wherein the common plane is located at or near a user's eye so that the array of cameras captures views of a scene in front of the device from substantially a same perspective as the user's eye.

### Claim 3 (depends on 1)

The system as recited in claim 1, wherein the entrance pupil of a given camera is a virtual image of the light refracted by the first lens group formed by the aperture stop.

### Claim 4 (depends on 3)

The system as recited in claim 3, wherein the first lens group and the aperture stop are configured to optimize the virtual image at the entrance pupil plane.

### Claim 5 (depends on 4)

The system as recited in claim 4, wherein the second lens group is configured to correct for aberrations to optimize an image formed at an image plane at or near an object-side surface of a respective one of the image sensors.

### Claim 6 (depends on 1)

The system as recited in claim 1, wherein the cameras are arranged in the array so that the FOVs of adjacent cameras are adjacent with no parallax between the adjacent cameras.

### Claim 7 (depends on 1)

The system as recited in claim 1, wherein the one or more lens elements in the first lens group of each camera are formed so that the cameras fit together in the array with minimal or no gaps between the first lens groups of the cameras.

### Claim 8 (depends on 1)

The system as recited in claim 1, wherein the device further comprises:
a camera; and
a prism that reflects light that enters the object side surface of the prism to the camera to cover a portion of the FOV in front of the device.

### Claim 9 (depends on 1)

The system as recited in claim 1, wherein the device further comprises a front-facing camera that covers a portion of the FOV in front of the device.

### Claim 10 (depends on 1)

The system as recited in claim 1, wherein one or more cameras in peripheral portions of the array are configured to capture images at lower resolution than one or more cameras in a center portion of the array.

### Claim 11 (depends on 10)

The system as recited in claim 10, wherein the one or more cameras in the peripheral portions of the array cover larger portions of the FOV than the one or more cameras in the center portion of the array.

### Claim 12 (depends on 11)

The system as recited in claim 11, wherein the entrance pupils of the one or more cameras in the center portion of the array are formed at a plane located at a user's eye, and wherein the entrance pupils of the one or more cameras in the peripheral portions of the array are formed at one or more planes located between the user's eye and the sensor.

### Claim 13 (depends on 1)

The system as recited in claim 1, wherein the cameras are arranged in the array to provide a small amount of parallax between adjacent cameras to reduce vignetting and provide spacing between the adjacent cameras.

### Claim 14 (depends on 13)

The system as recited in claim 13, wherein the amount of parallax between the adjacent cameras is one pixel at infinity.

### Claim 15 (depends on 1)

The system as recited in claim 1, wherein there is one image sensor for each camera in the array.

### Claim 16 (depends on 15)

The system as recited in claim 15, wherein the image sensor is a curved sensor.

### Claim 17 (depends on 1)

The system as recited in claim 1, wherein each of the plurality of image sensors captures images for two or more of the cameras in the array.

### Claim 18 (depends on 17)

The system as recited in claim 17, wherein the lens elements and aperture stops of the two or more cameras are configured to tilt the image planes of the respective cameras to align the image planes with the surface of the respective image sensor.

### Claim 19 (depends on 1)

The system as recited in claim 1, further comprising a negative meniscus lens located in front of the array of cameras configured to provide progressively wider fields of view and lower resolution for the cameras from the center of the array towards the periphery of the array.

### Claim 20 (depends on 1)

The system as recited in claim 1, wherein field of view of each camera in the array is within a range of 10 to 25 degrees.
