# US 12,181,681 B2 · Plenoptic camera measurement and calibration of head-mounted displays

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 12,181,681 B2
- Document ID: US12181681B2
- Status: Granted
- Kind: B2
- Application number: 18/505,437
- Filed: 2023-11-09
- Published: 2024-03-07
- Granted: 2024-12-31
- Earliest claimed: 2020-07-06
- Assignees: Magic Leap, Inc.
- Applicants: Magic Leap, Inc.
- Inventors: Miller Harry Schuck, III
- Web page: https://patentgrep.com/patent/US12181681B2

## CPC

- G02B 27/0172: {characterised by optical features}
- G02B 5/201: {in the form of arrays}
- G02B 27/0025: {for optical correction, e.g. distorsion, aberration}
- G02B 27/0075: {with means for altering, e.g. increasing, the depth of field or depth of focus}
- G02B 27/0081: {with means for altering, e.g. enlarging, the entrance or exit pupil}
- G02B 27/0149: {characterised by mechanical features (G02B27/0176 takes precedence)}
- G02B 27/0179: {Display position adjusting means not related to the information to be displayed}
- G02B 27/283: {used for beam splitting or combining}
- G02B 27/62: Optical apparatus specially adapted for adjusting optical elements during the assembly of optical systems
- G02B 2027/0138: {comprising image capture systems, e.g. camera}
- G02B 2027/014: {comprising information/image processing systems}
- G02B 2027/0178: {Eyeglass type (eyeglass details G02C)}
- G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS

## Abstract

A method for measuring performance of a head-mounted display module, the method including arranging the head-mounted display module relative to a plenoptic camera assembly so that an exit pupil of the head-mounted display module coincides with a pupil of the plenoptic camera assembly; emitting light from the head-mounted display module while the head-mounted display module is arranged relative to the plenoptic camera assembly; filtering the light at the exit pupil of the head-mounted display module; acquiring, with the plenoptic camera assembly, one or more light field images projected from the head-mounted display module with the filtered light; and determining information about the performance of the head-mounted display module based on acquired light field image.

## Claims

### Claim 1

A system, comprising:
a plenoptic camera assembly comprising a camera lens defining an image plane, a camera sensor, and a microlens array arranged to image light at the image plane to the camera sensor;
a stage for receiving a head-mounted display module;
a filter array positioned in a light path between the camera lens and the head-mounted display module; and
a system controller in communication with the plenoptic camera assembly and programmed to cause, during operation of the system, acquire one or more light field images projected from the head-mounted display module and determine information about a performance of the head-mounted display module based on the acquired light field image.

### Claim 2 (depends on 1)

The system of claim 1, the stage configured for positioning the head-mounted display module with respect to the plenoptic camera assembly so that an exit pupil of the head-mounted display module coincides with a pupil of the plenoptic camera assembly.

### Claim 3 (depends on 1)

The system of claim 1, wherein the filter array comprises a plurality of spatially discrete filters.

### Claim 4 (depends on 3)

The system of claim 3, wherein the plurality of spatially discrete filters extend across an aperture of the camera lens.

### Claim 5 (depends on 1)

The system of claim 1, wherein the filter array comprises a spatially discrete color filter, a spatially discrete polarization filter, or a spatially discrete neutral density filter.

### Claim 6 (depends on 5)

The system of claim 5, wherein the spatially discrete color filter comprises an X, Y, Z tristimulus color filter.

### Claim 7 (depends on 1)

The system of claim 1, wherein the filter array comprises a first array of spatially discrete color filters and a second array of spatially discrete color filters overlapping with the first array, the first and second arrays of spatially discrete filters filtering different properties of the light.

### Claim 8 (depends on 7)

The system of claim 7, wherein the properties of the light are selected from the group consisting of color, polarization, and intensity.

### Claim 9 (depends on 2)

The system of claim 2, further comprising an optical assembly arranged at the pupil of the plenoptic camera assembly.

### Claim 10 (depends on 9)

The system of claim 9, wherein the optical assembly is configured to combine light emitted from multiple different locations of the exit pupil of the head-mounted display module to form multiple overlapping images at a sensor of the plenoptic camera assembly.

### Claim 11 (depends on 10)

The system of claim 10, wherein each of the multiple overlapping images corresponds to a different user view for the head-mounted display module.

### Claim 12 (depends on 9)

The system of claim 9, wherein the optical assembly comprises one or more polarizing beam splitters arranged at different locations in the exit pupil of the head-mounted display module.

### Claim 13 (depends on 12)

The system of claim 12, comprising a beam combiner arranged in the pupil of the plenoptic camera assembly arranged to receive light from each of the polarizing beam splitters and direct the light from each polarizing beam splitter along a common path to the camera lens.

### Claim 14 (depends on 1)

The system of claim 1, wherein the filter array is arranged at a pupil of the plenoptic camera assembly.