# US 2024/0393591 A1 · Systems and Methods for Optical Alignment

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2024/0393591 A1
- Document ID: US20240393591A1
- Status: Published application
- Kind: A1
- Application number: 18/488,865
- Filed: 2023-10-17
- Published: 2024-11-28
- Earliest claimed: 2020-11-30
- Assignees: Apple Inc.
- Applicants: Apple Inc.
- Inventors: Scott M. DeLapp; Vikrant Bhakta; Hyungryul Choi; Guolin Peng; Di Hu
- Web page: https://patentgrep.com/patent/US20240393591A1

## CPC

- G02B 27/0172: {characterised by optical features}
- G02B 6/0016: {Grooves, prisms, gratings, scattering particles or rough surfaces}
- G02B 6/0036: {2-D arrangement of prisms, protrusions, indentations or roughened surfaces}
- G02B 26/0875: {by means of one or more refracting elements}
- G02B 27/0081: {with means for altering, e.g. enlarging, the entrance or exit pupil}
- G02B 27/0176: {characterised by mechanical features}
- G02B 27/0179: {Display position adjusting means not related to the information to be displayed}
- G02B 27/0955: {Lenses (lenses per se G02B3/00)}
- G02B 27/0977: {Reflective elements}
- G02B 27/144: {using partially transparent surfaces without spectral selectivity (G02B27/147 takes precedence)}
- G02B 2027/0138: {comprising image capture systems, e.g. camera}
- G02B 2027/014: {comprising information/image processing systems}
- G02B 2027/0163: {Electric or electronic control thereof}
- G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS

## Abstract

A display device may include first and second display modules that provide image light to first and second waveguides. The waveguides may direct the image light to first and second eye boxes. Each display module may include optics mounted to a housing and mechanical alignment structures that mechanically adjust the position of an optical axis of the optics. The alignment structures may rotate the entire housing, may mechanically translate the optics, may adjust the position of a spatial light modulator within the module, and/or control circuitry may change a subset of pixels used by the modulator to compensate for optical misalignment between the first and second eye boxes. The device may include optical misalignment sensors that detect the optical misalignment. The control circuitry may compensate for the optical misalignment as detected by the optical misalignment sensors.

## Claims

### Claim 1

A display system comprising:
a waveguide;
an input coupler on the waveguide and configured to couple image light into the waveguide;
an output coupler on the waveguide and configured to couple the image light out of the waveguide; and
a display module configured to produce the image light, the display module comprising:
a display module housing,
at least one light source within the display module housing,
collimating optics mounted to the display module housing and having an optical axis, the collimating optics being configured to direct the image light towards the input coupler, and
alignment structures configured to adjust a position of the optical axis relative to the waveguide.

### Claim 2 (depends on 1)

The display system of claim 1, wherein the alignment structures are configured to mechanically rotate the display module housing about an axis.

### Claim 3 (depends on 2)

The display system of claim 2, wherein the display module further comprises:
a lens housing, the collimating optics being mounted within the lens housing; and
a set of piezo-driven flexure stages that couple the lens housing to the display module housing, wherein the set of piezo-driven flexure stages are configured to mechanically translate the lens housing along a first axis relative to the display module housing.

### Claim 4 (depends on 3)

The display system of claim 3, wherein the display module further comprises:
an additional set of piezo-driven flexure stages that couple the lens housing to the display module housing, wherein the additional set of piezo-driven flexure stages are configured to mechanically translate the lens housing along a second axis relative to the display module housing, the second axis being orthogonal to the first axis.

### Claim 5 (depends on 3)

The display system of claim 3, wherein the display module further comprises:
a reflective display panel mounted to the display module housing and configured to produce the image light by modulating illumination light emitted by the at least one light source using image data.

### Claim 6 (depends on 5)

The display system of claim 5, wherein the display module further comprises:
additional alignment structures configured to adjust a position of the reflective display panel with respect to the display module housing.

### Claim 7 (depends on 1)

The display system of claim 1, wherein the display module further comprises:
a reflective display panel mounted to the display module housing and configured to produce the image light by modulating illumination light emitted by the at least one light source using image data, wherein the alignment structures are configured to adjust a position of the reflective display panel with respect to the display module housing.

### Claim 8 (depends on 1)

The display system of claim 1, wherein the display module further comprises:
a lens housing, wherein the collimating optics are mounted within the lens housing, the alignment structures couple the lens housing to the display module housing, and the alignment structures are configured to mechanically translate a position of the lens housing relative to the display module housing along at least one axis.

### Claim 9 (depends on 1)

The display system of claim 1, wherein the display module further comprises:
a display panel mounted within the display panel housing and having pixels, wherein the display panel is configured to produce the image light by modulating, using a subset of the pixels, illumination light produced by the at least one light source using image data, and wherein the display system comprises control circuitry configured to change the subset of pixels that are used by the display panel.

### Claim 10 (depends on 1)

The display system of claim 1, further comprising:
an additional waveguide;
an additional input coupler on the additional waveguide and configured to couple additional image light into the additional waveguide;
an additional output coupler on the additional waveguide and configured to couple the additional image light out of the additional waveguide;
an additional display module configured to produce the additional image light;
an optical alignment sensor configured to detect a position of the display module relative to the additional display module; and
control circuitry configured to control the mechanical alignment structures to mechanically adjust the position of the optical axis with respect to the waveguide based on the position detected by the optical alignment sensor.

### Claim 11 (depends on 10)

The display system of claim 10, wherein the optical alignment sensor comprises:
at least one image sensor configured to receive a portion of the image light from the waveguide and a portion of the additional image light from the additional waveguide.

### Claim 12 (depends on 11)

The display system of claim 11, wherein the output coupler is configured to pass the portion of the image light to a first additional output coupler on the waveguide, the first additional output coupler is configured to couple the portion of the image light out of the waveguide and towards the optical alignment sensor, the additional output coupler is configured to pass the portion of the additional image light to a second additional output coupler on the additional waveguide, and the second additional output coupler is configured to couple the portion of the additional image light out of the waveguide and towards the optical alignment sensor.

### Claim 13 (depends on 12)

The display system of claim 12, wherein the at least one image sensor comprises first and second image sensors, the first image sensor is configured to receive the portion of the image light, and the second image sensor is configured to receive the portion of the additional image light.

### Claim 14 (depends on 12)

The display system of claim 12, wherein the at least one image sensor comprises a single image sensor, the display system further comprising:
a first mirror;
a second mirror;
a third mirror; and
a partially reflective beam splitter, wherein the first mirror is configured to reflect the portion of the image light towards the second mirror, the second mirror is configured to reflect the portion of the image light towards the partially reflective beam splitter, the third mirror is configured to reflect the portion of the additional image light towards the partially reflective beam splitter, and the partially reflective beam splitter is configured to direct the portion of the image light and the additional portion of the image light towards the single image sensor.

### Claim 15 (depends on 10)

The display system of claim 10, wherein the optical alignment sensor comprises:
a first light emitter configured to emit first infrared light;
a first set of retro-reflective gratings on the waveguide and configured to diffract the first infrared light;
a second light emitter configured to emit second infrared light;
a second set of retro-reflective gratings on the additional waveguide and configured to diffract the second infrared light;
a first set of photo reflective sensors on the first waveguide and configured to generate a first set of voltages based on a reflected version of the first infrared light diffracted by the first set of retro-reflective gratings; and
a second set of photo reflective sensors on the second waveguide and configured to generate a second set of voltages based on a reflected version of the second infrared light diffracted by the second set of retro-reflective gratings, wherein the control circuitry is configured to control the mechanical alignment structures to mechanically adjust the position of the optical axis with respect to the waveguide based on the first and second sets of voltages.

### Claim 16

A display system comprising:
a first display module configured to produce first image light;
a second display module configured to produce second image light;
a first waveguide having first and second output couplers, wherein the first output coupler is configured to couple a first portion of first image light out of the first waveguide;
a second waveguide having third and fourth output couplers, wherein the third output coupler is configured to couple a first portion of the second image light out of the second waveguide;
a housing portion that couples the first waveguide to the second waveguide;
at least one image sensor in the housing portion, wherein the second output coupler is configured to couple a second portion of the first image light out of the first waveguide and towards the at least one image sensor in the housing portion, wherein the fourth output coupler is configured to couple a second portion of the second image light out of the second waveguide and towards the at least one image sensor in the housing portion, and wherein the at least one image sensor is configured to generate image sensor data based on the second portion of the first image light and the second portion of the second image light; and
control circuitry configured to identify a position of the first image light relative to the second image light based on the image sensor data generated by the at least one image sensor.

### Claim 17 (depends on 16)

The display system of claim 16, wherein the control circuitry is configured to mechanically adjust the first display module to compensate for the identified optical misalignment.

### Claim 18 (depends on 17)

The display system of claim 17, wherein the control circuitry is configured to mechanically adjust the second display module to compensate for the identified optical misalignment.

### Claim 19 (depends on 16)

The display system of claim 16, wherein the control circuitry is configured to change a subset of pixels that are used by the first display module to produce the first image light to compensate for the identified optical misalignment.

### Claim 20

A display system comprising:
a housing having first and second housing portions;
a display module in the first housing portion and configured to produce image light, wherein the display module has collimating optics configured to transmit the image light and wherein the collimating optics have an optical axis;
a waveguide in the second housing portion and configured to direct the image light;
an infrared light emitter in the first housing portion and configured to emit infrared light;
a set of retro-reflective gratings in the first housing portion and configured to reflect the infrared light;
a set of optical sensors in the first housing portion and configured to produce voltages based on the reflected infrared light; and
control circuitry configured to mechanically adjust an orientation of the optical axis based on the voltages produced by the set of optical sensors.
