# US 2023/0273433 A1 · Stereo alignment assessment for head-mounted display

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2023/0273433 A1
- Document ID: US20230273433A1
- Status: Published application
- Kind: A1
- Application number: 17/652,901
- Filed: 2022-02-28
- Published: 2023-08-31
- Earliest claimed: 2022-02-28
- Assignees: Microsoft Technology Licensing, LLC
- Applicants: Microsoft Technology Licensing, LLC
- Inventors: James Peele TERRELL, JR.; Michael Scott SUTTON; Rayna DEMASTER-SMITH; Dmitriy CHURIN; Parry Byron JOHNSON
- Web page: https://patentgrep.com/patent/US20230273433A1

## CPC

- G02B 27/0172: {characterised by optical features}
- G02B 6/10: of the optical waveguide type (G02B6/02, G02B6/24 take precedence; devices or arrangements for the control of light by electric, magnetic, electro-magnetic or acoustic means G02F1/00; transferring the modulation of modulated light G02F2/00; optical logic elements G02F3/00; optical analogue/digital converters G02F7/00)
- G02B 27/0081: {with means for altering, e.g. enlarging, the entrance or exit pupil}
- G02B 27/0093: {with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking}
- G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)}
- H04N 13/327: Calibration thereof
- H04N 13/344: with head-mounted left-right displays
- G02B 2027/0132: {comprising binocular systems}
- G02B 2027/0134: {of stereoscopic type}
- G02B 2027/0178: {Eyeglass type (eyeglass details G02C)}
- G02B 2027/0198: {System for aligning or maintaining alignment of an image in a predetermined direction}
- G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

A head-mounted display system includes a left display assembly configured to provide left-side display light and left-side test light. A left waveguide incouples the left-side display light and outcouples the left-side display light for viewing. A left optical sensor is positioned to measure the left-side test light. A left inertial measurement unit (IMU) is configured to measure an orientation of the left display assembly. A right display assembly is configured to provide right-side display light and right-side test light. A right waveguide incouples the right-side display light and outcouples the right-side display light for viewing. A right optical sensor is positioned to right the right-side test light. A right IMU is configured to measure an orientation of the left display assembly. A logic machine is configured to assess a stereo alignment for the left- and right-side display light.

## Claims

### Claim 1

A head-mounted display system, comprising:
a left display assembly configured to provide left-side display light and left-side test light;
a left waveguide configured to incouple the left-side display light from the left display assembly and outcouple the left-side display light for viewing at a left eyebox;
a left optical sensor positioned to measure the left-side test light;
a left inertial measuring unit (IMU) configured to measure an orientation of the left display assembly;
a right display assembly configured to provide right-side display light and right-side test light;
a right waveguide configured to incouple the right-side display light from the right display assembly and outcouple the right-side display light for viewing at a right eyebox;
a right optical sensor positioned to measure the right-side test light;
a right IMU configured to measure an orientation of the right display assembly; and
a logic machine configured to assess a stereo alignment for the left- and right-side display light based at least in part on the left-side test light measured by the left optical sensor, the right-side test light measured by the right optical sensor, the orientation of the left display assembly measured by the left IMU, and the orientation of the right display assembly measured by the right IMU.

### Claim 2 (depends on 1)

The head-mounted display system of claim 1, wherein the left IMU is physically coupled to the left display assembly and the right IMU is physically coupled to the right display assembly.

### Claim 3 (depends on 1)

The head-mounted display system of claim 1, wherein the left waveguide is configured to incouple the left-side test light and outcouple the left-side test light for sensing by the left optical sensor, and the right waveguide is configured to incouple the right-side test light and outcouple the right-side test light for sensing by the right optical sensor.

### Claim 4 (depends on 1)

The head-mounted display system of claim 1, wherein the left optical sensor is coupled to the left waveguide and the right optical sensor is coupled to the right waveguide.

### Claim 5 (depends on 4)

The head-mounted display system of claim 4, wherein the left waveguide has a left inner portion proximate to the right waveguide and a left outer portion distal from the right waveguide, and the right waveguide has a right inner portion proximate to the left waveguide and a right outer portion distal to the left waveguide, and wherein the left optical sensor is coupled to the left outer portion of the left waveguide, and the right optical sensor is coupled to the right outer portion of the right waveguide.

### Claim 6 (depends on 1)

The head-mounted display system of claim 1, wherein the left display assembly includes a first left pupil for releasing the left-side display light and a second left pupil for releasing the left-side test light, and wherein the right display assembly includes a first right pupil for releasing the right-side display light and a second right pupil for releasing the right-side test light.

### Claim 7 (depends on 1)

The head-mounted display system of claim 1, wherein the left display assembly includes a shared left pupil for releasing the left-side display light and the left-side test light, and the right display assembly includes a shared right pupil for releasing the right-side display light and the right-side test light.

### Claim 8 (depends on 1)

The head-mounted display system of claim 1, wherein the left display assembly includes a left liquid crystal on silicon (LCOS) display and the right display assembly includes a right LCOS display.

### Claim 9 (depends on 1)

The head-mounted display system of claim 1, wherein the left display assembly includes a left microoptoelectromechanical system (MOEMS) projector display and the right display assembly includes a right MOEMS projector display.

### Claim 10 (depends on 1)

The head-mounted display system of claim 1, wherein the logic machine is further configured to improve the stereo alignment by adjusting one or both of the left- and right-side display light.

### Claim 11 (depends on 1)

The head-mounted display system of claim 1, wherein the logic machine is further configured to improve the stereo alignment by horizontally and/or vertically shifting or rotating one or both of a left display image of the left-side display light and a right display image of the right-side display light.

### Claim 12 (depends on 1)

The head-mounted display system of claim 1, wherein the left waveguide includes a first left-side diffractive optical element (L-DOE-I) for incoupling the left-side display light, and a second left-side diffractive optical element (L-DOE-O) for outcoupling the left-side display light for viewing at the left eyebox, and wherein the right waveguide includes a first right-side diffractive optical element (R-DOE-I) for incoupling the right-side display light, and a second right-side diffractive optical element (R-DOE-O) for outcoupling the right-side display light for viewing at the right eyebox.

### Claim 13 (depends on 12)

The head-mounted display system of claim 12, wherein the left waveguide further includes one or more left-side expansion diffractive optical elements (L-DOE-X) between the L-DOE-I and the L-DOE-O for expanding the left-side display light along one or more orthogonal dimensions, and the right waveguide further includes one or more right-side expansion diffractive optical elements (R-DOE-X) between the R-DOE-I and the R-DOE-O for expanding the right-side display light along the one or more orthogonal dimensions.

### Claim 14 (depends on 1)

The head-mounted display system of claim 1, wherein the left optical sensor includes a left pinhole camera, and the right optical sensor includes a right pinhole camera.

### Claim 15

A head-mounted display system, comprising:
a wearable frame assembly;
a left display assembly mounted to a left side of the wearable frame assembly and configured to provide left-side display light and left-side test light;
a left waveguide mounted to the left side of the wearable frame assembly and configured to incouple the left-side display light from the left display assembly and outcouple the left-side display light for viewing at a left eyebox;
a left optical sensor positioned to measure the left-side test light proximate the left display assembly;
a left inertial measuring unit (IMU) mounted to the left display assembly and configured to measure an orientation of the left display assembly;
a right display assembly mounted to a right side of the wearable frame assembly and configured to provide right-side display light and right-side test light;
a right waveguide mounted to the right side of the wearable frame assembly and configured to incouple the right-side display light from the right display assembly and outcouple the right-side display light for viewing at a right eyebox;
a right optical sensor positioned to measure the right-side test light proximate the right display assembly;
a right IMU mounted to the right display assembly and configured to measure an orientation of the right display assembly; and
a logic machine configured to assess a stereo alignment for the left- and right-side display light based at least on the left-side test light measured by the left optical sensor, the right-side test light measured by the right optical sensor, the orientation of the left display assembly measured by the left IMU, and the orientation of the right display assembly measured by the right IMU.

### Claim 16 (depends on 15)

The head-mounted display system of claim 15, wherein the wearable frame assembly includes a left temple support and a right temple support, and wherein the left display assembly is coupled to the left temple support, and the right display assembly is coupled to the right temple support.

### Claim 17 (depends on 15)

The head-mounted display system of claim 15, wherein the left optical sensor is coupled to the left waveguide, and the right optical sensor is coupled to the right waveguide.

### Claim 18 (depends on 15)

The head-mounted display system of claim 15, wherein the left optical sensor is coupled to the left display assembly, and the right optical sensor is coupled to the right display assembly.

### Claim 19 (depends on 15)

The head-mounted display system of claim 15, wherein the left waveguide is configured to incouple the left-side test light and outcouple the left-side test light for sensing by the left optical sensor, and the right waveguide is configured to incouple the right-side test light and outcouple the right-side test light for sensing by the right optical sensor.

### Claim 20

A method for display system alignment assessment, the method comprising:
at a left display assembly of a head-mounted display system, emitting left-side display light and left-side test light, the left-side display light incoupled by a left waveguide and outcoupled for viewing at a left eyebox;
at a right display assembly of the head-mounted display system, emitting right-side display light and right-side test light, the right-side display light incoupled by a right waveguide and outcoupled for viewing at a right eyebox;
measuring the left-side test light at a left optical sensor proximate to the left display assembly;
measuring the right-side test light at a right optical sensor proximate to the right display assembly;
assessing a left-side potential misalignment between the left display assembly and the left waveguide based at least in part on the left-side test light measured by the left optical sensor;
assessing a right-side potential misalignment between the right display assembly and the right waveguide based at least in part on the right-side test light measured by the right optical sensor; and
assessing a stereo alignment between the left display assembly and the right display assembly based at least in part on an orientation of the left display assembly measured by a left inertial measurement unit (IMU) coupled to the left display assembly, and an orientation of the right display assembly measured by a right IMU coupled to the right display assembly.
