# US 10,310,598 B2 · Varifocal head-mounted display including modular air spaced optical assembly

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 10,310,598 B2
- Document ID: US10310598B2
- Status: Granted
- Kind: B2
- Application number: 15/407,701
- Filed: 2017-01-17
- Published: 2018-07-19
- Granted: 2019-06-04
- Earliest claimed: 2017-01-17
- Assignees: Facebook Technologies, LLC
- Applicants: Facebook Technologies, LLC
- Inventors: Nicholas Daniel Trail; Douglas Robert Lanman
- Web page: https://patentgrep.com/patent/US10310598B2

## CPC

- G06F 3/013: {Eye tracking input arrangements (G06F3/015 takes precedence)}
- G02B 27/0093: {with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking}
- G02B 27/0172: {characterised by optical features}
- G06F 1/163: {Wearable computers, e.g. on a belt}
- G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)}
- G02B 2027/0138: {comprising image capture systems, e.g. camera}
- G02B 2027/014: {comprising information/image processing systems}
- G02B 2027/0185: {Displaying image at variable distance}
- G02C 7/081: {Ophthalmic lenses with variable focal length}
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02C: SPECTACLES; SUNGLASSES OR GOGGLES INSOFAR AS THEY HAVE THE SAME FEATURES AS SPECTACLES; CONTACT LENSES (trial frames for testing the eyes A61B3/04; goggles or eyeshields not having the same features as spectacles A61F9/00)

## Abstract

A head-mounted display (HMD) includes an electronic display configured to emit image light, an optical assembly that provides optical correction to the image light, an eye tracking system, and a varifocal module. The optical assembly includes a back optical element configured to receive the image light from the electronic display, and a coupling assembly configured to couple a front optical element to a location within the optical assembly such that the front optical element receives light transmitted by the back optical element. The optical correction is determined in part by an optical characteristic of the front optical element that is replaceable. The eye tracking system determines eye tracking information for a first eye of a user of the HMD. A varifocal module adjusts focus of images displayed on the electronic display, based on the eye tracking information and the optical correction.

## Claims

### Claim 1

A head-mounted display (HMD) comprising:
a display;
an optical assembly comprising a front optical element sharing an optical axis with a back optical element and the display, the back optical element adjacent to the display with an air gap between the front optical element and the back optical element, wherein the optical assembly is configured to change an optical power of at least one of the front optical element and the back optical element;
an eye tracker comprising an illumination source located in the air gap, the eye tracker configured to:
obtain information about the optical power,
output light generated by the illumination source, and
determine a position of a user's eye relative to the optical axis, based at least in part on a modified version of the output light, the output light being modified by the optical power prior to reflection from the user's eye; and
a varifocal module configured to adjust focus of one or more images displayed on the display by adjusting a focal distance of the optical assembly, based on at least one of the determined position of the user's eye and the optical power.

### Claim 2 (depends on 1)

The HMD of claim 1, wherein the front optical element is replaceable and selected from a set of optical elements, each optical element from the set having a different optical characteristic.

### Claim 3 (depends on 2)

The HMD of claim 2, wherein each optical element from the set has a different optical prescription.

### Claim 4 (depends on 2)

The HMD of claim 2, wherein the set of optical elements comprises spherical lenses with spherical optical powers of −6, −3, 0, and +3 diopters, and other lenses with the same spherical optical powers having additional diopters for astigmatism.

### Claim 5 (depends on 1)

The HMD of claim 1, wherein the front optical element is rotatable to align the front optical element within the optical assembly to compensate for astigmatism.

### Claim 6 (depends on 1)

The HMD of claim 1, wherein the varifocal module is configured to adjust focus of the one or more images displayed on the display by adjusting position of at least one of the display, the front optical element and the back optical element.

### Claim 7 (depends on 1)

The HMD of claim 1, wherein the eye tracker is positioned optically after reflection from the back optical element.

### Claim 8 (depends on 1)

The HMD of claim 1, wherein the eye tracker is positioned optically folded between the front optical element and the back optical element.

### Claim 9 (depends on 1)

The HMD of claim 1, wherein the back optical element comprises a first surface adjacent to the display and a second surface opposite to the first surface configured to reflect light of a defined range of wavelengths, and the eye tracker comprises:
the illumination source positioned optically between the front optical element and the back optical element, the illumination source configured to illuminate the second surface of the back optical element with the output light having one or more wavelengths within the defined range of wavelengths;
an imaging device positioned optically between the front optical element and the back optical element, the imaging device configured to capture an image of the user's eye illuminated with the modified version of the output light having the one or more wavelengths and reflected from the second surface of the back optical element; and
a controller coupled to the imaging device and the illumination source, the controller configured to:
determine the position of the user's eye based on the captured image, and
adjust resolution of the one or more images displayed on the display, based on the determined position of the user's eye.

### Claim 10 (depends on 9)

The HMD of claim 9, wherein the second surface is coated to reflect light of the defined range of wavelengths and transmit visible light.

### Claim 11 (depends on 9)

The HMD of claim 9, wherein the second surface is spherical, aspherical, consisting of a polynominal basis, or of a free-form.

### Claim 12 (depends on 9)

The HMD of claim 9, wherein the imaging device is oriented to capture the image of the eye illuminated with the modified version of the output light reflected from the eye and then from the second surface of the back optical element.

### Claim 13 (depends on 1)

The HMD of claim 1, wherein the illumination source and an imaging device of the eye tracker are positioned outside of a primary display optical path to the user's eye and at opposite sides of the optical axis.

### Claim 14 (depends on 1)

The HMD of claim 1, wherein the front optical element is composed of a different material than the back optical element.

### Claim 15 (depends on 1)

The HMD of claim 1, wherein the optical assembly further comprises at least one other optical element positioned to share the optical axis with the front optical element and the back optical element.

### Claim 16

A head-mounted display (HMD) comprising:
a display configured to emit image light;
an optical assembly that provides optical correction to the image light, the optical assembly comprising:
a back optical element configured to receive the image light from the display, the back optical element sharing an optical axis with a front optical element and the display, and
a coupling assembly, the coupling assembly configured to couple the front optical element to a location within the optical assembly such that the front optical element receives light transmitted by the back optical element, and that there is an air gap between the location and the back optical element, wherein the optical correction is determined in part by an optical power of the optical assembly;
an eye tracking system comprising an illumination source located in the air gap, the eye tracking system configured to:
obtain information about the optical power,
output light generated by the illumination source, and
determine eye tracking information for one or both eyes of a user of the HMD, based at least in part on a modified version of the output light, the output light being modified by the optical power prior to reflection from the user's eye; and
a varifocal module configured to adjust focus of one or more images displayed on the display by adjusting a focal distance of the optical assembly, based on at least one of the eye tracking information and the optical power.

### Claim 17 (depends on 16)

The HMD of claim 16, wherein the varifocal module is configured to compensate for a difference between a prescription of the user and the optical power to provide the optical correction to the image light.

### Claim 18 (depends on 16)

The HMD of claim 16, wherein the varifocal module is configured to adjust focus of the one or more images displayed on the display by adjusting position of at least one of the display, the front optical element and the back optical element, based on the eye tracking information and the optical correction.

### Claim 19 (depends on 16)

The HMD of claim 16, wherein:
the front optical element is coupled, via the coupling assembly, to the location within the optical assembly; and
the front optical element is positioned in optical series with the back optical element adjacent to the display.

### Claim 20 (depends on 19)

The HMD of claim 19, wherein the back optical element comprises a first surface adjacent to the display and a second surface opposite to the first surface configured to reflect light of a defined range of wavelengths, and the eye tracking system comprises:
the illumination source positioned between the front optical element and the back optical element, the illumination source configured to illuminate the second surface of the back optical element with the output light having one or more wavelengths within the defined range of wavelengths;
an imaging device positioned between the front optical element and the back optical element, the imaging device and the illumination source positioned at opposite sides of the optical axis, the imaging device configured to capture an image of the user's eye illuminated with the modified version of the output light having the one or more wavelengths and reflected from the second surface of the back optical element; and
a controller coupled to the imaging device and the illumination source, the controller configured to determine the eye tracking information based on the captured image.

### Claim 21 (depends on 20)

The HMD of claim 20, wherein:
the modified version of the output light having the one or more wavelengths reflected from the second surface of the back optical element comprises infra-red (IR) light; and
the imaging device comprises a camera configured to capture images in the IR.

### Claim 22 (depends on 20)

The HMD of claim 20, wherein the first surface of the back optical element comprises a Fresnel surface.

### Claim 23 (depends on 19)

The HMD of claim 19, wherein the front optical element is replaceable and selected from a set of optical elements, each optical element from the set having a different optical characteristic.