# US 12,001,023 B2 · Wearable pupil-forming display apparatus

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 12,001,023 B2
- Document ID: US12001023B2
- Status: Granted
- Kind: B2
- Application number: 18/123,448
- Filed: 2023-03-20
- Published: 2023-10-19
- Granted: 2024-06-04
- Earliest claimed: 2020-08-03
- Assignees: Raytrx, LLC
- Applicants: Raytrx, LLC
- Inventors: David Kessler; Michael H. Freeman; Jordan Boss; Mitchael C. Freeman; Steven Yeager
- Web page: https://patentgrep.com/patent/US12001023B2

## CPC

- G02B 27/0172: {characterised by optical features}
- H04N 13/344: with head-mounted left-right displays
- G02B 13/0025: {having one lens only}
- G02B 13/0065: {having a beam-folding prism or mirror}
- G02B 13/0095: {Relay lenses or rod lenses (in instruments for viewing the inside of hollow bodies G02B23/2446)}
- G02B 27/0176: {characterised by mechanical features}
- G02B 27/0179: {Display position adjusting means not related to the information to be displayed}
- G02B 27/283: {used for beam splitting or combining}
- G02B 27/286: {for controlling or changing the state of polarisation, e.g. transforming one polarisation state into another (G02B5/3083 takes precedence; light guide coupling means utilising polarising elements G02B6/34)}
- G02B 30/35: using reflective optical elements in the optical path between the images and the observer
- G02B 30/36: using refractive optical elements, e.g. prisms, in the optical path between the images and the observer
- G06F 3/013: {Eye tracking input arrangements (G06F3/015 takes precedence)}
- G06T 7/50: Depth or shape recovery
- G09G 3/007: {Use of pixel shift techniques, e.g. by mechanical shift of the physical pixels or by optical shift of the perceived pixels}
- H04N 13/383: for tracking with gaze detection, i.e. detecting the lines of sight of the viewer's eyes
- G02B 2027/0123: {comprising devices increasing the field of view}
- G02B 2027/0134: {of stereoscopic type}
- G02B 2027/0138: {comprising image capture systems, e.g. camera}
- G02B 2027/0159: {with mechanical means other than scaning means for positioning the whole image}
- G02B 2027/0187: {slaved to motion of at least a part of the body of the user, e.g. head, eye}
- G09G 2340/0407: Resolution change, inclusive of the use of different resolutions for different screen areas
- H04N 23/90: Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums
- G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00)

## Abstract

A wearable display apparatus is described herein. The wearable display apparatus includes an image generator that forms a 2D image, a partially transmissive mirror having a curved reflective surface, a beam splitter disposed to reflect light toward the curved mirror surface, and an optical image relay that is configured to conjugate the formed 2D image at the image generator to a curved focal surface of the partially transmissive mirror.

## Claims

### Claim 1

A wearable display apparatus comprising:
a headset including an optical module housing configured to be disposed above an eye of a viewer;
one or more front facing cameras mounted to the headset;
an image generator that forms a 2D image;
a partially transmissive mirror having a curved reflective surface;
a beam splitter disposed to reflect light toward the curved mirror surface; and
an optical image relay that is housed within the optical module housing and configured to conjugate the formed 2D image at the image generator to a curved focal surface of the partially transmissive mirror, wherein the curved focal surface is defined between the curved reflective surface of the partially transmissive mirror and the beam splitter, wherein the optical image relay comprises:
a prism having an input surface, an output surface, and a folding surface extending between the input and output surfaces and configured for folding an optical path for light generated by the image generator, wherein an aperture stop for the relay lies within the prism;
at least a first plano-aspheric lens in optical contact against the prism input surface and configured to guide light from the image generator toward the folding surface;
wherein the relay, curved mirror, and beam splitter are configured to form an exit pupil for viewing the 2D image superimposed on a portion of a visible object scene; and
a control logic processor coupled to the one or more front facing cameras and the image generator, and programmed to execute an algorithm including the steps of:
receiving image data from the one or more front facing cameras; and
operating the image generator to display the received image data onto the curved mirror.

### Claim 2 (depends on 1)

The wearable display apparatus of claim 1, wherein the one or more front facing cameras include SLAM cameras.

### Claim 3 (depends on 1)

The wearable display apparatus of claim 1, wherein the beam splitter and curved mirror are arranged to lie along a visual axis of the viewer.

### Claim 4 (depends on 1)

The wearable display apparatus of claim 1, further comprising a rechargeable battery.

### Claim 5 (depends on 1)

The wearable display apparatus of claim 1, wherein the headset includes an adjustable strap and a counterweight.

### Claim 6 (depends on 1)

The wearable display apparatus of claim 1, further comprising:
a gaze tracking system configured to detect a focus of attention of the viewer;
wherein the control logic processor is programmed to operate the image generator to adjust the formed 2D image based on the detected focus of attention of the viewer.

### Claim 7 (depends on 6)

The wearable display apparatus of claim 6, wherein the control logic processor is programmed to operate the image generator to adjust an image aspect ratio of the formed 2D image based on the detected focus of attention of the viewer.

### Claim 8 (depends on 6)

The wearable display apparatus of claim 6, wherein the gaze tracking system includes:
a sensor light generator configured to transmit sensing light along the optical path.

### Claim 9 (depends on 8)

The wearable display apparatus of claim 8, wherein the gaze tracking system includes:
a complementary facing prism coupled to the prism adjacent the folding surface; and
a tracking sensor coupled to the complementary facing prism.

### Claim 10 (depends on 9)

The wearable display apparatus of claim 9, wherein the folding surface includes a dichroic surface treated to direct the sensing light to the beam splitter, the curved mirror, and to an iris of the viewer, such that sensing light returning from the iris retraces a light path to the prism and a portion of the returning sensing light is transmitted through the folding surface and conveyed through the complementary facing prism to the tracking sensor.

### Claim 11

A wearable display apparatus comprising:
a headset including an optical module housing configured to be disposed above an eye of a viewer;
one or more front facing cameras mounted to the headset; and
a left-eye optical system coupled to the headset; and
a right-eye optical system coupled to the headset;
wherein each of the left-eye and the right-eye optical systems include:
an image generator that forms a 2D image;
a partially transmissive mirror having a curved reflective surface;
a beam splitter disposed to reflect light toward the curved mirror surface; and
an optical image relay that is housed within the optical module housing and configured to conjugate the formed 2D image at the image generator to a curved focal surface of the partially transmissive mirror, wherein the curved focal surface is defined between the curved reflective surface of the partially transmissive mirror and the beam splitter, wherein the optical image relay comprises:
a prism having an input surface, an output surface, and a folding surface extending between the input and output surfaces and configured for folding an optical path for light generated by the image generator, wherein an aperture stop for the relay lies within the prism; and
at least a first plano-aspheric lens in optical contact against the prism input surface and configured to guide light from the image generator toward the folding surface;
wherein the relay, curved mirror, and beam splitter are configured to form an exit pupil for viewing the 2D image superimposed on a portion of a visible object scene; and
a control logic processor coupled to the one or more front facing cameras and the image generator, and programmed to execute an algorithm including the steps of:
receiving image data from the one or more front facing cameras; and
operating the image generator to display the received image data onto the curved mirror.

### Claim 12 (depends on 11)

The wearable display apparatus of claim 11, wherein the one or more front facing cameras include SLAM cameras.

### Claim 13 (depends on 11)

The wearable display apparatus of claim 11, wherein the beam splitter and curved mirror are arranged to lie along a visual axis of the viewer.

### Claim 14 (depends on 11)

The wearable display apparatus of claim 11, further comprising a rechargeable battery.

### Claim 15 (depends on 11)

The wearable display apparatus of claim 11, wherein the headset includes an adjustable strap and a counterweight.

### Claim 16 (depends on 11)

The wearable display apparatus of claim 11, further comprising:
a gaze tracking system configured to detect a focus of attention of the viewer;
wherein the control logic processor is programmed to operate the image generator to adjust the formed 2D image based on the detected focus of attention of the viewer.

### Claim 17 (depends on 16)

The wearable display apparatus of claim 16, wherein the control logic processor is programmed to operate the image generator to adjust an image aspect ratio of the formed 2D image based on the detected focus of attention of the viewer.

### Claim 18 (depends on 16)

The wearable display apparatus of claim 16, wherein the gaze tracking system includes:
a sensor light generator configured to transmit sensing light along the optical path.

### Claim 19 (depends on 18)

The wearable display apparatus of claim 18, wherein the gaze tracking system includes:
a complementary facing prism coupled to the prism adjacent the folding surface; and
a tracking sensor coupled to the complementary facing prism.

### Claim 20 (depends on 19)

The wearable display apparatus of claim 19, wherein the folding surface includes a dichroic surface treated to direct the sensing light to the beam splitter, the curved mirror, and to an iris of the viewer, such that sensing light returning from the iris retraces a light path to the prism and a portion of the returning sensing light is transmitted through the folding surface and be conveyed through the complementary facing prism to the tracking sensor.
