# US 2025/0085534 A1 · Display systems and methods for determining registration between a display and a user's eyes

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0085534 A1
- Document ID: US20250085534A1
- Status: Published application
- Kind: A1
- Application number: 18/962,659
- Filed: 2024-11-27
- Published: 2025-03-13
- Earliest claimed: 2018-01-17
- Assignees: Magic Leap, Inc.
- Applicants: Magic Leap, Inc.
- Inventors: Lionel Ernest EDWIN; Zachary C. NIENSTEDT; Ivan Li Chuen YEOH; Samuel A. MILLER; Yan XU; Jordan Alexander CAZAMIAS
- Web page: https://patentgrep.com/patent/US20250085534A1

## CPC

- G02B 27/0081: {with means for altering, e.g. enlarging, the entrance or exit pupil}
- A61B 3/111: {for measuring interpupillary distance}
- A61B 3/113: for determining or recording eye movement
- G02B 27/0093: {with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking}
- G02B 27/0172: {characterised by optical features}
- G02B 27/0176: {characterised by mechanical features}
- G02B 30/00: Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images (in microscopes G02B21/22)
- G02B 30/40: giving the observer of a single two-dimensional [2D] image a perception of depth
- G06F 1/163: {Wearable computers, e.g. on a belt}
- G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)}
- G06F 3/012: {Head tracking input arrangements}
- G06F 3/013: {Eye tracking input arrangements (G06F3/015 takes precedence)}
- G06F 3/017: {Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883)}
- G06F 3/0346: with detection of the device orientation or free movement in a three-dimensional [3D] space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
- G06F 3/04815: Interaction with a metaphor-based environment or interaction object displayed as three-dimensional [3D], e.g. changing the user viewpoint with respect to the environment or object
- G06F 3/16: Sound input; Sound output (speech processing G10L)
- G06F 3/167: {Audio in a user interface, e.g. using voice commands for navigating, audio feedback}
- G06V 40/193: {Preprocessing; Feature extraction}
- H04N 13/344: with head-mounted left-right displays
- H04N 13/383: for tracking with gaze detection, i.e. detecting the lines of sight of the viewer's eyes
- H04N 13/388: Volumetric displays, i.e. systems where the image is built up from picture elements distributed through a volume
- H04N 13/398: Synchronisation thereof; Control thereof
- G02B 2027/0134: {of stereoscopic type}
- G02B 2027/0138: {comprising image capture systems, e.g. camera}
- G02B 2027/0174: {holographic}
- G06T 3/40: Scaling of whole images or parts thereof, e.g. expanding or contracting
- G06V 10/42: Global feature extraction by analysis of the whole pattern, e.g. using frequency domain transformations or autocorrelation
- G06V 10/467: {Encoded features or binary features, e.g. local binary patterns [LBP]}
- G06V 10/60: relating to illumination properties, e.g. using a reflectance or lighting model
- G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D)
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

A display system may include a head-mounted display (HMD) for rendering a three-dimensional virtual object which appears to be located in an ambient environment of a user of the display. One or more eyes of the user may not be in desired positions, relative to the HMD, to receive, or register, image information outputted by the HMD and/or to view an external environment. For example, the HMD-to-eye alignment may vary for different users and/or may change over time (e.g., as the HMD is displaced). The display system may determine a relative position or alignment between the HMD and the user's eyes. Based on the relative positions, the wearable device may determine if it is properly fitted to the user, may provide feedback on the quality of the fit to the user, and/or may take actions to reduce or minimize effects of any misalignment.

## Claims

### Claim 1

A display system configured to project light to an eye of a user to display virtual image content, the display system comprising:
a frame configured to be supported on a head of the user;
a display disposed on the frame, the display configured to project light into the eye to display the virtual image content with different amounts of wavefront divergence to present the virtual image content appearing to be located at different depths while an external environment is viewable by the eye;
one or more eye-tracking cameras configured to image the eye; and
processing electronics in communication with the display and the one or more eye-tracking cameras, the processing electronics configured to:
determine a display registration volume relative to the display such that the virtual image content is received by the eye while the eye is situated within the display registration volume;
determine a housing registration volume relative to the frame such that an external field of view of the external environment proximal to the display is viewable by the eye while the eye is situated within the housing registration volume;
determine a combined registration volume that includes a plurality of points that are included in both the display registration volume and the housing registration volume;
determine a three-dimensional (3D) position of the eye based on one or more images of the eye obtained with the one or more eye-tracking cameras;
determine whether the position of the eye is within the combined registration volume; and
control operation of the display based on determining whether the position of the eye is within the combined registration volume.

### Claim 2 (depends on 1)

The display system of claim 1, wherein the combined registration volume includes all of the points that are included in both the display registration volume and the housing registration volume.

### Claim 3 (depends on 1)

The display system of claim 1, wherein the housing registration volume is defined relative to one or more housing openings in the frame.

### Claim 4 (depends on 3)

The display system of claim 3, wherein the housing registration volume has a cone-like shape with a base defined by the shape and size of the one or more housing openings.

### Claim 5 (depends on 1)

The display system of claim 1, wherein the position of the eye is a center of rotation of the eye.

### Claim 6 (depends on 1)

The display system of claim 1, wherein the display registration volume has a frustum shape.

### Claim 7 (depends on 1)

The display system of claim 1, wherein controlling operation of the display includes providing, to the user, a notification of misregistration based on determining that the position of the eye is not within the combined registration volume.

### Claim 8 (depends on 1)

The display system of claim 1, wherein controlling operation of the display includes providing, to the user, a notification of misregistration based on determining that the position of the eye is more than a threshold distance outside of the combined registration volume.

### Claim 9 (depends on 1)

The display system of claim 1, wherein the display registration volume is defined based at least partly on a type of application that is running on the display system.

### Claim 10

Computer-readable storage media storing instructions which, when executed by at least one processor, instruct the at least one processor to perform operations for controlling a wearable display configured to project light to an eye of a user to display virtual image content, the operations comprising:
determining a display registration volume relative to the display such that the virtual image content is received by the eye while the eye is situated within the display registration volume;
determining a housing registration volume relative to the frame such that an external field of view of an external environment proximal to the display is viewable by the eye while the eye is situated within the housing registration volume;
determining a combined registration volume that includes a plurality of points that are included in both the display registration volume and the housing registration volume;
determining a three-dimensional (3D) position of the eye based on one or more images of the eye obtained with one or more eye-tracking cameras configured to image the eye while the display is being worn by the user;
determining whether the position of the eye is within the combined registration volume; and
controlling operation of the display based on determining whether the position of the eye is within the combined registration volume.

### Claim 11

A computer-implemented method for controlling a wearable display configured to project light to an eye of a user to display virtual image content, the method comprising:
determining a display registration volume relative to the display such that the virtual image content is received by the eye while the eye is situated within the display registration volume;
determining a housing registration volume relative to the frame such that an external field of view of an external environment proximal to the display is viewable by the eye while the eye is situated within the housing registration volume;
determining a combined registration volume that includes a plurality of points that are included in both the display registration volume and the housing registration volume;
determining a three-dimensional (3D) position of the eye based on one or more images of the eye obtained with one or more eye-tracking cameras configured to image the eye while the display is being worn by the user;
determining whether the position of the eye is within the combined registration volume; and
controlling operation of the display based on determining whether the position of the eye is within the combined registration volume.

### Claim 12 (depends on 11)

The computer-implemented method of claim 11, wherein the combined registration volume includes all of the points that are included in both the display registration volume and the housing registration volume.

### Claim 13 (depends on 11)

The computer-implemented method of claim 11, wherein the housing registration volume is defined relative to one or more housing openings in the frame.

### Claim 14 (depends on 13)

The computer-implemented method of claim 13, wherein the housing registration volume has a cone-like shape with a base defined by the shape and size of the one or more housing openings.

### Claim 15 (depends on 11)

The computer-implemented method of claim 11, wherein the position of the eye is a center of rotation of the eye.

### Claim 16 (depends on 11)

The computer-implemented method of claim 11, wherein the display registration volume has a frustum shape.

### Claim 17 (depends on 11)

The computer-implemented method of claim 11, wherein controlling operation of the display includes providing, to the user, a notification of misregistration based on determining that the position of the eye is not within the combined registration volume.

### Claim 18 (depends on 11)

The computer-implemented method of claim 11, wherein controlling operation of the display includes providing, to the user, a notification of misregistration based on determining that the position of the eye is more than a threshold distance outside of the combined registration volume.

### Claim 19 (depends on 11)

The computer-implemented method of claim 11, wherein the display registration volume is defined based at least partly on a type of application associated with virtual content being presented through the display.
