# US 2021/0063734 A1 · Optical adjustment for head-mountable device

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0063734 A1
- Document ID: US20210063734A1
- Status: Published application
- Kind: A1
- Application number: 16/938,770
- Filed: 2020-07-24
- Published: 2021-03-04
- Earliest claimed: 2019-08-29
- Assignees: Apple Inc.
- Applicants: Apple Inc.
- Inventors: Ivan S. MARIC; Jan K. QUIJALVO
- Web page: https://patentgrep.com/patent/US20210063734A1

## CPC

- G02B 27/0093: {with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking}
- G06F 3/013: {Eye tracking input arrangements (G06F3/015 takes precedence)}
- G01P 15/00: Measuring acceleration; Measuring deceleration; Measuring shock, i.e. sudden change of acceleration
- G02B 27/0101: {characterised by optical features (G02B27/0172 takes precedence)}
- G02B 27/0172: {characterised by optical features}
- G02B 27/0176: {characterised by mechanical features}
- G02B 27/0179: {Display position adjusting means not related to the information to be displayed}
- G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)}
- G02B 2027/0138: {comprising image capture systems, e.g. camera}
- G02B 2027/0187: {slaved to motion of at least a part of the body of the user, e.g. head, eye}
- G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G01P: MEASURING LINEAR OR ANGULAR SPEED, ACCELERATION, DECELERATION, OR SHOCK; INDICATING PRESENCE, ABSENCE, OR DIRECTION, OF MOVEMENT (measuring or recording blood flow A61B5/02, A61B8/06; monitoring speed or deceleration of electrically-propelled vehicles B60L3/00; vehicle lighting systems adapted to indicate speed B60Q1/54; determining position or course in navigation, measuring ground distance in geodesy or surveying G01C; combined measuring devices for measuring two or more variables of movement G01C23/00; measuring velocity of sound G01H; measuring velocity of light G01J7/00; measuring direction or velocity of solid objects by reception or emission of radiowaves or other waves and based on propagation effects, e.g. Doppler effect, propagation time, direction of propagation, G01S; measuring speed of nuclear radiation G01T; measuring acceleration of gravity G01V; {measuring or recording the speed of trains B61L23/00; speed indicators incorporated in motor vehicles B60K35/00; measuring frequency or phase G01R; traffic control G08G})

## Abstract

A head-mountable device can include an optical module that provides a display element and/or an optical element that are adjustably mounted. The display element and/or another optical element can be adjusted by actuation of a mechanism that allows the display element and/or the optical element to move in one or more (e.g., six) degrees of freedom (roll, pitch, and yaw). The actuation allows for the position of the display element to be adjusted relative to the optical element to correct for any displacements caused during operation of the head-mountable device. One or more sensors within the optical module or external to the optical module and/or the head-mountable device can detect the position of the display at an initial state as well as thereafter. The sensors can check for changes in the position of the components to provide a basis for the actuation.

## Claims

### Claim 1

A head-mountable device comprising:
a frame; and
a pair of optical modules, each of the optical modules being movable relative to the frame and comprising:
a housing;
a display element within the housing; and
an optical element providing a view to the display element from outside the housing;
a display sensor within the housing and configured to detect an alignment of the display element relative to the housing; and
an actuator configured to move the display element relative to the housing based on the alignment detected by the display sensor.

### Claim 2 (depends on 1)

The head-mountable device of claim 1, wherein the actuator couples the display element to the housing.

### Claim 3 (depends on 1)

The head-mountable device of claim 1, wherein the actuator is operable to adjust an orientation of the display element relative to the optical element.

### Claim 4 (depends on 1)

The head-mountable device of claim 1, wherein the actuator is operable to adjust a position of the display element relative to the optical element.

### Claim 5 (depends on 1)

The head-mountable device of claim 1, wherein each of the optical modules further comprises markers coupled to the display element, wherein the display sensor is configured to determine a position of each of the markers within the housing.

### Claim 6 (depends on 1)

The head-mountable device of claim 1, wherein each of the optical modules further comprises:
an additional sensor configured to detect an alignment of the optical element relative to the housing; and
an additional actuator configured to move the optical element relative to the housing based on the alignment detected by the additional sensor.

### Claim 7 (depends on 1)

The head-mountable device of claim 1, wherein each of the optical modules is positioned on an inner side of the frame, the head-mountable device further comprising cameras on an outer side of the frame, each of the cameras being movable with a corresponding one of the optical modules.

### Claim 8

A head-mountable device comprising:
an optical module comprising:
a housing;
a display element within the housing;
an optical element providing a view to the display element along an optical pathway;
a display sensor within the housing and configured to detect an alignment of the display element with respect to the optical element; and
an actuator configured to move the display element relative to the housing;
and
a controller configured to perform the operations of:
operating the display sensor to determine a detected alignment of the display element;
comparing the detected alignment to a target alignment of the display element; and
based on the detected alignment and the target alignment, operating the actuator.

### Claim 9 (depends on 8)

The head-mountable device of claim 8, wherein the optical module is a first optical module and the head-mountable device further comprises a second optical module, wherein each of the first optical module and the second optical module are moveable relative to a frame of the head-mountable device to align with a corresponding one of a user's eyes.

### Claim 10 (depends on 8)

The head-mountable device of claim 8, further comprising markers coupled to the display element, wherein the display sensor is configured to determine a position of each of the markers within the housing.

### Claim 11 (depends on 8)

The head-mountable device of claim 8, wherein:
the controller is further configured to operate the display element to output a known image;
operating the display sensor to determine a detected alignment of the display element comprises capturing a detected image of the display element; and
comparing the detected alignment to the target alignment of the display element comprises comparing the detected image to a target image that is based on the known image.

### Claim 12 (depends on 8)

The head-mountable device of claim 8, wherein the target alignment is defined by the operation of, prior to operating the display sensor to determine a detected alignment of the display element, operating the display sensor to determine a target alignment of the display element.

### Claim 13 (depends on 8)

The head-mountable device of claim 8, wherein the controller is further configured to perform the operation of detecting a shock to the head-mountable device, wherein operating the display sensor to determine a detected alignment of the display element is in response to detecting the shock.

### Claim 14 (depends on 8)

The head-mountable device of claim 8, further comprising:
an additional sensor configured to detect an alignment of the optical element relative to the housing; and
an additional actuator configured to move the optical element relative to the housing based on the alignment detected by the additional sensor.

### Claim 15

A head-mountable device comprising:
an optical module comprising:
a housing;
a display element within the housing;
an optical element providing a view to the display element along an optical pathway; and
an actuator configured to move the display element relative to the housing;
and
a controller configured to:
receive from an external device an indication of a detected alignment of the display element;
compare the detected alignment to a target alignment of the display element; and
based on the detected alignment and the target alignment, operate the actuator.

### Claim 16 (depends on 15)

The head-mountable device of claim 15, wherein the optical module is a first optical module and the head-mountable device further comprises a second optical module, wherein each of the first optical module and the second optical module are moveable relative to a frame of the head-mountable device to align with a corresponding one of a user's eyes.

### Claim 17 (depends on 15)

The head-mountable device of claim 15, wherein:
the controller is further configured to operate the display element to output a known image;
the indication of the detected alignment of the display element is based on a detected image from a view of the display element captured by an external sensor of the external device; and
comparing the detected alignment to the target alignment of the display element comprises comparing the detected image to a target image that is based on the known image.

### Claim 18 (depends on 15)

The head-mountable device of claim 15, wherein the target alignment is defined by the operation of, prior to receiving from the external device the indication of the detected alignment of the display element, receiving from the external device an indication of a target alignment of the display element.

### Claim 19 (depends on 15)

The head-mountable device of claim 15, further comprising a first dock that is configured to engage a second dock of the external device to couple the head-mountable device to the external device in a known position and orientation with respect to the external device.

### Claim 20 (depends on 15)

The head-mountable device of claim 15, further comprising:
an additional actuator configured to move the optical element relative to the housing based on an additional detection performed by the external device.
