# US 2022/0276702 A1 · Movement detection of a head mounted device

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2022/0276702 A1
- Document ID: US20220276702A1
- Status: Published application
- Kind: A1
- Application number: 17/249,393
- Filed: 2021-03-01
- Published: 2022-09-01
- Earliest claimed: 2021-03-01
- Assignees: QUALCOMM Incorporated
- Applicants: QUALCOMM Incorporated
- Inventors: Khurshid Syed ALAM; Russell GRUHLKE
- Web page: https://patentgrep.com/patent/US20220276702A1

## CPC

- G02B 27/017: {Head mounted}
- G06F 3/013: {Eye tracking input arrangements (G06F3/015 takes precedence)}
- G02B 6/0068: {Arrangements of plural sources, e.g. multi-colour light sources}
- G02B 27/0093: {with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking}
- G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)}
- G06T 7/248: {involving reference images or patches}
- G02B 2027/0138: {comprising image capture systems, e.g. camera}
- G02B 2027/014: {comprising information/image processing systems}
- G02B 2027/0187: {slaved to motion of at least a part of the body of the user, e.g. head, eye}
- G06T 2207/30201: Face
- G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

In some aspects, a head mounted device may include an eye portion configured to face an eye of a user wearing the head mounted device, where the eye portion includes a display. The head mounted device may include at least one light emitter configured to emit light for illuminating at least a portion of a nose of the user. The head mounted device may include at least one image sensor configured to capture an image of at least a portion of the nose of the user for use in determining a shift or a rotation of the head mounted device relative to the user. Numerous other aspects are provided.

## Claims

### Claim 1

A head mounted device, comprising:
an eye portion configured to face an eye of a user wearing the head mounted device,
wherein the eye portion includes a display;
at least one light emitter configured to emit light for illuminating at least a portion of a nose of the user; and
at least one image sensor configured to capture an image of at least a portion of the nose of the user for use in determining a shift or a rotation of the head mounted device relative to the user.

### Claim 2 (depends on 1)

The head mounted device of claim 1, further comprising:
a light guide optically coupled to the at least one light emitter and configured to direct light from the at least one light emitter, at a position away from the portion of the nose, to the portion of the nose.

### Claim 3 (depends on 1)

The head mounted device of claim 1, further comprising:
a light guide optically coupled to the at least one image sensor and configured to direct light from the portion of the nose to the at least one image sensor at a position away from the portion of the nose.

### Claim 4 (depends on 1)

The head mounted device of claim 1, wherein the eye portion is a first eye portion configured to face a first eye of the user, and
wherein the head mounted device further comprises:
a second eye portion configured to face a second eye of the user; and
a bridge portion between the first eye portion and the second eye portion.

### Claim 5 (depends on 4)

The head mounted device of claim 4, further comprising:
a light guide at the bridge portion.

### Claim 6 (depends on 5)

The head mounted device of claim 5, wherein the at least one light emitter and the at least one image sensor are in optical communication with a first end of the light guide, and
wherein a second end of the light guide is configured for optical communication with the nose of the user.

### Claim 7 (depends on 5)

The head mounted device of claim 5, wherein the at least one light emitter is in optical communication with a first end of the light guide,
wherein a second end of the light guide is configured for optical communication with the nose of the user, and
wherein the at least one image sensor is configured for direct optical communication with the nose of the user.

### Claim 8 (depends on 4)

The head mounted device of claim 4, further comprising:
a first light guide at the bridge portion; and
a second light guide at the bridge portion.

### Claim 9 (depends on 8)

The head mounted device of claim 8, wherein the at least one light emitter is in optical communication with a first end of the first light guide, and the at least one image sensor is in optical communication with a first end of the second light guide, and
wherein a second end of the first light guide is configured for optical communication with the nose of the user, and a second end of the second light guide is configured for optical communication with the nose of the user.

### Claim 10 (depends on 4)

The head mounted device of claim 4, wherein the at least one image sensor is positioned at a nose-facing side of the bridge portion.

### Claim 11 (depends on 1)

The head mounted device of claim 1, wherein the at least one light emitter comprises a light emitting diode configured to output red light or near infrared light.

### Claim 12 (depends on 1)

The head mounted device of claim 1, further comprising:
one or more processors configured to determine, based at least in part on the image captured by the image sensor, the shift or the rotation of the head mounted device relative to the user.

### Claim 13

A system, comprising:
a light emitter configured to emit light for illuminating at least a portion of a nose of a user wearing a head mounted device;
an image sensor configured to capture an image of at least a portion of the nose of the user;
a memory; and
one or more processors coupled to the memory, the memory and the one or more processors configured to:
determine a shift or a rotation of the head mounted device relative to the user based at least in part on the image.

### Claim 14 (depends on 13)

The system of claim 13, wherein the light emitter and the image sensor are positioned at a bridge portion of the head mounted device that is positioned between a first eye portion of the head mounted device and a second eye portion of the head mounted device.

### Claim 15 (depends on 13)

The system of claim 13, further comprising:
at least one light guide configured to provide optical communication between the nose of the user and at least one of the light emitter or the image sensor.

### Claim 16 (depends on 15)

The system of claim 15, wherein the at least one light guide includes a beveled end.

### Claim 17 (depends on 15)

The system of claim 15, wherein the at least one light guide is configured to direct light from the light emitter to the nose of the user, collect light reflected from the nose of the user, and direct the reflected light to the image sensor.

### Claim 18 (depends on 15)

The system of claim 15, wherein the at least one light guide is configured to direct light from the light emitter to the nose of the user, and
wherein the image sensor is configured to directly detect light reflected from the nose of the user.

### Claim 19 (depends on 13)

The system of claim 13, wherein the memory and the one or more processors are further configured to:
adjust a calibration used for eye tracking of the user based at least in part on the shift or the rotation of the head mounted device.

### Claim 20

A method, comprising:
obtaining, from an image sensor of a head mounted device, a first image of at least a portion of a nose of a user wearing the head mounted device;
obtaining, from the image sensor of the head mounted device, a second image of at least a portion of the nose of the user;
determining, based at least in part on the first image and the second image, a shift or a rotation of the head mounted device relative to the user; and
adjusting a calibration used for eye tracking of the user based at least in part on the shift or the rotation of the head mounted device.

### Claim 21 (depends on 20)

The method of claim 20, wherein determining the shift or the rotation of the head mounted device comprises:
determining a shift of one or more pixels in the second image relative to the first image.

### Claim 22 (depends on 21)

The method of claim 21, wherein the one or more pixels depict at least one of dermal features of the nose or subdermal features of the nose.

### Claim 23 (depends on 20)

The method of claim 20, further comprising:
performing eye tracking of the user based at least in part on the adjusted calibration; and
adjusting a content of a display of the head mounted device based at least in part on performing eye tracking.

### Claim 24 (depends on 20)

The method of claim 20, wherein the first image and the second image are obtained by the image sensor based at least in part on an illumination of at least a portion of the nose of the user by a light emitter.

### Claim 25 (depends on 20)

The method of claim 20, wherein the shift or the rotation of the head mounted device is relative to the nose of the user.

### Claim 26

A non-transitory computer-readable medium storing a set of instructions, the set of instructions comprising:
one or more instructions that, when executed by one or more processors of a head mounted device, cause the head mounted device to:
monitor, using an image sensor, at least a portion of a nose of a user wearing the head mounted device;
determine, based at least in part on monitoring the nose of the user, a shift or a rotation of the head mounted device relative to the user; and
adjust a calibration used for eye tracking of the user based at least in part on the shift or the rotation of the head mounted device.

### Claim 27 (depends on 26)

The non-transitory computer-readable medium of claim 26, wherein the one or more instructions, when executed by the one or more processors of the head mounted device, further cause the head mounted device to:
output light, from a light emitter, toward the nose of the user.

### Claim 28 (depends on 26)

The non-transitory computer-readable medium of claim 26, wherein the one or more instructions, that cause the head mounted device to monitor the nose of the user, cause the head mounted device to:
obtain images of at least a portion of the nose of the user using the image sensor.

### Claim 29 (depends on 26)

The non-transitory computer-readable medium of claim 26, wherein the one or more instructions, that cause the head mounted device to determine the shift or the rotation of the head mounted device, cause the head mounted device to:
determine a shift of one or more pixels in images of at least a portion of the nose of the user obtained by the image sensor.

### Claim 30 (depends on 26)

The non-transitory computer-readable medium of claim 26, wherein the one or more instructions, when executed by the one or more processors of the head mounted device, further cause the head mounted device to:
perform eye tracking of the user based at least in part on the adjusted calibration.
