# US 2026/0086649 A1 · Positioning and controlling augments presented with augmented-reality glasses using sensor data indicating head position, eye gaze, and in-air hand gestures

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2026/0086649 A1
- Document ID: US20260086649A1
- Status: Published application
- Kind: A1
- Application number: 19/322,487
- Filed: 2025-09-08
- Published: 2026-03-26
- Earliest claimed: 2024-09-20
- Assignees: Meta Platforms Technologies, LLC
- Applicants: Meta Platforms Technologies, LLC
- Inventors: Brian John Mc Laughlin; Brandon Malicoat; Paul Martin
- Web page: https://patentgrep.com/patent/US20260086649A1

## CPC

- G06F 3/017: {Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883)}
- G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)}
- G06F 3/012: {Head tracking input arrangements}
- G06F 3/013: {Eye tracking input arrangements (G06F3/015 takes precedence)}
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

An example non-transitory, computer-readable storage medium comprises instructions that, when executed by one or more processors communicatively coupled with an augmented-reality headset, cause the one or more processors to perform operations that include causing display of an augment in an augmented-reality environment presented at the augmented-reality headset. The instructions further include that in response to receiving information identifying head movements of a wearer of the augmented-reality headset, causing positional adjustments of the augment within the augmented-reality environment in accordance with the head movement of the wearer, and initiating selection of another augment based on an eye gaze of the wearer detected based on sensor information from the augmented-reality headset. The instructions further include that after initiating the selection of the other augment: in response to receiving information indicating an in-air hand gesture from the wearer, performing an action on the other augment.

## Claims

### Claim 1

A non-transitory, computer-readable storage medium including executable instructions that, when executed by one or more processors, cause the one or more processors to:
cause display of an augment in an augmented-reality environment presented at the augmented-reality headset;
in response to receiving information identifying head movements of a wearer of the augmented-reality headset, cause positional adjustments of the augment within the augmented-reality environment in accordance with the head movement of the wearer;
initiate selection of another augment based on an eye gaze of the wearer detected based on sensor information from the augmented-reality headset; and
after initiating the selection of the other augment:
in response to receiving information indicating an in-air hand gesture from the wearer, cause performance of an action on the other augment.

### Claim 2 (depends on 1)

The non-transitory, computer-readable storage medium of claim 1, wherein the selection of the other augment includes changing a virtual presentation of the other augment.

### Claim 3 (depends on 2)

The non-transitory computer-readable storage medium of claim 2, wherein changing the virtual presentation of the other augment includes placing a bounding box around the other augment.

### Claim 4 (depends on 1)

The non-transitory computer-readable storage medium of claim 1, wherein the positional adjustments of the augment occur along at least two axes of the augmented-reality environment.

### Claim 5 (depends on 1)

The non-transitory computer-readable storage medium of claim 1, wherein the executable instructions further cause the one or more processors to:
initiate selection of yet another augment based on an eye gaze of the wearer detected based on sensor information from the augmented-reality headset; and
after initiating the selection of the yet other augment:
in response to receiving information indicating another in-air hand gesture from the wearer, cause performance of another action on the yet another augment.

### Claim 6 (depends on 5)

The non-transitory computer-readable storage unit of claim 5, wherein the yet another augment is different than the other augment, and the yet another augment has different properties than the other augment.

### Claim 7 (depends on 1)

The non-transitory computer-readable storage medium of claim 1, wherein the action includes removing the other augment from display in the augmented-reality environment.

### Claim 8 (depends on 1)

The non-transitory computer-readable storage medium of claim 1, wherein the augmented-reality environment is an augmented-reality game environment.

### Claim 9 (depends on 8)

The non-transitory computer-readable storage medium of claim 8, the augment is a game object associated with the wearer of the augmented-reality headset and the other augment is another game object associated with a game mechanic.

### Claim 10 (depends on 1)

The non-transitory computer-readable storage unit of claim 1, wherein the augmented-reality environment includes a performance metric associated with the augment.

### Claim 11 (depends on 1)

The non-transitory computer-readable storage medium of claim 1, wherein the executable instructions further cause the one or more processors to:
in response to receiving information indicating a different in-air hand gesture from the wearer, cause performance of a different action on the other augment.

### Claim 12 (depends on 1)

The non-transitory computer-readable storage medium of claim 1, wherein the executable instructions further cause the one or more processors to:
in response to receiving additional information identifying another head movement of the wearer of the augmented-reality headset, cause another positional adjustment of the augment within the augmented-reality environment in accordance with the other head movement of the wearer.

### Claim 13 (depends on 1)

The non-transitory computer-readable storage unit of claim 1, wherein the in-air hand gesture is a pinch gesture.

### Claim 14 (depends on 1)

The non-transitory computer-readable storage unit of claim 1, wherein performing the action on the other augment includes an animation indicating the other object is removed.

### Claim 15

A method comprising:
displaying an augment in an augmented-reality environment presented at the augmented-reality headset;
in response to receiving information identifying head movements of a wearer of the augmented-reality headset, causing positional adjustments of the augment within the augmented-reality environment in accordance with the head movement of the wearer;
initiating selection of another augment based on an eye gaze of the wearer detected based on sensor information from the augmented-reality headset; and
after initiating the selection of the other augment:
in response to receiving information indicating an in-air hand gesture from the wearer, performing an action on the other augment.

### Claim 16 (depends on 15)

The method of claim 15, further comprising:
in response to receiving information indicating a different in-air hand gesture from the wearer, performing a different action on the other augment.

### Claim 17 (depends on 15)

The method of claim 15, further comprising:
in response to receiving additional information identifying another head movement of the wearer of the augmented-reality headset, causing another positional adjustment of the augment within the augmented-reality environment in accordance with the other head movement of the wearer.

### Claim 18

A head-wearable device including a display and a gaze-tracker module, the head-wearable device configured to:
display an augment in an augmented-reality environment presented at the display;
in response to receiving information identifying head movements of a wearer of the head-wearable device, cause positional adjustments of the augment within the augmented-reality environment in accordance with the head movement of the wearer;
initiate selection of another augment based on an eye gaze of the wearer detected based on sensor information from the gaze tracker module; and
after initiating the selection of the other augment:
in response to receiving information indicating an in-air hand gesture from the wearer, cause performance of an action on the other augment.

### Claim 19 (depends on 18)

The head-wearable device of claim 18, further configured to:
in response to receiving information indicating a different in-air hand gesture from the wearer, cause performance of a different action on the other augment.

### Claim 20 (depends on 18)

The head-wearable device of claim 18, further configured to:
in response to receiving additional information identifying another head movement of the wearer of the head-wearable device, cause another positional adjustment of the augment within the augmented-reality environment in accordance with the other head movement of the wearer.
