# US 2026/0073647 A1 · Designing and optimizing adaptive shortcuts for extended reality

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2026/0073647 A1
- Document ID: US20260073647A1
- Status: Published application
- Kind: A1
- Application number: 19/322,512
- Filed: 2025-09-08
- Published: 2026-03-12
- Earliest claimed: 2022-10-28
- Assignees: Meta Platforms Technologies, LLC
- Applicants: Meta Platforms Technologies, LLC
- Inventors: Tanya Renee Jonker; Kashyap Todi; Joao Marcelo Evangelista Belo; Felix Izarra
- Web page: https://patentgrep.com/patent/US20260073647A1

## CPC

- G06F 3/013: {Eye tracking input arrangements (G06F3/015 takes precedence)}
- G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)}
- G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)}
- G06T 2200/24: involving graphical user interfaces [GUIs]
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

Disclosed herein is an extended reality system, and associated techniques, whereby personalized usage data of a user in one or more extended reality environments over a period of time can be collected and provided to a predictive model to determine optimal shortcut assignments for presentation to and subsequent use by the user. Determining the optimal shortcut assignments can involve estimating a plurality of interaction times for the user in the one or more extended reality environments, generating an optimized graphical user interface within the one or more extended reality environments with the optimal shortcut assignments reflected in the optimized graphical user interface, and rendering the optimized graphical user interface in the one or more extended reality environments to the user. The system may collect additional personalized usage data and periodically update the optimal shortcut assignments based on ongoing use of the system by the user.

## Claims

### Claim 1

An extended reality system comprising:
an extended reality device designed to be worn by a user and having a display to display content to the user in one or more extended reality environments;
one or more sensors to capture input data including images of a visual field of the user;
one or more processors; and
one or more memories accessible to the one or more processors, the one or more memories storing a plurality of instructions that are executable by the one or more processors to cause the one or more processors to perform processing comprising:
collecting a first set of personalized usage data of the user in the one or more extended reality environments over a period of time;
providing the first set of personalized usage data to a predictive model;
based on the first set of personalized usage data, estimating, by the predictive model, a plurality of interaction times for the user in the one or more extended reality environments, wherein each interaction time is associated with a corresponding functionality that has been used by the user over the period of time;
determining, by the predictive model, optimal shortcut assignments based on the first set of personalized usage data and the plurality of interaction times, wherein the optimal shortcut assignments assign shortcuts to execute functionalities in the one or more extended reality environments;
generating, by the predictive model, an optimized graphical user interface in the one or more extended reality environments, the optimal shortcut assignments reflected in the optimized graphical user interface; and
rendering the optimized graphical user interface in the one or more extended reality environments to the user.
