Techniques for identifying graphical elements displayed at a head-worn device based on an eye gesture and a motional gesture
AssigneeMeta Platforms Technologies, LLC
InventorsSebastian Sztuk, Salvael Ortega Estrada
Life of this patent
Estimating the term…
Abstract
A method for managing a user interface in a smart glass is provided. The method includes identifying an eye gesture of the user of the smart glass, based on an eye-tracking signal indicative of a pupil location of the user, assessing a user intention for an application displayed in a user interface in the headset based on the eye gesture, and activating the application based on the user intention. A smart glass for use with the above method is also provided.
Claims20
A method, comprising:
- providing information to cause a graphical user interface, of a head-worn device worn by a user, to be displayed on a display of the head-worn device;
- detecting an eye gesture performed by the user;
- identifying, in the graphical user interface displayed on the display of the head-worn device, a graphical element based at least in part upon the detected eye gesture;
- receiving, from a wearable device worn by the user, an indication of a motional gesture performed by the user outside of the graphical user interface, wherein the motional gesture, when performed, is associated with the graphical element and reproduced in the graphical user interface;
- and
- performing an action associated with the graphical element based at least in part upon the indication of the motional gesture performed by the user.
A system, comprising:
- one or more processors;
- and
- one or more memories storing instructions that, when executed by the one or more processors, cause the system to:
- provide information to cause a graphical user interface, of a head-worn device worn by a user, to be displayed on a display of the head-worn device;
- detect an eye gesture performed by the user;
- identify, in the graphical user interface displayed on the display of the head-worn device, a graphical element based at least in part upon the detected eye gesture;
- receive, from a wearable device worn by the user, an indication of a motional gesture performed by the user outside of the graphical user interface, wherein the motional gesture, when performed, is associated with the graphical element and reproduced in the graphical user interface;
- and
- perform an action associated with the graphical element based at least in part upon the indication of the motional gesture performed by the user.
A non-transitory computer-readable storage medium having instructions embodied thereon, wherein the instructions, when executed by one or more processors, cause a system to:
- provide information to cause a graphical user interface, of a head-worn device worn by a user, to be displayed on a display of the head-worn device;
- detect an eye gesture performed by the user;
- identify, in the graphical user interface displayed on the display of the head-worn device, a graphical element based at least in part upon the detected eye gesture;
- receive, from a wearable device worn by the user, an indication of a motional gesture performed by the user outside of the graphical user interface, wherein the motional gesture, when performed, is associated with the graphical element and reproduced in the graphical user interface;
- and
- perform an action associated with the graphical element based at least in part upon the indication of the motional gesture performed by the user.
Dependencies are inferred from the claim text.