Techniques for identifying graphical elements displayed at a head-worn device based on an eye gesture and a motional gesture
AssigneeMeta Platforms Technologies, LLC
InventorsSebastian Sztuk, Salvael Ortega Estrada
Life of this patent
Estimating the term…
Abstract
A method for managing a user interface in a smart glass is provided. The method includes identifying an eye gesture of the user of the smart glass, based on an eye-tracking signal indicative of a pupil location of the user, assessing a user intention for an application displayed in a user interface in the headset based on the eye gesture, and activating the application based on the user intention. A smart glass for use with the above method is also provided.
Claims21
(canceled)
A method comprising:
- while a user is wearing a wrist-worn device and a head-worn device comprising (1) a first eyepiece with a display and (2) one or more cameras:
- receiving, from the wrist-worn device, an indication of a motional gesture performed by the user;
- obtaining image data from the one or more cameras;
- identifying an object from the image data;
- determining, based on the indication of the motional gesture and the object, a user intention to interact with an interface displayed on the head-worn device, wherein the interface is associated with an application;
- activating, based on the user intention, a function of the application;
- and
- displaying, on the interface, information associated with the object on the display of the first eyepiece.
A non-transitory, computer-readable storage medium including executable instruction that, when executed by one or more processors, cause the one or more processors to:
- while a user is wearing a wrist-worn device and a head-worn device comprising (1) a first eyepiece with a display and (2) one or more cameras:
- receive, from the wrist-worn device, an indication of a motional gesture performed by the user;
- obtain image data from the one or more cameras;
- identify an object from the image data;
- determine, based on the indication of the motional gesture and the object, a user intention to interact with an interface displayed on the head-worn device, wherein the interface is associated with an application;
- cause a function of the application to be activated based on the user intention;
- and
- cause information associated with the object to be displayed on the interface at the display of the first eyepiece.
A system comprising:
- wrist-worn device;
- and
- a head-worn device comprising (1) a first eyepiece with a display and (2) one or more cameras, wherein the system is configured to:
- while a user is wearing the wrist-worn device and the head-worn device:
- receive, from the wrist-worn device, an indication of a motional gesture performed by the user;
- obtain image data from the one or more cameras;
- identify an object from the image data;
- determine, based on the indication of the motional gesture and the object, a user intention to interact with an interface displayed on the head-worn device, wherein the interface is associated with an application;
- activate, based on the user intention, a function of the application;
- and
- display, on the interface, information associated with the object on the display of the first eyepiece.
Dependencies are inferred from the claim text.