Back to results
US 10,866,093 B2Granted
Method and system for retrieving data in response to user input
AssigneeMagic Leap, Inc.
InventorsRony Abovitz, Brian T. Schowengerdt, Matthew D. Watson
Life of this patent
Estimating the term…
Abstract
A method of retrieving data comprises receiving a user input in the form of a command, determining that the user input is a gesture, sending a request to a cloud server based on the determined gesture, receiving data from a knowledge base connected to the cloud server based on the request, and displaying virtual content at the user device based on the received data.
Claims16
A method of retrieving and presenting data, the method comprising:
- receiving a visual user input in the form of a gesture performed by a user;
- based at least partly on interpreting the gesture, sending a request to a cloud server in response to the interpreted gesture;
- receiving, from the cloud server, the data from a knowledge base connected to the cloud server, the data retrieved from the knowledge base by the cloud server in response to the request, the data including a navigation menu;
- receiving, from the cloud server, a set of map points associated with a position of a hand of the user;
- displaying a virtual user interface comprising the navigation menu using the set of map points, wherein the virtual user interface is displayed in real time at a position that corresponds to a current position of the hand as described by the set of map points;
- detecting a further gesture, the further gesture triggering an expansion of the plurality of first level menu items by spreading apart fingers of a hand, wherein the expansion of the plurality of first level menu items renders a plurality of second level menu items that appears on the finger of the user;
- recognizing, based on the detected further gesture, a second active command to create a second virtual user interface comprising the plurality of second level menu items such that the second virtual user interface, when viewed by the user, appears to be stationary at a second position of the hand;
- and
- rendering, in real-time and based on the detected further gesture, the second virtual user interface at the determined map points associated with the second position of the hand such that the plurality of first level menu items of the virtual user interface and the plurality of second level menu items of the second virtual user interface are simultaneously viewable on the finger of the user, the second level menu items being derived from the first level menu items as lower level menu items.
6 more elements
Dependencies are inferred from the claim text.