AR glasses with event and user action control of external applications
AssigneeMicrosoft Technology Licensing, LLC
InventorsRalph F. Osterhout, John D. Haddick, Robert Michael Lohse, Charles Cella, Robert J. Nortrup, Edward H. Nortrup
Life of this patent
Estimating the term…
Abstract
This disclosure concerns an interactive head-mounted eyepiece with an integrated processor for handling content for display and an integrated image source for introducing the content to an optical assembly through which the user views a surrounding environment and the displayed content, wherein the eyepiece includes event and user action control of external applications.
Claims20
A system comprising:
- an interactive head-mounted device including an optical assembly configured to display virtual content and to enable viewing of at least a portion of a surrounding environment, an integrated processor for processing the virtual content for display, and an integrated image source for introducing the virtual content to the optical assembly;
- a communications facility configured to connect the interactive head-mounted device to an external device;
- and
- a user action capture device configured to detect a user action as input;
- wherein the interactive head-mounted device is configured to detect, via a sensor of the interactive head-mounted device and independently of user input, a target that indicates that instructions are available to the user, and in response enable a command and control scheme for command and control of an external application resident on the external device, and
- wherein the command and control scheme is configured to use user actions captured by the user action capture device as input to the external application, to send a request for the instructions to the external application in response to the user actions captured by the user action capture device, and to present the instructions to a user of the interactive head-mounted device responsive to the external application sending the instructions.
A system comprising:
- an interactive head-mounted device including an optical assembly configured to display virtual content and to enable viewing of at least a portion of a surrounding environment, an integrated processor for processing the virtual content for display, and an integrated image source for introducing the virtual content to the optical assembly;
- a communications facility configured to connect the interactive head-mounted device to an external device;
- and
- a user action capture device configured to detect a user action as input;
- wherein the interactive head-mounted device is configured to enable a command and control scheme for command and control of an external application resident on the external device when a target that indicates that instructions are available to the user is detected by a sensor of the interactive head-mounted device independently of user input, and
- wherein the command and control scheme is configured to use user actions captured by the user action capture device as input to the external payment application, to send a request for the instructions to the external application in response to the user actions captured by the user action capture device, and to present the instructions to a user of the interactive head-mounted device responsive to the external application sending the instructions.
On a head-mounted display device including an optical assembly through which a surrounding environment and displayed content are viewable, an integrated processor for handling content for display to a user, an integrated image source for introducing the content to the optical assembly, a communications facility configured to connect an external device to the interactive head-mounted display device, a sensor configured to detect an event or condition, and a user action capture device configured to detect a user action as input, a method comprising:
- detecting, via data from the sensor and independently of user input, a target in the surrounding environment that indicates that instructions are available to the user;
- connecting to the external device via the communications facility;
- in response to detecting the target, activating a command and control scheme for command and control of an external application resident on the external device;
- detecting a user action via the user action capture device;
- translating the user action into input to the external application;
- sending a request to the external application for the instructions;
- receiving instructions from the external application in response to the input;
- and
- presenting the instructions on the optical assembly.
Dependencies are inferred from the claim text.