Combined Activation for Natural User Interface Systems
AssigneeMicrosoft Corporation
InventorsLarry Paul Heck, Madhusudan Chinthakunta, David Mitby, Lisa Stifelman
Life of this patent
Estimating the term…
Abstract
A user interaction activation may be provided. A plurality of signals received from a user may be evaluated to determine whether the plurality of signals are associated with a visual display. If so, the plurality of signals may be translated into an agent action and a context associated with the visual display may be retrieved. The agent action may be performed according to the retrieved context and a result associated with the performed agent action may be displayed to the user.
Claims20
A method for providing a user-interaction activation, the method comprising:
- receiving a plurality of signals from a user;
- determining whether the plurality of signals are associated with a visual display;
- and
- in response to determining that the plurality of signals are associated with the visual display:
- translating the plurality of signals into an agent action,
- retrieving a context associated with the visual display,
- performing the agent action according to the retrieved context, and
- displaying a result associated with the performed agent action to the user.
A computer-readable medium which stores a set of instructions which when executed performs a method for providing a user-interaction activation, the method executed by the set of instructions comprising:
- receiving a request from a user, wherein the request comprises a speech signal;
- retrieving a context associated with a visual display;
- identifying a gesture received from the user;
- performing an action associated with the request according to the retrieved context and the identified gesture;
- and
- providing a result associated with the performed action to the user.
A system for providing a user-interaction activation, the system comprising:
- at least one camera;
- a memory storage;
- and
- a processing unit coupled to the memory storage and the camera, wherein the processing unit is operative to:
- receive a plurality of contemporaneous signals from a user, wherein at least one first signal comprises a speech signal received via at least one microphone and at least one second signal comprises a gesture received via the at least one camera,
- determine whether the plurality of signals are directed to the system, and
- in response to determining that the plurality of signals are directed to the system:
- retrieve a context associated with a visual display;
- translate the plurality of signals into at least one agent action associated with the visual display, wherein the gesture comprises a pointing gesture operative to select a subset of the visual display;
- perform the agent action according to the retrieved context and the gesture;
- and
- display a result associated with the performed agent action to the user.
Dependencies are inferred from the claim text.