Multi-modal inputs for voice commands
AssigneeApple Inc.
InventorsPhilippe P. Piernot, Garrett L. Weinberg
Life of this patent
Estimating the term…
Abstract
Systems and processes for operating an intelligent automated assistant are provided. In one example process, a first input including activation of an affordance is received. A domain associated with the affordance is determined. A second input including user speech is received, where a user intent is determined based on the domain and the user speech. A determination is made whether the user intent includes a command associated with the affordance. In accordance with a determination that the user intent includes a command associated with the affordance, a task in furtherance of the command is performed.
Claims42
An electronic device, comprising:
- one or more processors;
- a memory;
- and
- one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for:
- detecting a user gaze including activation of a text input area;
- determining whether the activation of the text input area is associated with a predetermined input type;
- in accordance with a determination that the activation of the text input area is associated with a predetermined input type, sampling audio data;
- determining a text representation based on the sampled audio data;
- and
- providing, within the text input area, an output including the text representation.
A non-transitory computer-readable storage medium storing one or more programs, wherein the one or more programs are configured to be executed by one or more processors of an electronic device, the one or more programs including instructions for:
- detecting a user gaze including activation of a text input area;
- determining whether the activation of the text input area is associated with a predetermined input type;
- in accordance with a determination that the activation of the text input area is associated with a predetermined input type, sampling audio data;
- determining a text representation based on the sampled audio data;
- and
- providing, within the text input area, an output including the text representation.
A computer-implemented method, comprising:
- at an electronic device with one or more processors and memory:
- detecting a user gaze including activation of a text input area;
- determining whether the activation of the text input area is associated with a predetermined input type;
- in accordance with a determination that the activation of the text input area is associated with a predetermined input type, sampling audio data;
- determining a text representation based on the sampled audio data;
- and
- providing, within the text input area, an output including the text representation.
Dependencies are inferred from the claim text.