Speech-based interaction with a display window
AssigneeBanma Zhixing Network (Hongkong) Co., Limited
InventorShanwen Shi
Life of this patent
Estimating the term…
Abstract
Speech-based interaction with a display window is disclosed, including: receiving speech input with respect to a display window that is presented at a device; converting the speech input into an operation instruction; determining an interface element of the display window that corresponds to the operation instructions, including by querying interface element information corresponding to the display window; and activating the interface element of the display window based at least in part on simulating a manual selection event with respect to the interface element of the display window.
Claims20
A device, comprising:
- one or more processors configured to:
- receive, at the device, speech input with respect to a display window that is presented at the device;
- convert the speech input into an operation instruction;
- determine an interface element of the display window that corresponds to the operation instructions, including by querying interface element information corresponding to the display window;
- and
- activate the interface element of the display window based at least in part on simulating a manual selection event with respect to the interface element of the display window;
- and
- one or more memories coupled to the one or more processors and configured to provide the one or more processors with instructions.
A method, comprising:
- receiving speech input with respect to a display window that is presented at a device;
- converting the speech input into an operation instruction;
- determining an interface element of the display window that corresponds to the operation instructions, including by querying interface element information corresponding to the display window;
- and
- activating the interface element of the display window based at least in part on simulating a manual selection event with respect to the interface element of the display window.
A computer program product, the computer program product being embodiment in a non-transitory transitory computer readable storage medium and comprising computer instructions for:
- receiving speech input with respect to a display window that is presented at a device;
- converting the speech input into an operation instruction;
- determining an interface element of the display window that corresponds to the operation instructions, including by querying interface element information corresponding to the display window;
- and
- activating the interface element of the display window based at least in part on simulating a manual selection event with respect to the interface element of the display window.
Dependencies are inferred from the claim text.