# US 2019/0318736 A1 · Method for voice controlling, terminal device, cloud server and system

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0318736 A1
- Document ID: US20190318736A1
- Status: Published application
- Kind: A1
- Application number: 16/236,276
- Filed: 2018-12-28
- Published: 2019-10-17
- Earliest claimed: 2018-04-11
- Assignees: Baidu Online Network Technology (Beijing) Co., Ltd.
- Applicants: Baidu Online Network Technology (Beijing) Co., Ltd
- Inventors: LICHAO XU; YUSHU CAO; LISHANG XIAO; LIFENG ZHAO; XIANGDONG XUE; JI ZHOU
- Web page: https://patentgrep.com/patent/US20190318736A1

## CPC

- G10L 15/22: Procedures used during a speech recognition process, e.g. man-machine dialogue
- G06F 3/167: {Audio in a user interface, e.g. using voice commands for navigating, audio feedback}
- G10L 15/30: Distributed recognition, e.g. in client-server systems, for mobile phones or network applications
- G10L 2015/223: {Execution procedure of a spoken command}
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

The embodiment of the disclosure provides a method for voice controlling, a terminal device, a cloud server and a system. The method includes: receiving voice information that the user performs voice controlling on a terminal device; transmitting voice information to the cloud server, so that the cloud server determines, according to the voice information, a voice control and a control instruction that match the voice information in the current interface, and generates a corresponding voice control instruction; receiving the voice control instruction transmitted by the cloud server; and controlling, according to the voice control instruction, a corresponding voice control of the terminal device to perform an operation. The method of the embodiments of the present disclosure achieves controlling over the controls in the interface through the voice, which deepens the controlling degree of the voice over the terminal device, and improves the user experience.

## Claims

### Claim 1

A method for voice controlling, comprising:
receiving voice information, the voice information being used for a user to perform the voice controlling on a terminal device;
transmitting the voice information to a cloud server, so that the cloud server determines, according to the voice information, a voice control and a control instruction that match the voice information in a current interface to generate a corresponding voice control instruction;
receiving the voice control instruction transmitted by the cloud server;
controlling, according to the voice control instruction, a corresponding voice control of the terminal device to perform an operation.

### Claim 2 (depends on 1)

The method according to claim 1, wherein, before the transmitting the voice information to the cloud server, the method further comprises:
crawling information of voice controls in the current interface after an interface of the terminal device is changed;
transmitting the crawled information of all the voice controls in the current interface to the cloud server.

### Claim 3 (depends on 2)

The method according to claim 2, wherein, the crawling the information of the voice controls in the current interface comprises:
obtaining a control structure tree of the current interface, traversing the control structure tree, and obtaining information of the voice controls in the current interface; wherein the control structure tree comprises the information of all voice controls and information of all non-voice controls in the current interface.

### Claim 4 (depends on 1)

The method according to claim 1, wherein, the controlling, according to the voice control instruction, the corresponding voice control of the terminal device to perform the operation comprises:
determining, according to the voice control instruction, a voice control and a control instruction for performing the instruction, and triggering a corresponding control action.

### Claim 5 (depends on 1)

The method according to claim 1, wherein, the method further comprises:
receiving prompt information transmitted by the cloud server;
prompting the user correspondingly by means of a voice and/or a text, according to the prompt information.

### Claim 6

A method for voice controlling, comprising:
receiving voice information transmitted by a terminal device, the voice information being used to perform the voice controlling on the terminal device;
determining, according to the voice information, a voice control and a control instruction that match the voice information in a current interface to generate a corresponding voice control instruction;
transmitting the voice control instruction to the terminal device, so that the terminal device controls a corresponding voice control of the terminal device to perform an operation according to the voice control instruction.

### Claim 7 (depends on 6)

The method according to claim 6, wherein, before the receiving the voice information transmitted by the terminal device, the method further comprises:
receiving information of all voice controls in the current interface transmitted by the terminal device.

### Claim 8 (depends on 6)

The method according to claim 6 wherein, the method further comprises:
determining prompt information, according to the information of the voice control in the current interface;
transmitting the prompt information to the terminal device, so that the terminal device prompts the user correspondingly.

### Claim 9

A terminal device, comprising:
a first receiving module, configured to receive voice information, the voice information being used for a user to perform voice controlling on a terminal device;
a first transmitting module, configured to transmit the voice information to a cloud server, so that the cloud server determines, according to the voice information, a voice control and a control instruction that match the voice information in a current interface to generate a corresponding voice control instruction;
a second receiving module, configured to receive the voice control instruction transmitted by the cloud server;
a control module, configured to control, according to the voice control instruction, a corresponding voice control of the terminal device to perform an operation.

### Claim 10 (depends on 9)

The device according to claim 9, further comprising:
a crawling module, configured to crawl information of voice controls in the current interface after an interface of the terminal device is changed;
the first transmitting module is further configured to transmit the crawled information of all the voice controls in the current interface to the cloud server.

### Claim 11 (depends on 10)

The device according to claim 10, wherein, the crawling module is specifically configured to:
obtain a control structure tree of the current interface, traverse the control structure tree, and obtain information of the voice controls in the current interface, wherein the control structure tree comprises the information of all voice controls and information of all non-voice controls in the current interface.

### Claim 12 (depends on 9)

The device according to claim 9, wherein, the control module is specifically configured to:
determine, according to the voice control instruction, a voice control and a control instruction for performing the instruction, and triggering a corresponding control action.

### Claim 13 (depends on 9)

The device according to claim 9,
wherein the second receiving module is further configured to receive prompt information transmitted by the cloud server;
the device further comprises a prompt module, configured to prompt the user correspondingly by means of a voice and/or a text, according to the prompt information.

### Claim 14

A cloud server, comprising:
a third receiving module, configured to receive voice information transmitted by a terminal device, the voice information being used to perform voice controlling on the terminal device;
a determining module, configured to determine, according to the voice information, a voice control and a control instruction that match the voice information in a current interface to generate a corresponding voice control instruction;
a second transmitting module, configured to transmit the voice control instruction to the terminal device, so that the terminal device controls a corresponding voice control of the terminal device to perform an operation according to the voice control instruction.

### Claim 15 (depends on 14)

The cloud server according to claim 14, wherein, the third receiving module is further configured to:
receive information of all voice controls in the current interface transmitted by the terminal device before receiving the voice information transmitted by the terminal device.

### Claim 16 (depends on 14)

The cloud server according to claim 14, wherein:
the determining module is further configured to determine prompt information according to the information of the voice control in the current interface;
the second transmitting module is further configured to transmit the prompt information to the terminal device, so that the terminal device prompts the user correspondingly.

### Claim 17 (depends on 1)

A terminal device, comprising:
a memory;
a processor; and
a computer program;
wherein the computer program is stored in the memory, and configured to be executed by the processor to implement the method according to claim 1.

### Claim 18 (depends on 6)

A cloud server, comprising:
a memory;
a processor; and
a computer program;
wherein the computer program is stored in the memory and configured to be executed by the processor to implement the method according to claim 6.

### Claim 19 (depends on 9, 14)

A voice control system, comprising:
at least one terminal device according to claim 9;
at least one cloud server according to claim 14.

### Claim 20 (depends on 1)

A computer readable storage medium having a computer program stored thereon, wherein the computer program is executed by a processor to implement the method of claim 1.
