# US 2023/0058437 A1 · Method for human-computer interaction, apparatus for human-computer interaction, device, and storage medium

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2023/0058437 A1
- Document ID: US20230058437A1
- Status: Published application
- Kind: A1
- Application number: 17/706,409
- Filed: 2022-03-28
- Published: 2023-02-23
- Earliest claimed: 2021-08-18
- Assignees: Beijing Baidu Netcom Science Technology Co., Ltd.
- Applicants: Beijing Baidu Netcom Science and Technology Co., Ltd.
- Inventors: Zhen WU; Jiaxiang GE; Xiao WANG; Xianze SU; Bing LIU; Jiawei WANG; Dan WANG; Song YANG; Jinghao HAO; Yufang WU; Qin QU; Bingqi ZHANG; Xiaoyin FU; Siyuan WU; Chao LI; Cong GAO; Lei JIA
- Web page: https://patentgrep.com/patent/US20230058437A1

## CPC

- G10L 15/22: Procedures used during a speech recognition process, e.g. man-machine dialogue
- G06F 40/40: Processing or translation of natural language (natural language analysis G06F40/20; semantic analysis G06F40/30)
- G10L 13/027: Concept to speech synthesisers; Generation of natural phrases from machine-based concepts (generation of parameters for speech synthesis out of text G10L13/08)
- G10L 15/34: Adaptation of a single recogniser for parallel processing, e.g. by use of multiple processors or cloud computing
- G06F 40/35: Discourse or dialogue representation
- G10L 13/00: Speech synthesis; Text to speech systems
- G10L 2015/223: {Execution procedure of a spoken command}
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

The present disclosure provides a method for a human-computer interaction, an apparatus for a human-computer interaction, a device, and a storage medium, and the present disclosure relates to the field of artificial intelligence, such as deep learning and voice. A specific implementation includes: acquiring a voice command; performing voice recognition on the voice command to determine a corresponding voice text; sending, in response to satisfying a preset information sending condition, the voice text to a cloud; receiving a resource for the voice command returned from the cloud; and responding to the voice command based on the resource.

## Claims

### Claim 1

A method for a human-computer interaction, comprising:
acquiring a voice command;
performing voice recognition on the voice command to determine a corresponding voice text;
sending, in response to satisfying a preset information sending condition, the corresponding voice text to a cloud;
receiving a resource for the voice command returned from the cloud; and
responding to the voice command based on the resource.

### Claim 2 (depends on 1)

The method according to claim 1, wherein the method further comprises:
performing intention recognition on the voice text to determine a user intention; and
determining, in response to determining that the user intention instructs to control a client, that the preset information sending condition is not satisfied.

### Claim 3 (depends on 1)

The method according to claim 1, wherein the method further comprises:
determining a status of network connection with the cloud; and
determining, in response to determining that the status of network connection is abnormal, that the preset information sending condition is not satisfied.

### Claim 4 (depends on 1)

The method according to claim 1, wherein the resource comprises a response text; and
the responding to the voice command based on the resource comprises
performing voice synthesis on the response text, to output a synthesized voice.

### Claim 5 (depends on 1)

The method according to claim 1, wherein the resource comprises a query result; and
the responding to the voice command based on the resource comprises displaying a page corresponding to the query result.

### Claim 6 (depends on 4)

The method according to claim 4, wherein the method further comprises:
generating, in response to not satisfying the preset information sending condition, a response text for the voice command based on a historical response text.

### Claim 7 (depends on 1)

The method according to claim 1, wherein the performing the voice recognition on the voice command to determine the corresponding voice text comprises:
determining whether the voice command is a human-computer interaction command; and
performing, in response to determining that the voice command is the human-computer interaction command, the voice recognition on the voice command to determine the corresponding voice text.

### Claim 8 (depends on 7)

The method according to claim 7, wherein the determining whether the voice command is the human-computer interaction command comprises:
performing semantic analysis and intention recognition on text information of the voice command to determine a user intention; and
determining a probability of the text information belonging to a sentence;
determining a text length corresponding to the text information;
determining:
(a) acoustic confidence of a syllable corresponding to acoustic information of the voice command and
(b) acoustic confidence of an entire sentence corresponding to the acoustic information; and
determining whether the voice command belongs to the human-computer interaction command based on at least one of
(i) the user intention, (ii) the probability, (iii) the text length, (iv) the acoustic confidence of the syllable, and (v) the acoustic confidence of the entire sentence.

### Claim 9 (depends on 8)

The method according to claim 8, wherein the performing the voice recognition on the voice command to determine the corresponding voice text comprises:
determining a definite text and an indefinite text in the voice command based on the acoustic confidence corresponding to the acoustic information and a preset confidence threshold;
generating a prompt information based on the definite text and the indefinite text, and outputting the prompt information;
receiving a response voice for the prompt information;
recognizing a clarification text in the response voice; and
determining the corresponding voice text based on the definite text and the clarification text.

### Claim 10 (depends on 1)

The method according to claim 1, wherein the sending, in response to satisfying the preset information sending condition, the voice text to the cloud comprises:
sending a recognized text to the cloud in a voice recognition process of the voice command.

### Claim 11 (depends on 10)

The method according to claim 10, wherein the sending the recognized text to the cloud in the voice recognition process of the voice command comprises:
determining whether the recognized text satisfies a preset condition in the voice recognition process of the voice command; and
sending, in response to determining that the recognized text satisfies the preset condition, the recognized text to the cloud.

### Claim 12 (depends on 10)

The method according to claim 10, wherein the method further comprises:
displaying, in response to receiving an intermediate resource sent from the cloud in the recognition process of the voice command, the intermediate resource.

### Claim 13

An electronic device, comprising:
at least one processor; and
a memory communicatively connected to the at least one processor; wherein
the memory stores instructions executable by the at least one processor, and the instructions, when executed by the at least one processor, cause the at least one processor to perform operations comprising:
acquiring a voice command;
performing voice recognition on the voice command to determine a corresponding voice text;
sending, in response to satisfying a preset information sending condition, the corresponding voice text to a cloud;
receiving a resource for the voice command returned from the cloud; and
responding to the voice command based on the resource.

### Claim 14 (depends on 13)

The electronic device according to claim 13, wherein the operations further comprise:
performing intention recognition on the voice text to determine a user intention; and
determining, in response to determining that the user intention instructs to control a client, that the preset information sending condition is not satisfied.

### Claim 15 (depends on 13)

The electronic device according to claim 13, wherein the operations further comprise:
determining a status of network connection with the cloud; and
determining, in response to determining that the status of network connection is abnormal, that the preset information sending condition is not satisfied.

### Claim 16 (depends on 13)

The electronic device according to claim 13, wherein the resource comprises a response text; and
the responding to the voice command based on the resource comprises:
performing voice synthesis on the response text, to output a synthesized voice.

### Claim 17 (depends on 13)

The electronic device according to claim 13, wherein the resource comprises a query result; and
the responding to the voice command based on the resource comprises:
displaying a page corresponding to the query result.

### Claim 18 (depends on 16)

The electronic device according to claim 16, wherein the operations further comprise:
generating, in response to not satisfying the preset information sending condition, a response text for the voice command based on a historical response text.

### Claim 19 (depends on 13)

The electronic device according to claim 13, wherein the performing the voice recognition on the voice command to determine the corresponding voice text comprises:
determining whether the voice command is a human-computer interaction command; and
performing, in response to determining that the voice command is the human-computer interaction command, the voice recognition on the voice command to determine the corresponding voice text.

### Claim 20

A non-transitory computer readable storage medium storing computer instructions, wherein the computer instructions cause a computer to perform operations comprising:
acquiring a voice command;
performing voice recognition on the voice command to determine a corresponding voice text;
sending, in response to satisfying a preset information sending condition, the corresponding voice text to a cloud;
receiving a resource for the voice command returned from the cloud; and
responding to the voice command based on the resource.
