# US 12,190,878 B2 · Voice interaction method and apparatus > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,190,878 B2 - Document ID: US12190878B2 - Status: Granted - Kind: B2 - Application number: 17/707,666 - Filed: 2022-03-29 - Published: 2022-07-14 - Granted: 2025-01-07 - Earliest claimed: 2019-09-30 - Assignees: Huawei Technologies Co., Ltd. - Applicants: Huawei Technologies Co., Ltd. - Inventors: Yuxiao Zhou; Ping Song; Chunliang Liu; Chao Liang - Web page: https://patentgrep.com/patent/US12190878B2 ## CPC - G06F 3/167: {Audio in a user interface, e.g. using voice commands for navigating, audio feedback} - G10L 15/22: Procedures used during a speech recognition process, e.g. man-machine dialogue - G06F 3/165: {Management of the audio stream, e.g. setting of volume, audio stream path} - G10L 15/30: Distributed recognition, e.g. in client-server systems, for mobile phones or network applications - G10L 2015/223: {Execution procedure of a spoken command} - G10L 2015/225: {Feedback of the input speech} - G10L 2015/228: {of application context} - Y02D 30/70: in wireless communication networks - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING - Y02D: CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE ## Abstract Embodiments provide a voice interaction method and an apparatus, and relate to the field of terminal technologies. Common voice skill commands in a first application scenario may be determined based on the first application scenario and a historical voice skill usage record, and displayed in a display interface. This can implement scenario-based recommendation of voice skill commands, to cover as many application scenarios as possible. In this application, after being woken up, the voice assistant determines the first application scenario based on one or more information items. The voice assistant determines the common voice skill commands in the first application scenario based on the first application scenario and the historical voice skill usage record. The voice assistant displays the common voice skill commands in the first application scenario in the display interface. ## Claims ### Claim 1 A voice interaction method, used in an electronic device, wherein a voice assistant is installed on the electronic device, and the method comprises: after being woken up, determining, by the voice assistant, a first application scenario based on an information item, wherein the information item comprises a current display interface of the electronic device, a current moment, a current location of the electronic device, a current motion state of the electronic device, a current event, or an application currently running on the electronic device; determining, by the voice assistant, common voice skill commands in the first application scenario based on the first application scenario and a historical voice skill usage record, wherein a voice skill command is used to invoke a voice skill, the voice skill is a service provided by the voice assistant; determining, by the voice assistant, a priority sequence of the common voice skill commands in the first application scenario based on the first application scenario and the historical voice skill usage record; and displaying, by the voice assistant, the common voice skill commands in the first application scenario in a display interface according to the priority sequence. ### Claim 2 (depends on 1) The voice interaction method according to claim 1, wherein based on the voice assistant being woken up for a first time, the method further comprises: based on a current user being a new user, a network connection is normal, and the voice assistant can normally obtain high-frequency voice skill commands in a current network, displaying, by the voice assistant, the high-frequency voice skill commands in the display interface; and based on the current user being an old user, determining, by the voice assistant, common voice skill commands of the current user based on the historical voice skill usage record, and displaying, by the voice assistant, the common voice skill commands of the current user in the display interface. ### Claim 3 (depends on 1) The voice interaction method according to claim 1, wherein the determining the priority sequence of the common voice skill commands comprises: determining, by the voice assistant, an appearance frequency of common voice skills in the first application scenario based on the historical voice skill usage record and the first application scenario, wherein the common voice skills correspond to the common voice skill commands; determining, by the voice assistant, priorities of the common voice skills based on an appearance frequency of the common voice skill commands in the first application scenario; and determining, by the voice assistant, locations of the common voice skill commands in the display interface based on the priorities of the common voice skills. ### Claim 4 (depends on 1) The voice interaction method according to claim 1, wherein the method further comprises: in response to a voice skill command entered by a user, invoking, by the voice assistant, a voice skill corresponding to the voice skill command entered by the user. ### Claim 5 (depends on 1) The voice interaction method according to claim 1, wherein the method further comprises: closing the voice assistant based on the voice assistant not receiving, within a second preset time period, a voice skill command entered by a user. ### Claim 6 (depends on 1) The voice interaction method according to claim 1, wherein the method further comprises: based on a network connection being abnormal, notifying, by the voice assistant, a user that a network is abnormal. ### Claim 7 (depends on 1) The voice interaction method according to claim 1, wherein the common voice skill commands include one or more of: a voice skill command used to invoke a voice skill corresponding to a clickable control in the display interface; or a voice skill command used to invoke a voice skill corresponding to recognizable text or a recognizable picture in the display interface; or a voice skill command used to invoke a voice skill corresponding to a recognizable scenario intention in the display interface; or a voice skill command used to invoke a voice skill corresponding to regular behavior that is based on the current moment; or a voice skill command used to invoke a voice skill corresponding to regular behavior that is based on the current location of the electronic device; or a voice skill command used to invoke a voice skill corresponding to regular behavior that is based on the current motion state of the electronic device; or a voice skill command used to invoke a voice skill corresponding to a native application; or a voice skill command used to invoke a voice skill corresponding to a third-party application; or a voice skill command used to invoke a voice skill corresponding to a preset event; or a voice skill command used to invoke a voice skill corresponding to an operation related to a plurality of applications; or a voice skill command used to invoke a voice skill corresponding to an operation with a long path; or a voice skill command used to invoke a voice skill corresponding to a function in the application currently running on the electronic device. ### Claim 8 (depends on 1) The voice interaction method according to of claim 1, wherein the voice assistant is displayed in a half-screen mode, wherein for the half-screen mode a ratio of an application interface of the voice assistant to an entire display interface of the electronic device is greater than 0 and less than 1, and the method comprises: displaying, by the voice assistant, a feedback result of a voice skill command in a user interface of the voice assistant; and sharing, by the voice assistant, the feedback result of the voice skill command with another application in response to an operation command of the user. ### Claim 9 (depends on 1) The voice interaction method according to claim 1, wherein the historical voice skill usage record comprises a record and the record is used to indicate a time for invoking a voice skill, a voice skill command for invoking a voice skill, or an application scenario for invoking a voice skill. ### Claim 10 An electronic device, wherein a voice assistant is installed on the electronic device, and the electronic device comprises a processor, a memory, and a display; the memory and the display are coupled to the processor; the display is configured to display an image generated by the processor; the memory is configured to store computer program code; and the computer program code comprises computer instructions, and when the processor executes the computer instructions, the processor is configured to: after the voice assistant is woken up, determine a first application scenario based on an information item, wherein the information item comprises a current display interface of the electronic device, a current moment, a current location of the electronic device, a current motion state of the electronic device, a current event, or an application currently running on the electronic device; determine common voice skill commands in the first application scenario based on the first application scenario and a historical voice skill usage record, wherein a voice skill command is used to invoke a voice skill, the voice skill is a service provided by the voice assistant; determine, by the voice assistant, a priority sequence of the common voice skill commands in the first application scenario based on the first application scenario and the historical voice skill usage record; and display the common voice skill commands in the first application scenario in a display interface according to the priority sequence. ### Claim 11 (depends on 10) The electronic device according to claim 10, wherein based on the voice assistant being woken up for a first time, the processor is further configured to: based on a current user being a new user, a network connection is normal, and the voice assistant can normally obtain high-frequency voice skill commands in a current network, display, by the voice assistant, the high-frequency voice skill commands in the display interface; based on the current user being an old user, determine, by the voice assistant, common voice skill commands of the current user based on the historical voice skill usage record, and display, by the voice assistant, the common voice skill commands of the current user in the display interface. ### Claim 12 (depends on 10) The electronic device according to claim 10, wherein that the processor is configured to determine the priority sequence of the common voice skill commands in the first application scenario based on the first application scenario and the historical voice skill usage record, includes that the processor is configured to; determine an appearance frequency of common voice skills in the first application scenario based on the historical voice skill usage record and the first application scenario, wherein the common voice skills correspond to the common voice skill commands; determine priorities of the common voice skills based on an appearance frequency of the common voice skill commands in the first application scenario; and determine locations of the common voice skill commands in the display interface based on the priorities of the common voice skills. ### Claim 13 (depends on 10) The electronic device according to claim 10, wherein the processor is further configured to: in response to a voice skill command entered by a user, invoke a voice skill corresponding to the voice skill command entered by the user. ### Claim 14 (depends on 10) The electronic device according to claim 10, wherein the processor is further configured to close the voice assistant based on the voice assistant not receiving, within a second preset time period, a voice skill command entered by the user. ### Claim 15 (depends on 10) The electronic device according to claim 10, wherein the processor is further configured to: based on a network connection being abnormal, notify, by the voice assistant, a user that a network is abnormal. ### Claim 16 (depends on 10) The electronic device according to claim 10, wherein the common voice skill commands include one or more of: a voice skill command used to invoke a voice skill corresponding to a clickable control in the display interface; or a voice skill command used to invoke a voice skill corresponding to recognizable text or a recognizable picture in the display interface; or a voice skill command used to invoke a voice skill corresponding to a recognizable scenario intention in the display interface; or a voice skill command used to invoke a voice skill corresponding to regular behavior that is based on the current moment; or a voice skill command used to invoke a voice skill corresponding to regular behavior that is based on the current location of the electronic device; or a voice skill command used to invoke a voice skill corresponding to regular behavior that is based on the current motion state of the electronic device; or a voice skill command used to invoke a voice skill corresponding to a native application; or a voice skill command used to invoke a voice skill corresponding to a third-party application; or a voice skill command used to invoke a voice skill corresponding to a preset event; or a voice skill command used to invoke a voice skill corresponding to an operation related to a plurality of applications; or a voice skill command used to invoke a voice skill corresponding to an operation with a long path; or a voice skill command used to invoke a voice skill corresponding to a function in the application currently running on the electronic device. ### Claim 17 (depends on 10) The electronic device according to claim 10, wherein the voice assistant is displayed in half-screen mode, wherein for the half-screen mode a ratio of the application interface of the voice assistant to an entire display interface of the electronic device is greater than 0 and less than 1; and the processor is further configured to display a feedback result of a voice skill command in a user interface of the voice assistant, and share, by the voice assistant, the feedback result of the voice skill command with another application in response to an operation command of the user. ### Claim 18 (depends on 10) The electronic device according to claim 10, wherein the historical voice skill usage record comprises a record, and the record is used to indicate a time for invoking a voice skill, a voice skill command for invoking a voice skill, or an application scenario for invoking a voice skill. ### Claim 19 A non-transitory readable medium comprising an instruction, which when executed by a processor causes the processor to perform a method of: after being woken up, determining, by a voice assistant, a first application scenario based on an information item, wherein the information item comprises a current display interface of an electronic device, a current moment, a current location of the electronic device, a current motion state of the electronic device, a current event, or an application currently running on the electronic device; determining, by the voice assistant, common voice skill commands in the first application scenario based on the first application scenario and a historical voice skill usage record, wherein a voice skill command is used to invoke a voice skill, the voice skill is a service provided by the voice assistant, the historical voice skill usage record comprises a record, and the record is used to indicate time for invoking a voice skill, a voice skill command for invoking a voice skill, and an application scenario for invoking a voice skill; determining, by the voice assistant, a priority sequence of the common voice skill commands in the first application scenario based on the first application scenario and the historical voice skill usage record; and displaying, by the voice assistant, the common voice skill commands in the first application scenario in a display interface according to the priority sequence. ### Claim 20 (depends on 19) The non-transitory readable medium according to claim 19, wherein the method further includes: based on a current user being a new user, a network connection is normal, and the voice assistant can normally obtain high-frequency voice skill commands in a current network, display, by the voice assistant, the high-frequency voice skill commands in the display interface; based on the current user being an old user, determine, by the voice assistant, common voice skill commands of the current user based on the historical voice skill usage record, and display, by the voice assistant, the common voice skill commands of the current user in the display interface.