# US 11,114,093 B2 · Intelligent voice recognizing method, apparatus, and intelligent computing device > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 11,114,093 B2 - Document ID: US11114093B2 - Status: Granted - Kind: B2 - Application number: 16/555,659 - Filed: 2019-08-29 - Published: 2019-12-19 - Granted: 2021-09-07 - Earliest claimed: 2019-08-12 - Assignees: LG Electronics Inc. - Applicants: LG Electronics Inc. - Inventors: Wonchul Kim - Web page: https://patentgrep.com/patent/US11114093B2 ## CPC - G10L 15/20: Speech recognition techniques specially adapted for robustness in adverse environments, e.g. in noise, of stress induced speech (G10L21/02 takes precedence) - G10L 15/16: using artificial neural networks - G10L 15/22: Procedures used during a speech recognition process, e.g. man-machine dialogue - G10L 21/0232: Processing in the frequency domain - G10L 25/84: for discriminating voice from noise - H04W 72/1268: of uplink data flows - G10L 21/0208: Noise filtering - G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING - H04W: WIRELESS COMMUNICATION NETWORKS (broadcast communication H04H; communication systems using wireless links for non-selective communication, e.g. wireless extensions H04M1/72) ## Abstract An intelligent voice recognition method, voice recognition apparatus and intelligent computing device are disclosed. An intelligent voice recognition method according to an embodiment of the present invention obtains a microphone detection signal, recognizes a voice of a user from the microphone detection signal and outputs a response related to the voice on the basis of a result of recognition of the voice, wherein the microphone detection signal includes noise, and a microphone detection signal including only the voice obtained by removing the noise from the microphone detection signal is recognized. Accordingly, only a voice of a user can be effectively separated from a microphone detection signal detected through a microphone of the voice recognition apparatus. One or more of the voice recognition devices, intelligent computing devices, and servers of the present invention may include artificial intelligence modules, drones (Unmanned Aerial Vehicles, UAVs), robots, Augmented Reality (AR) devices, and virtual reality (VR) devices, devices related to 5G services, and the like. ## Claims ### Claim 1 An intelligent voice recognition method of a voice recognition apparatus, comprising: obtaining a microphone detection signal; recognizing a voice of a user from the microphone detection signal; and outputting a response related to the voice based on a result of recognition of the voice, wherein the microphone detection signal includes noise, and the recognizing of the voice comprises recognizing a microphone detection signal including only the voice obtained by removing the noise from the microphone detection signal, and wherein the obtaining of the microphone detection signal is obtained from a wireless earphone for detecting external signals and comprises: receiving an uplink (UL) grant from a network; requesting the microphone detection signal from the wireless earphone using frequency hopping set based on a number of repetitions of transmission included in the UL grant; and obtaining the microphone detection signal in response to the requesting the microphone detection signal. ### Claim 2 (depends on 1) The intelligent voice recognition method of claim 1, wherein the recognizing of the voice comprises removing ambient noise of the wireless earphone from the microphone detection signal. ### Claim 3 (depends on 1) The intelligent voice recognition method of claim 1, wherein the outputting of the response comprises transmitting a microphone detection signal including only the voice obtained by removing the noise from the microphone detection signal to an external device connected to the voice recognition apparatus for a call. ### Claim 4 (depends on 1) The intelligent voice recognition method of claim 1, wherein the outputting of the response comprises: receiving resource allocation information for call connection with an external device from a network through a physical uplink control channel; and transmitting the microphone detection signal including only the voice from which the noise has been removed to the external device based on the resource allocation information. ### Claim 5 (depends on 1) The intelligent voice recognition method of claim 1, wherein the voice recognition apparatus includes a virtual reality device or an augmented reality device, wherein the recognizing of the voice comprises removing ambient noise of a head module of the virtual reality device or the augmented reality device from the microphone detection signal. ### Claim 6 (depends on 1) The intelligent voice recognition method of claim 1, wherein the recognizing of the voice comprises: inputting the microphone detection signal to an artificial neural network learned in advance; and obtaining the microphone detection signal including only the voice from which the noise has been removed as an output of the artificial neural network, wherein the artificial neural network is learned in advance based on a training set including prestored sound signals and the voice of the user. ### Claim 7 (depends on 6) The intelligent voice recognition method of claim 6, further comprising: receiving downlink control information (DCI) used to schedule transmission of the microphone detection signal obtained from at least one sensor included in the voice recognition apparatus from a network; and transmitting the microphone detection signal to the network based on the DCI. ### Claim 8 (depends on 7) The intelligent voice recognition method of claim 7, further comprising: performing an initial access procedure with the network based on a synchronization signal block (SSB); and transmitting the microphone detection signal to the network through a PUSCH, wherein the SSB and a DM-RS of the PUSCH are QCLed for QCL type D. ### Claim 9 (depends on 8) The intelligent voice recognition method of claim 8, further comprising: controlling a communication module to transmit the microphone detection signal to an AI processor included in the network; and controlling the communication module to receive AT-processed information from the AI processor, wherein the AI-processed information is a microphone detection signal including only the voice from which the noise has been removed. ### Claim 10 An intelligent voice recognition apparatus comprising: a microphone for detecting external signals; a speaker for outputting sound to the outside; and a processor configured to obtain a microphone detection signal through the microphone, to recognize a voice of a user from the microphone detection signal, and to output a response related to the voice through the speaker based on a result of recognition of the voice, wherein the microphone detection signal includes noise, and the processor recognizes a microphone detection signal including only the voice obtained by removing the noise from the microphone detection signal, and wherein the processor obtains the microphone detection signal from a wireless earphone for detecting external signals by: receiving a uplink (UL) grant from a network; requesting the microphone detection signal from the wireless earphone using frequency hopping set based on a number of repetitions of transmission included in the UL grant; and obtaining the microphone detection signal in response to the requesting the microphone detection signal. ### Claim 11 (depends on 10) The intelligent voice recognition apparatus of claim 10, wherein the processor removes ambient noise of the wireless earphone from the microphone detection signal. ### Claim 12 (depends on 11) The intelligent voice recognition apparatus of claim 11, wherein the voice recognition apparatus is a first mobile terminal including a communication module, and the processor transmits a microphone detection signal including only the voice obtained by removing the noise from the microphone detection signal to a second mobile terminal connected to the first mobile terminal for a call through the communication module. ### Claim 13 (depends on 10) The intelligent voice recognition apparatus of claim 10, wherein the voice recognition apparatus is a virtual reality device or an augmented reality device, and the processor removes ambient noise of a head module of the virtual reality device or the augmented reality device from the microphone detection signal. ### Claim 14 (depends on 10) The intelligent voice recognition apparatus of claim 10, wherein the processor inputs the microphone detection signal to an artificial neural network learned in advance and obtains the microphone detection signal including only the voice from which the noise has been removed as an output of the artificial neural network, wherein the artificial neural network is learned in advance based on a training set including prestored sound signals and the voice of the user. ### Claim 15 (depends on 14) The intelligent voice recognition apparatus of claim 14, wherein the artificial neural network is learned through a supervised learning method by setting the prestored sound signals as input values and setting the voice of the user as an output value. ### Claim 16 (depends on 15) The intelligent voice recognition apparatus of claim 15, wherein the processor separates the microphone detection signal into the voice of the user and the noise in the time domain and the frequency domain, extracts feature vectors from the voice of the user and the noise and inputs the feature vectors to the artificial neural network. ### Claim 17 (depends on 16) The intelligent voice recognition apparatus of claim 16, wherein the processor receives downlink control information MCI) used to schedule transmission of the microphone detection signal obtained from the microphone included in the voice recognition apparatus from a network through the communication module and transmits the microphone detection signal to the network based on the DCI. ### Claim 18 (depends on 17) The intelligent voice recognition apparatus of claim 17, wherein the processor performs an initial access procedure with the network based on a synchronization signal block (SSB) through the communication module and transmits the microphone detection signal to the network over a PUSCH through the communication module, wherein the SSB and a DM-RS of the PUSCH are QCLed for QCL type D. ### Claim 19 (depends on 18) The intelligent voice recognition apparatus of claim 18, wherein the processor controls the communication module to transmit the microphone detection signal to an AI processor included in the network and controls the communication module to receive AI-processed information from the AI processor, wherein the AI-processed information is a microphone detection signal including only the voice from which the noise has been removed. ### Claim 20 A non-transitory computer-readable recording medium storing a computer-executable component configured to be executed in one or more processors of a computing device, the computer-executable component being configured to: obtain a microphone detection signal; recognize a voice of a user from the microphone detection signal; and output a response related to the voice based on a result of recognition of the voice, wherein the microphone detection signal includes noise, and a microphone detection signal including only the voice obtained by removing the noise from the microphone detection signal is recognized, and wherein the microphone detection signal is obtained from a wireless earphone for detecting external signals by: receiving an uplink (UL) grant from a network; requesting the microphone detection signal from the wireless earphone using frequency hopping set based on a number of repetitions of transmission included in the UL grant; and obtaining the microphone detection signal in response to the requesting the microphone detection signal.