# US 11,308,977 B2 · Processing method of audio signal using spectral envelope signal and excitation signal and electronic device including a plurality of microphones supporting the same > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 11,308,977 B2 - Document ID: US11308977B2 - Status: Granted - Kind: B2 - Application number: 16/733,735 - Filed: 2020-01-03 - Published: 2020-07-09 - Granted: 2022-04-19 - Earliest claimed: 2019-01-04 - Assignees: Samsung Electronics Co., Ltd. - Applicants: Samsung Electronics Co., Ltd. - Inventors: Hangil Moon; Aran Cha; Hwan Shim; Gunwoo Lee; Kyuhan Kim - Web page: https://patentgrep.com/patent/US11308977B2 ## CPC - G10L 21/038: using band spreading techniques - H04R 1/1083: {Reduction of ambient noise (active noise reduction per se G10K11/175; protective devices for the ear, e.g. providing acoustic protection A61F11/06)} - G10L 19/0204: {using subband decomposition} - G10L 19/08: Determination or coding of the excitation function; Determination or coding of the long-term prediction parameters - H04R 1/10: Earpieces; Attachments therefor {; Earphones; Monophonic headphones (H04R1/28 takes precedence; stereophonic headphones H04R5/033)} - H04R 1/1016: {Earpieces of the intra-aural type} - H04R 1/265: {of microphones} - H04R 1/1041: {Mechanical or electronic switches, or control elements (switches in general H01H)} - H04R 1/1075: {Mountings of transducers in earphones or headphones} - H04R 2420/07: Applications of wireless loudspeakers or wireless microphones - G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING - H04R: LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS (producing sounds with frequency not determined by supply frequency G10K) ## Abstract According to an embodiment, the above-described specification discloses an electronic device comprises at least one processor configured to: receive a first audio signal and a second audio signal; detect a spectral envelope signal from the first audio signal and extract a feature point from the second audio signal; extend a high-band of the second audio signal based on the spectral envelope signal from the first audio signal and the feature point from the second audio signal to generate a high-band extension signal; and mix the high-band extension signal and the first audio signal, thereby resulting in a synthesized signal. ## Claims ### Claim 1 An electronic device including a plurality of microphones comprising: at least one processor configured to: receive a first audio signal from a first microphone among a plurality of microphones and a second audio signal from a second microphone among a plurality of microphones; detect a wide-band spectral envelope signal from the first audio signal and extract a narrow-band excitation signal from the second audio signal; extend a high-band of the second audio signal based on the wide-band spectral envelope signal from the first audio signal and the narrow-band excitation signal from the second audio signal to generate a high-band extension signal; and mix the high-band extension signal and the first audio signal, thereby resulting in a synthesized signal. ### Claim 2 (depends on 1) The electronic device of claim 1, wherein the first microphone and the second microphone are operatively connected to the at least one processor, and wherein the first microphone includes an external microphone disposed on one side of an earphone or a headset and the second microphone disposed on one side of a housing configured to be mounted in an ear. ### Claim 3 (depends on 2) The electronic device of claim 2, wherein the second microphone includes at least one of an in-ear microphone or a bone conduction microphone. ### Claim 4 (depends on 1) The electronic device of claim 1, wherein the first audio signal includes a signal in a band wider than the second audio signal. ### Claim 5 (depends on 1) The electronic device of claim 1, wherein the second audio signal includes greater energy in a low-band than the first audio signal. ### Claim 6 (depends on 1) The electronic device of claim 1, wherein the at least one processor is configured to: identify a noise level included in the first audio signal; when the noise level exceeds a specified value, perform pre-processing on the first audio signal; and perform linear prediction analysis on the pre-processed signal and detect the wide-band spectral envelope signal. ### Claim 7 (depends on 6) The electronic device of claim 6, wherein the at least one processor is configured to: when the noise level included in the first audio signal is less than the specified value, perform the linear prediction analysis on the first audio signal and detect the wide-band spectral envelope signal. ### Claim 8 (depends on 1) The electronic device of claim 1, wherein the at least one processor is configured to: store the synthesized signal in a memory; output the synthesized signal through a speaker; or transmit the synthesized signal to an external electronic device connected with a communication circuit. ### Claim 9 (depends on 2) The electronic device of claim 2, wherein the at least one processor is configured to: when one of a call function execution request, a recording function execution request, or a video shooting function execution request is requested, automatically control activation of the first microphone and the second microphone; and perform mixing of the high-band extension signal and the first audio signal. ### Claim 10 An audio signal processing method of an electronic device including a plurality of microphones, the method comprising: receiving a first audio signal from a first microphone among a plurality of microphones and obtaining a second audio signal through a second microphone among the plurality of microphones; detecting a wide-band spectral envelope signal from the first audio signal and extracting a narrow-band excitation signal from the second audio signal; extending a high-band signal of the second audio signal based on the wide-band spectral envelope signal from the first audio signal and the narrow-band excitation signal from the second audio signal to generate a high-band extension signal; and mixing the high-band extension signal and the first audio signal. ### Claim 11 (depends on 10) The method of claim 10, wherein the first microphone includes an external microphone disposed on one side of an earphone or a headset and the second microphone is disposed on one side of a housing configured to be mounted in an ear. ### Claim 12 (depends on 10) The method of claim 10, wherein the second microphone includes at least one of an in-ear microphone or a bone conduction microphone. ### Claim 13 (depends on 10) The method of claim 10, wherein the first audio signal includes a signal in a band wider than the second audio signal. ### Claim 14 (depends on 10) The method of claim 10, wherein the second audio signal hear greater energy in a low-band than the first audio signal. ### Claim 15 (depends on 10) The method of claim 10, further comprising: identifying a noise level included in the first audio signal, wherein mixing includes: when the noise level exceeds a specified value, pre-processing the first audio signal; performing linear prediction analysis on the pre-processed signal and detecting the wide-band spectral envelope signal; and mixing the detected wide-band spectral envelope signal and the high-band extension signal. ### Claim 16 (depends on 15) The method of claim 15, wherein the detecting of the wide-band spectral envelope signal includes: when the noise level included in the first audio signal is less than the specified value, performing the linear prediction analysis on the first audio signal and detecting the wide-band spectral envelope signal. ### Claim 17 (depends on 10) The method of claim 10, further comprising one of: storing the mixed signal in a memory; outputting the mixed signal through a speaker; or transmitting the mixed signal to an external electronic device connected based on a communication circuit. ### Claim 18 (depends on 10) The method of claim 10, further comprising: receiving one of a call function execution request, a recording function execution request, or a video shooting function execution request; and automatically activating the first microphone and the second microphone. ### Claim 19 An electronic device including a plurality of microphones comprising: a first microphone, a communication circuit and at least one processor operatively connected to the first microphone and the communication circuit, wherein the at least one processor is configured to: when activating the first microphone, obtain a first audio signal through the first microphone; identify a noise level of the first audio signal obtained by the activated first microphone; when the noise level exceeds a specified value, activating a second microphone configured to generate a second audio signal through the communication circuit; when obtaining the second audio signal, extract a narrow-band excitation signal from the second audio signal; extend a high-band portion of the second audio signal based on the narrow-band excitation signal from the second audio signal and a wide-band spectral envelope signal extracted from the first audio signal, thereby resulting in a high-band extension signal; and mixing the high-band extension signal and the first audio signal. ### Claim 20 (depends on 19) The electronic device of claim 19, wherein the at least one processor is configured to: when the noise level of the first audio signal is less than the specified value, support deactivation of the second microphone and support execution of a specified function based on the first audio signal through the activated first microphone, and when the noise level of the first audio signal exceeds the specified value, support activation of the second microphone and support execution of a specified function based on the first audio signal through the activated first microphone and the second audio signal through the activated second microphone.