# US 12,114,136 B2 · Signal processing methods and systems for beam forming with microphone tolerance compensation > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,114,136 B2 - Document ID: US12114136B2 - Status: Granted - Kind: B2 - Application number: 17/571,466 - Filed: 2022-01-08 - Published: 2022-04-28 - Granted: 2024-10-08 - Earliest claimed: 2019-07-10 - Assignees: Analog Devices International Unlimited Company - Applicants: Analog Devices International Unlimited Company - Inventors: Dietmar Ruwisch - Web page: https://patentgrep.com/patent/US12114136B2 ## CPC - H04R 3/005: {for combining the signals of two or more microphones (specially adapted for hearing aids H04R25/407)} - H04R 1/406: {microphones} - H04R 29/006: {Microphone matching} - H04R 2430/20: Processing of the output signals of the acoustic transducers of an array for obtaining a desired directivity characteristic (H04R2203/12 takes precedence) - H04R: LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS (producing sounds with frequency not determined by supply frequency G10K) ## Abstract A method and apparatus are provided for generating a directional output signal from sound received by at least two microphones arranged as microphone array. The method includes transforming the sound received by each of said microphones and represented by analog-to-digital converted time-domain signals provided by each of said microphones into corresponding complex-valued frequency-domain microphone signals each having a frequency component value for each of a plurality of frequency components, and calculating, for each of the plurality of frequency components of the complex-valued frequency-domain microphone signal of at least one of said microphones, a respective tolerance compensated frequency component value by multiplying the frequency component value of the complex-valued frequency-domain microphone signal of said microphone with a frequency-specific real-valued correction factor. ## Claims ### Claim 1 A method of microphone tolerance compensation when generating a directional output signal from sound received by at least two microphones arranged as microphone array, said method comprising: transforming analog-to-digital converted time-domain signals provided by respective ones of said at least two microphones into corresponding complex-valued frequency-domain microphone signals, the analog-to-digital converted time-domain signals representing respective sounds received by said at least two microphones, wherein each one of the corresponding complex-valued frequency-domain microphone signals has a frequency component value for each frequency component of a plurality of frequency components; calculating, for each frequency component of the plurality of frequency components of the complex-valued frequency-domain microphone signal of at least one microphone of said at least two microphones, a respective tolerance compensated frequency component value by multiplying the frequency component value of the complex-valued frequency-domain microphone signal of said at least one of said at least two microphones with a frequency-specific real-valued correction factor, resulting in tolerance compensated frequency component values, wherein the frequency-specific real-valued correction factor compensates for at least a sensitivity deviation relative to a reference microphone within the microphone array or a combination of reference microphones within the microphone array; and forming a tolerance compensated complex-valued frequency-domain microphone signal from said tolerance compensated frequency component values for said plurality of frequency components. ### Claim 2 (depends on 1) The method of claim 1, further comprising: calculating, for each frequency component of the plurality of frequency components, said frequency-specific real-valued correction factor as weighted spectral average of frequency component value of a real-valued deviation spectrum; wherein, for each frequency component of the plurality of frequency components, said frequency component value of said deviation spectrum is calculated by dividing the component value of a reference magnitude spectrum by a respective frequency component value of a temporally averaged magnitude value of the frequency domain microphone signal of said at least one microphone. ### Claim 3 (depends on 2) The method of claim 2, further comprising: calculating said reference magnitude spectrum by temporally averaging the magnitude spectrum values of the frequency domain microphone signal of a particular microphone of the microphone array, the particular microphone being the reference microphone. ### Claim 4 (depends on 3) The method of claim 3, further comprising: calculating said reference magnitude spectrum by averaging temporally averaged magnitude spectra of the frequency domain microphone signals of two or more particular microphones or all of the at least two microphones of the microphone array, the two or more particular microphones or all of the at least two microphones being the combination of reference microphones. ### Claim 5 (depends on 3) The method of claim 3, wherein said temporal averaging of the magnitude spectrum values is executed in response to the magnitude spectrum values being above a predefined threshold value. ### Claim 6 (depends on 1) The method of claim 1, further comprising: calculating, from the tolerance compensated complex-valued frequency-domain microphone signals for a beam focus direction, a beam focus spectrum by means of a characteristic function with values between zero and one, said beam focus spectrum comprises, for each frequency, component of the plurality of frequency components, a time-dependent, real-valued attenuation factor; multiplying, for each of the plurality of frequency components, the attenuation factor with the frequency component value of the complex-valued frequency-domain microphone signal of one of said at least two microphones to obtain a directional frequency component value; and forming a tolerance-compensated frequency-domain directional output signal from the directional frequency component values for each of the plurality of frequency components. ### Claim 7 (depends on 6) The method of claim 6, further comprising calculating a linear combination of the tolerance-compensated microphone signals of said at least two microphones, wherein, in the multiplying, the attenuation factor is multiplied with the frequency component value of the complex-valued frequency-domain microphone signal of the linear combination of respective complex-valued frequency-domain microphone signals of said at least two microphones. ### Claim 8 (depends on 6) The method of claim 6, wherein a tolerance compensated time-domain directional output signal is synthesized from the tolerance-compensated frequency-domain directional output signal by means of inverse transformation. ### Claim 9 (depends on 6) The method of claim 6, further comprising calculating beam focus spectra by: calculating, for each of the plurality of frequency components, a real-valued beam spectra value from the complex-valued frequency-domain microphone signals for the beam focus direction by means of predefined, microphone-specific, time-constant, complex-valued transfer functions, wherein, for each of the plurality of frequency components, said beam spectra value is an argument of said characteristic function, providing a beam focus spectrum for said beam focus direction. ### Claim 10 (depends on 6) The method of claim 6, wherein the beam focus spectrum comprises respective attenuation factors. ### Claim 11 An apparatus for generating a directional output signal from sound received by at least two microphones arranged as microphone array, said apparatus comprising at least one processor adapted to perform: transforming analog-to-digital converted time-domain signals provided by respective ones of said at least two microphones into corresponding complex-valued frequency-domain microphone signals, the analog-to-digital converted time-domain signals representing respective sounds received by said at least two microphones, wherein each one of the corresponding complex-valued frequency-domain microphone signals has a frequency component value for each frequency component of a plurality of frequency components; and calculating, for each frequency component of the plurality of frequency components of the complex-valued frequency-domain microphone signal of at least one of said at least two microphones, a respective tolerance compensated frequency component value by multiplying the frequency component value of the complex-valued frequency-domain microphone signal of the at least one of said at least two microphones with a frequency-specific real-valued correction factor, wherein the frequency-specific real-valued correction factor compensates for at least a sensitivity deviation relative to a reference microphone within the microphone array or a combination of reference microphones w the microphone array. ### Claim 12 (depends on 11) The apparatus of claim 11, further comprising said at least two microphones. ### Claim 13 (depends on 1) An apparatus comprising at least one processor configured to carry out the method of claim 1. ### Claim 14 One or more non-transitory computer-readable media having instructions stored thereon, the instructions for microphone tolerance compensation when generating a directional output signal from sound received by at least two microphones arranged as microphone array, and the instructions to cause one or more processors to perform operations comprising: transforming analog-to-digital converted time-domain signals provided by respective ones of said at least two microphones into corresponding complex-valued frequency-domain microphone signals, the analog-to-digital converted time-domain signals representing respective sounds received by said at least two microphones, wherein each one of the corresponding complex-valued frequency-domain microphone signals has a frequency component value for each frequency component of a plurality of frequency components; calculating, for each frequency component of the plurality of frequency components of the complex-valued frequency-domain microphone signal of at least one microphone of said at least two microphones, a respective tolerance compensated frequency component value by multiplying the frequency component value of the complex-valued frequency-domain microphone signal of said at least one of said at least two microphones with a frequency-specific real-valued correction factor, resulting in tolerance compensated frequency component values, wherein the frequency-specific real-valued correction factor compensates for at least a sensitivity deviation relative to a reference microphone within the microphone array or a combination of reference microphones within the microphone array; and forming a tolerance compensated complex-valued frequency-domain microphone signal from said tolerance compensated frequency component values for said plurality of frequency components. ### Claim 15 (depends on 14) The one or more non-transitory computer-readable media of claim 14, wherein the operations further comprise: calculating, for each frequency component of the plurality of frequency components, said frequency-specific real-valued correction factor as weighted spectral average of frequency component value of a real-valued deviation spectrum; wherein, for each frequency component of the plurality of frequency components, said frequency component value of said deviation spectrum is calculated by dividing the component value of a reference magnitude spectrum by a respective frequency component value of a temporally averaged magnitude value of the frequency domain microphone signal of said at least one microphone. ### Claim 16 (depends on 15) The one or more non-transitory computer-readable media of claim 15, wherein the operations further comprise: calculating said reference magnitude spectrum by temporally averaging the magnitude spectrum values of the frequency domain microphone signal of a particular microphone of the microphone array, the particular microphone being the reference microphone. ### Claim 17 (depends on 16) The one or more non-transitory computer-readable media of claim 16, wherein the operations further comprise: calculating said reference magnitude spectrum by averaging temporally averaged magnitude spectra of the frequency domain microphone signals of two or more particular microphones or all of the at least two microphones of the microphone array, the two or more particular microphones or all of the at least two microphones being the combination of reference microphones. ### Claim 18 (depends on 16) The one or more non-transitory computer-readable media of claim 16, wherein said temporal averaging of the magnitude spectrum values is executed in response to the magnitude spectrum values being above a predefined threshold value. ### Claim 19 (depends on 14) The one or more non-transitory computer-readable media of claim 14, wherein the operations further comprise: calculating, from the tolerance compensated complex-valued frequency-domain microphone signals, for a beam focus direction, a beam focus spectrum by means of a characteristic function with values between zero and one, said beam focus spectrum comprises, for each of the plurality of frequency components, a time-dependent, real-valued attenuation factor; multiplying, for each of the plurality of frequency components, the attenuation factor with the frequency component value of the complex-valued frequency-domain microphone signal of one of said at least two microphones to obtain a directional frequency component value; and forming a tolerance-compensated frequency-domain directional output signal from the directional frequency component values for each of the plurality of frequency components. ### Claim 20 (depends on 19) The one or more non-transitory computer-readable media of claim 19, wherein the operations further comprise: calculating a linear combination of the tolerance-compensated microphone signals of said at least two microphones, wherein, in the multiplying, the attenuation factor is multiplied with the frequency component value of the complex-valued frequency-domain microphone signal of the linear combination of the microphone signals.