Microphone array auto-directive adaptive wideband beamforming using orientation information from MEMS sensors

A system, comprising:

• a processor;
• and
• non-transitory computer-readable storage media having stored thereon executable instructions that, when executed by the processor cause the processor to:
• receive data representative of audio captured by a microphone array including a plurality of microphones, the data representative of the audio including a plurality of frames;
• receive data representative of an orientation of the microphone array detected by a microelectromechanical systems (MEMS) sensor;
• estimate a direction of arrival of a source signal based on the data representative of the audio by:
• performing a short-time Fourier transform (STFT) on a frame of the plurality of frames to produce a transformed frame;
• determining whether the transformed frame has a signal power above a noise threshold;
• and
• in response to the signal power being above the noise threshold, estimating the direction of arrival of the source signal;
• detect, based on the data representative of the orientation, a change in the orientation of the microphone array;
• compensate the direction of arrival based on the change in the orientation of the microphone array;
• pre-steer a beam of a beam pattern of the microphone array based on the compensated direction of arrival to retain the source signal in a broadside of the microphone array;
• and
• perform adaptive wideband beamforming to null one or more interfering sources in the beam pattern while retaining the source signal in the broadside of the microphone array.

A method, comprising:

• receiving data representative of audio captured by a microphone array including a plurality of microphones, the data representative of the audio including a plurality of frames;
• receiving data representative of an orientation of the microphone array detected by a microelectromechanical systems (MEMS) sensor;
• estimating a direction of arrival of a source signal based on the data representative of the audio by:
• performing a short-time Fourier transform (STFT) on a frame of the plurality of frames to produce a transformed frame;
• determining whether the transformed frame has a signal power above a noise threshold;
• and
• in response to the signal power being above the noise threshold, estimating the direction of arrival of the source signal;
• detecting, based on the data representative of the orientation, a change in the orientation of the microphone array;
• compensating the direction of arrival based on the change in the orientation of the microphone array;
• pre-steering a beam of a beam pattern of the microphone array based on the compensated direction of arrival to retain the source signal in a broadside of the microphone array;
• and
• performing adaptive wideband beamforming to null one or more interfering sources in the beam pattern while retaining the source signal in the broadside of the microphone array.