# US 10,873,814 B2 · Analysis of spatial metadata from multi-microphones having asymmetric geometry in devices > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 10,873,814 B2 - Document ID: US10873814B2 - Status: Granted - Kind: B2 - Application number: 16/461,606 - Filed: 2017-11-10 - Published: 2020-02-27 - Granted: 2020-12-22 - Earliest claimed: 2016-11-18 - Assignees: Nokia Technologies Oy - Applicants: Nokia Technologies Oy - Inventors: Juha Vilkamo; Miikka Vilermo; Mikko Tammi - Web page: https://patentgrep.com/patent/US10873814B2 ## CPC - H04R 5/04: Circuit arrangements, {e.g. for selective connection of amplifier inputs/outputs to loudspeakers, for loudspeaker detection, or for adaptation of settings to personal preferences or hearing impairments (combinations of amplifiers H03F3/68; stereophonic systems H04S)} - H04R 3/005: {for combining the signals of two or more microphones (specially adapted for hearing aids H04R25/407)} - H04R 3/04: for correcting frequency response - H04R 5/027: Spatial or constructional arrangements of microphones, e.g. in dummy heads - H04R 1/326: {for microphones (H04R1/34 and H04R1/40 take precedence)} - H04R 2499/11: Transducers incorporated or for use in hand-held devices, e.g. mobile phones, PDA's, camera's - H04S 7/303: {Tracking of listener position or orientation} - H04S 7/304: {For headphones} - H04S 2400/15: Aspects of sound capture and related signal processing for recording or reproduction - H04S 2420/03: Application of parametric coding in stereophonic audio systems - H04R: LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS (producing sounds with frequency not determined by supply frequency G10K) - H04S: STEREOPHONIC SYSTEMS ## Abstract An apparatus including a predetermined shape, the apparatus including at least three microphones, wherein at least one pair from the at least three microphones comprises including two microphones which are separated by a shorter distance of the predetermined shape than at least one other microphone pair of the predetermined shape; and a processor configured to: receive at least three microphone audio signals from the at least three microphones; analyse at least the microphone audio signals from the two microphones to determine a directional ambiguity decision; and analyse the microphone audio signals from at least one of the other microphone pairs to determine at least one sound characteristic other than the direction ambiguity. ## Claims ### Claim 1 An apparatus comprising a predetermined shape, the apparatus comprising: at least three microphones, located on or within the apparatus, wherein at least one pair of the at least three microphones comprises two microphones which are separated with a shorter distance of the predetermined shape than one or more other microphone pair; and a processor configured to: receive at least three microphone audio signals from the at least three microphones; analyse at least the microphone audio signals from the two microphones which are separated with the shorter distance to determine a direction ambiguity decision; and analyse the microphone audio signals from at least one pair of the one or more other microphone pair to determine at least one sound characteristic other than a direction ambiguity, wherein the at least one pair of the one or more other microphone pair comprises two microphones separated with a longer distance of the predetermined shape in such a way that the two microphones separated with the longer distance are configured to capture spatial audio signals, wherein the at least one sound characteristic comprises at least a direction angle of arriving sound, wherein the direction angle of the arriving sound has at least one ambiguous value, and wherein the direction ambiguity decision is configured to at least partially resolve the at least one ambiguous value. ### Claim 2 (depends on 1) The apparatus as claimed in claim 1, wherein the predetermined shape is a physical shape of the apparatus and at least one dimension of the physical shape of the apparatus is shorter than other dimensions of the physical shape of the apparatus and wherein the two microphones which are separated with the shorter distance are separated due to the at least one dimension of the physical shape of the apparatus being shorter than other dimensions of the physical shape of the apparatus. ### Claim 3 (depends on 1) The apparatus as claimed in claim 1, wherein the processor configured to analyse at least the microphone audio signals from the two microphones which are separated with the shorter distance is further configured to analyse the microphone audio signals from at least one further pair of the one or more other microphone pair to determine the direction ambiguity decision. ### Claim 4 (depends on 1) The apparatus as claimed in claim 1, wherein the processor is configured to: determine a first spatial metadata part, the first spatial metadata part being the direction ambiguity decision; determine a second spatial metadata part, the second spatial metadata part being the at least one sound characteristic other than the direction ambiguity; and combine the first spatial metadata part and the second spatial metadata part to generate spatial metadata associated with the at least three microphone audio signals, and wherein the second spatial metadata part has a greater range of values than the first spatial metadata part. ### Claim 5 (depends on 1) The apparatus as claimed in claim 1, wherein the processor configured to analyse the microphone audio signals from the at least one pair of the one or more other microphone pair to determine the at least one sound characteristic is configured to determine a delay value between microphones of the at least one pair of the one or more other microphone pair. ### Claim 6 (depends on 1) The apparatus as claimed in claim 1, wherein the processor configured to analyse the microphone audio signals from the at least one pair of the one or more other microphone pair to determine the direction angle is configured to: determine a delay value between the microphone audio signals from the at least one pair of the one or more other microphone pair; normalise the delay value against a delay value for a sound wave to travel a distance between microphones of the at least one pair of the one or more other microphone pair; and apply a trigonometric function to the normalised delay value, or use the normalised delay value in a look up table, to generate at least two ambiguous direction angle values. ### Claim 7 (depends on 6) The apparatus as claimed in claim 6, wherein the processor configured to analyse at least the microphone audio signals from the two microphones which are separated with the shorter distance to determine the direction ambiguity decision is configured to: determine a sign of the delay value associated with a maximum correlation value between the microphone audio signals from the two microphones which are separated with the shorter distance, wherein the processor is further configured to resolve the at least two ambiguous direction angle values based on the sign of the delay value. ### Claim 8 (depends on 6) The apparatus as claimed in claim 6, wherein the processor configured to determine the delay value between the microphone audio signals is configured to: determine a plurality of correlation values for a range of delay values between the microphone audio signals; perform a search of the plurality of correlation values for a correlation value with a maximum correlation value; and select the delay value from the range of delay values associated with the correlation value with the maximum correlation value. ### Claim 9 (depends on 6) The apparatus as claimed in claim 6, wherein the processor configured to determine the delay value between the microphone audio signals is configured to: determine a derivative over frequency of a phase difference between the microphone audio signals; and determine the delay value based on the derivative over frequency of the phase difference. ### Claim 10 (depends on 1) The apparatus as claimed in claim 1, wherein the at least one sound characteristic other than the direction ambiguity further comprises at least one of: an energy ratio associated with the direction angle of the arriving sound; or a coherence associated with the direction angle of the arriving sound. ### Claim 11 (depends on 1) The apparatus as claimed in claim 1, wherein the processor configured to at least one of: analyse at least the microphone audio signals from the two microphones which are separated with the shorter distance to determine the direction ambiguity decision is configured to analyse, on a frequency-band by frequency-band basis, at least the microphone audio signals from the two microphones which are separated with the shorter distance to determine the direction ambiguity decision; or analyse, on a frequency-band by frequency-band basis, the microphone audio signals from the at least one pair of the one or more other microphone pair to determine the at least one sound characteristic other than the direction ambiguity. ### Claim 12 (depends on 1) The apparatus as claimed in claim 1, wherein the at least three microphones comprise four microphones, the processor configured to receive the at least three microphone audio signals from the at least three microphones is configured to receive four microphone audio signals from the four microphones, the processor configured to analyse the microphone audio signals from the at least one pair of the one or more other microphone pair to determine the at least one sound characteristic other than the direction ambiguity is configured to: analyse the microphone audio signals from at least two pairs of the one or more other microphone pair to determine at least two delays; and determine an azimuth direction and an elevation direction of the arriving sound from the at least two delays, and the processor configured to analyse at least the microphone audio signals from the two microphones which are separated with the shorter distance to determine the direction ambiguity decision is configured to determine a direction ambiguity decision for at least one of the determined azimuth and elevation directions. ### Claim 13 A method for an apparatus comprising a predetermined shape, the apparatus comprising: at least three microphones, located on or within the apparatus, wherein at least one pair of the at least three microphones comprises two microphones which are separated with a shorter distance of the predetermined shape than one or more other microphone pair, the method comprising: receiving at least three microphone audio signals from the at least three microphones; analysing at least the microphone audio signals from the two microphones which are separated with the shorter distance to determine a direction ambiguity decision; and analysing the microphone audio signals from at least one pair of the one or more other microphone pair to determine at least one sound characteristic other than a direction ambiguity, wherein the at least one pair of the one or more other microphone pair comprises two microphones separated with a longer distance of the predetermined shape in such a way that the two microphones separated with the longer distance are configured to capture spatial audio signals, wherein the at least one sound characteristic comprises at least a direction angle of arriving sound, wherein the direction angle of the arriving sound has at least one ambiguous value, and wherein the direction ambiguity decision is configured to at least partially resolve the at least one ambiguous value. ### Claim 14 (depends on 13) The method as claimed in claim 13, further comprising: determining a first spatial metadata part, the first spatial metadata part being the direction ambiguity decision; determining a second spatial metadata part, the second spatial metadata part being the at least one sound characteristic other than the direction ambiguity; and combining the first spatial metadata part and the second spatial metadata part to generate spatial metadata associated with the at least three microphone audio signals, and wherein the second spatial metadata part has a greater range of values than the first spatial metadata part. ### Claim 15 (depends on 13) The method as claimed in claim 13, wherein analysing the microphone audio signals from the at least one pair of the one or more other microphone pair to determine the at least one sound characteristic other than the direction ambiguity comprises determining a delay value between microphones of the at least one pair of the one or more other microphone pair. ### Claim 16 (depends on 13) The method as claimed in claim 13, wherein analysing the microphone audio signals from the at least one pair of the one or more other microphone pair to determine the direction angle further comprises: determining the delay value between the microphone audio signals from at least one pair of the one or more other microphone pair; normalising the delay value against a delay value for a sound wave to travel a distance between microphones of the at least one pair of the one or more other microphone pair; and applying a trigonometric function to the normalised delay value, or using the normalised delay value in a look up table, to generate at least two ambiguous direction angle values. ### Claim 17 (depends on 16) The method as claimed in claim 16, wherein analysing at least the microphone audio signals from the two microphones which are separated with the shorter distance to determine the direction ambiguity decision comprises: determining a sign of the delay value associated with a maximum correlation value between the microphone audio signals from the two microphones which are separated with the shorter distance, wherein the method further comprises resolving the at least two ambiguous direction angle values based on the sign of the delay value. ### Claim 18 (depends on 13) The method as claimed in claim 13, wherein the at least three microphones comprise four microphones, wherein receiving the at least three microphone audio signals from the at least three microphones comprises receiving four microphone audio signals from the four microphones, analysing the microphone audio signals from the at least one pair of the one or more other microphone pair to determine the at least one sound characteristic other than the direction ambiguity further comprises: analysing the microphone audio signals from at least two pairs of the one or more other microphone pair to determine at least two delays; and determining an azimuth direction and an elevation direction of the arriving sound from the at least two delays, and analysing at least the microphone audio signals from the two microphones which are separated with the shorter distance to determine the direction ambiguity decision comprises determining a direction ambiguity decision for at least one of the determined azimuth and elevation directions. ### Claim 19 (depends on 1) The apparatus as claimed in claim 1, wherein the at least one ambiguous value comprises one of an azimuth value or an elevation value of the direction angle of the arriving sound. ### Claim 20 (depends on 13) The method as claimed in claim 13, wherein the at least one ambiguous value comprises one of the an azimuth value or an elevation value of the direction angle of the arriving south.