# US 2020/0396537 A1 · Positioning sound sources

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2020/0396537 A1
- Document ID: US20200396537A1
- Status: Published application
- Kind: A1
- Application number: 16/971,630
- Filed: 2019-02-22
- Published: 2020-12-17
- Earliest claimed: 2018-02-22
- Assignees: Nomono AS
- Applicants: Nomono AS
- Inventors: Audun SOLVANG
- Web page: https://patentgrep.com/patent/US20200396537A1

## CPC

- H04R 3/005: {for combining the signals of two or more microphones (specially adapted for hearing aids H04R25/407)}
- G06T 7/20: Analysis of motion (motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51)
- H04R 1/406: {microphones}
- H04R 5/027: Spatial or constructional arrangements of microphones, e.g. in dummy heads
- H04R 29/005: {Microphone arrays}
- H04S 3/008: {in which the audio signals are in digital form, i.e. employing more than two discrete digital channels (data reduction aspects thereof based on psychoacoustics G10L19/02)}
- H04S 7/30: {Control circuits for electronic adaptation of the sound field}
- G06T 2207/10016: Video; Image sequence
- H04S 3/02: of the matrix type, i.e. in which input signals are combined algebraically, e.g. after having been phase shifted with respect to each other
- H04S 2400/01: Multi-channel, i.e. more than two input channels, sound reproduction with two speakers wherein the multi-channel information is substantially preserved
- H04S 2400/15: Aspects of sound capture and related signal processing for recording or reproduction
- H04S 2420/11: Application of ambisonics in stereophonic audio systems
- H04R: LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS (producing sounds with frequency not determined by supply frequency G10K)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- H04S: STEREOPHONIC SYSTEMS

## Abstract

A method of determining a position of a sound source is provided which comprises generating a spatially encoded sound-field signal using a sound-field microphone system comprising at least two microphones, wherein the spatially encoded sound-field signal comprises a plurality of components, each component including sound from the sound source. The method further comprises generating a local microphone signal corresponding to sound from the sound source using a local microphone positioned close to the sound source, comparing the local microphone signal with each of the plurality of components to generate a plurality of comparison results and using the plurality of comparison results to determine the position of the sound source relative to the sound-field microphone system.

## Claims

### Claim 1

A method of determining a position of a sound source comprising:
generating a spatially encoded sound-field signal using a sound-field microphone system comprising at least two microphones, wherein the spatially encoded sound-field signal comprises a plurality of components, each component including sound from the sound source;
generating a local microphone signal corresponding to sound from the sound source using a local microphone positioned close to the sound source;
comparing the local microphone signal with each of the plurality of components to generate a plurality of comparison results; and
using the plurality of comparison results to determine the position of the sound source relative to the sound-field microphone system.

### Claim 2 (depends on 1)

The method as claimed in claim 1, wherein comparing the local microphone signal with each of the plurality of components comprises determining respective measures of correlation between the local microphone signal and each of the plurality of components.

### Claim 3 (depends on 2)

The method as claimed in claim 2, wherein determining the position of the sound source relative to the sound-field microphone system comprises:
using the measures of correlation to determine a direct sound autocorrelation weighted by spherical harmonics; and
extracting the direction from the sound-field microphone system to the local microphone by evaluating the components of the direct sound autocorrelation.

### Claim 4 (depends on 2)

The method as claimed in claim 2, comprising using the determined measures of correlation to calculate one or more propagation delays between the local microphone signal and at least one of the plurality of components.

### Claim 5 (depends on 4)

The method as claimed in claim 4, wherein using the plurality of comparison results to determine the position of the sound source relative to the sound-field microphone system comprises determining a direction from the sound-field microphone system to the local microphone using differences between two or more of the propagation delays.

### Claim 6 (depends on 4)

The method as claimed in claim 4, wherein using the plurality of comparison results to determine the position of the sound source relative to the sound-field microphone system comprises determining a distance, or a change in distance, from the sound-field microphone system to the local microphone using at least one of the propagation delays.

### Claim 7 (depends on 1)

The method as claimed in claim 1, wherein the sound source is moving.

### Claim 8 (depends on 1)

The method as claimed in claim 1, wherein each of the plurality of components includes sound from a second sound source, and the method further comprises:
capturing a second microphone signal using a second microphone positioned close to the second sound source, wherein the first microphone signal comprises sound from the second sound source;
comparing the second microphone signal with each of the plurality of components to generate a plurality of second comparison results; and
using the plurality of second comparison results to determine the position of the second sound source relative to the sound-field microphone system.

### Claim 9 (depends on 1)

The method as claimed in claim 1, further comprising producing a spatially encoded soundtrack wherein the local microphone signal is encoded with the position of the sound source relative to the sound-field microphone system.

### Claim 10 (depends on 1)

The method as claimed in claim 1, wherein the method further comprises using the determined position of the sound source to control a further action.

### Claim 11 (depends on 1)

The method as claimed in claim 1, further comprising capturing a video signal using a camera system, wherein the sound source is captured within the video signal.

### Claim 12 (depends on 11)

The method as claimed in claim 11, wherein the sound-field microphone system is collocated with the camera system.

### Claim 13 (depends on 11)

The method as claimed in claim 11, wherein the method further comprises using optical image tracking techniques with the video signal to refine the position of the sound source.

### Claim 14 (depends on 11)

The method as claimed in claim 11, wherein the method further comprises using optical image tracking techniques to align the spatially encoded sound-field signal and the video signal.

### Claim 15 (depends on 1)

The method as claimed in claim 1, wherein the sound-field microphone system comprises at least four microphones.

### Claim 16 (depends on 1)

The method as claimed in claim 1, wherein the sound-field microphone system comprises a microphone array and an encoder.

### Claim 17 (depends on 1)

The method as claimed in claim 1, wherein the spatially encoded sound-field signal comprises an ambisonic B-format signal.

### Claim 18 (depends on 1)

The method as claimed in claim 1, wherein the at least two microphones of the sound-field microphone system are adjacent each other.

### Claim 19 (depends on 1)

The method as claimed in claim 1, wherein comparing the local microphone signal with each of the plurality of components comprises inputting the local microphone signal and each of the plurality of components to a neural network and receiving the position of the sound source relative to the sound-field microphone system as an output from said neural network.

### Claim 20 (depends on 19)

The method as claimed in claim 19, further comprising training said neural network with previously captured local microphone signals, spatially encoded sound-field signals and information regarding sound source positions.

### Claim 21

A method of determining a position of a sound source comprising:
providing a spatially encoded sound-field signal comprising a plurality of components, each component including sound from the sound source;
providing a local microphone signal corresponding to sound from the sound source;
comparing the local microphone signal with each of the plurality of components to generate a plurality of comparison results; and
using the plurality of comparison results to determine the position of the sound source.

### Claim 22

A computer software tool configured to:
receive a spatially encoded sound-field signal comprising a plurality of components, each component including sound from a sound source;
receive a local microphone signal corresponding to sound from the sound source;
compare the local microphone signal with each of the plurality of components to generate a plurality of comparison results; and
use the plurality of comparison results to determine a position of the sound source.

### Claim 23

A sound source positioning system comprising:
a sound-field microphone system which is arranged to output a sound-field signal comprising a plurality of components, each component including sound from a sound source;
a close microphone which is positioned close to the sound source and is arranged to output a close microphone signal corresponding to sound from the sound source; and
a processor arranged to receive the close microphone signal and the sound-field signal;
wherein the processor is configured to compare the close microphone signal with each of the plurality of components to generate a plurality of comparison results and to use the plurality of comparison results to determine a position of the sound source relative to the sound-field microphone system.
