# US 10,321,241 B2 · Direction of arrival estimation in miniature devices using a sound sensor array

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 10,321,241 B2
- Document ID: US10321241B2
- Status: Granted
- Kind: B2
- Application number: 15/643,074
- Filed: 2017-07-06
- Published: 2019-01-10
- Granted: 2019-06-11
- Earliest claimed: 2016-07-06
- Assignees: Oticon A/S
- Applicants: Oticon A/S
- Inventors: Thomas Lunner; Fredrik Gustafsson; David Lindgren; Gustaf Hendeby
- Web page: https://patentgrep.com/patent/US10321241B2

## CPC

- H04R 25/407: {Circuits for combining signals of a plurality of transducers}
- G01S 3/8006: {Multi-channel systems specially adapted for direction-finding, i.e. having a single aerial system capable of giving simultaneous indications of the directions of different signals}
- G01S 3/801: Details {(G01S3/82, G01S3/84, G01S3/86 take precedence)}
- G01S 3/8083: {determining direction of source}
- H04R 25/402: {using contructional means}
- H04R 25/405: {by combining a plurality of transducers}
- H04R 25/505: {using digital signal processing}
- H04R 25/554: {using a wireless connection, e.g. between microphone and amplifier or using Tcoils}
- H04R 25/558: {Remote control, e.g. of amplification, frequency}
- G10L 2021/02166: {Microphone arrays; Beamforming}
- H04R 25/40: {Arrangements for obtaining a desired directivity characteristic}
- H04R 2203/12: Beamforming aspects for stereophonic sound reproduction with loudspeaker arrays
- H04R 2225/0216: BTE hearing aids having a receiver in the ear mould
- H04R 2225/025: In the ear hearing aids [ITE] hearing aids
- H04R 2225/55: Communication between hearing aids and external devices via a network for data exchange
- H04R 2430/23: Direction finding using a sum-delay beam-former
- H04R: LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS (producing sounds with frequency not determined by supply frequency G10K)
- G01S: RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING

## Abstract

A hearing device comprises a sound system for estimating the direction of arrival of sound emitted by one or more sound sources creating a sound field. The sound system comprises an array of N sound receiving transducers (microphones), each providing an electric input signal, a processing unit comprising a) a model unit comprising a parametric model configured to be able to describe the sound field at the array as a function of the direction of arrival in a region surrounding and adjacent to the array; b) a model optimizing unit configured to optimize said model with respect to its parameters based on said sound samples; c) a cost optimizing unit configured to minimize a cost function of the model with respect to said direction of arrivals; d) an estimating unit configured to estimate the direction of arrival based on said parametric model with the optimized parameters and the optimized cost function.

## Claims

### Claim 1

A hearing aid, comprising:
a sound system for estimating the direction of arrival of a sound signal emitted from one or more sound sources, the system comprising:
a sound sensor unit comprising an array of N sound receiving transducers, each providing an electric input signal;
a sampling unit for providing at least one sample of said surrounding sound field from each of said electric input signals at substantially the same time instant; and
a processing unit comprising
a model unit comprising a parametric model configured to be able to describe the sound field at the array as a function of the direction of arrival in a region surrounding and adjacent to the array;
a model optimizing unit configured to optimize said model with respect to its parameters based on said sound samples;
a cost optimizing unit configured to minimize a cost function of the model with respect to said direction of arrivals; and
an estimating unit configured to estimate the direction of arrival based on said parametric model with the optimized parameters and the optimized cost function.

### Claim 2 (depends on 1)

A hearing device according to claim 1, wherein said array of sound sensitive sensors is or comprises an array of microphones configured to be worn by a user.

### Claim 3 (depends on 1)

A hearing device according to claim 1 wherein said array of sound sensitive sensors comprises microphones integrated on a chip, or MEMS microphones.

### Claim 4 (depends on 1)

A hearing device according to claim 1 wherein the number N of sound sensitive sensors is larger than 3.

### Claim 5 (depends on 1)

A hearing device according to claim 1 configured to provide that the distance between adjacent sound sensitive sensors is smaller than 0.01 m.

### Claim 6 (depends on 1)

A hearing device according to claim 1 comprising a beamformer filtering unit for providing a beamformed signal based on one or more beamformer input signals representing said surrounding sound field, and configured to use said estimate the direction of arrival in the determination of the beamformed signal.

### Claim 7 (depends on 6)

A hearing device according to claim 6 configured to provide that said beamformer filtering unit receives at least some of said electric input signals from said sound sensor array, and provides said beamformed signal as a weighted combination of said at least some of said electric input signals and possibly further electric input signals.

### Claim 8 (depends on 6)

A hearing device according to claim 6, wherein
the hearing device is configured to estimate a direction of arrival of a multitude of active target sound sources, and
the beamformer filtering unit is configured to determine a beam pattern based on estimates of direction of arrival of a multitude of active target sound sources.

### Claim 9 (depends on 8)

A hearing device according to claim 8 configured to activate beams at different direction of arrivals at the same time.

### Claim 10 (depends on 1)

A hearing device according to claim 1 comprising a filter configured to isolate a fundamental frequency of the electric input signals corresponding to a human voice from higher lying harmonics and providing respective filtered electric input signals, and to use such filtered electric input signals for identification of the direction of arrival.

### Claim 11 (depends on 1)

A hearing device according to claim 1 comprising a tracking unit configured to track one or more sound sources over time.

### Claim 12 (depends on 1)

A hearing device according to claim 1 configured to estimate a direction of arrival to a multitude of active target sound sources.

### Claim 13 (depends on 1)

A hearing device according to claim 1 comprising a network of arrays of sound sensitive sensors.

### Claim 14 (depends on 1)

A hearing device according to claim 1 wherein the hearing aid comprises a behind-the-ear hearing aid or an in-the-ear hearing aid or hearing glasses or a headband.

### Claim 15 (depends on 1)

A hearing device according to claim 1 comprising a user interface allowing a user to control functionality of the device.

### Claim 16 (depends on 1)

A non-transitory computer readable medium having stored on application, termed an APP, comprising executable instructions configured to be executed on an auxiliary device to implement a user interface for a hearing device as described in claim 1.

### Claim 17 (depends on 16)

An APP according to claim 16 configured to run on a cellular phone or on another portable device allowing communication with said hearing device.

### Claim 18

A method for estimating the direction of arrival of sound emitted by one or more sound sources creating a sound field in the surroundings of the one or more sound sources, the method comprising:
providing, using an array of sound sensitive sensors of a hearing aid, an electric input signal, from each sensor, comprising a stream of digital samples representing the sound field of the surroundings;
providing, using a sampling unit of the hearing aid, at least one sample of said surrounding sound field from each of said sensors at substantially the same time instant;
providing, using a processing unit of the hearing aid, a parametric model configured to be able to describe the sound field as a function of the direction of arrival in a region surrounding and adjacent to said array;
optimizing, using a processing unit of the hearing aid, said model with respect to its parameters based on said sound samples;
minimizing, using the processing unit of the hearing aid, a cost function of the model with respect to said direction of arrivals; and
estimate, using the processing unit of the hearing aid, the direction of arrival based on said parametric model with the optimized parameters and the optimized cost function.

### Claim 19 (depends on 18)

A method according to claim 18, wherein said model is a Taylor expansion model and the sound signal received at each of said respective sensor is decomposed in a Taylor series expansion of order L, in which the signal derivatives are determined by a linear least squares method, and wherein the direction of arrival □ is estimated by the expression:
where ∥⋅∥2 represents the least squares loss (or error) function, z is a mixed signal comprising sound signal s and additional noise ϵ, and T(θ) is a vector comprising the first L Taylor expansion coefficients.
