# US 2022/0286788 A1 · Ear-mountable listening device with voice direction discovery for rotational correction of microphone array outputs

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2022/0286788 A1
- Document ID: US20220286788A1
- Status: Published application
- Kind: A1
- Application number: 17/192,652
- Filed: 2021-03-04
- Published: 2022-09-08
- Earliest claimed: 2021-03-04
- Assignees: Iyo Inc.
- Applicants: Iyo Inc.
- Inventors: Simon Carlile; Devansh Gupta; Jason Rugolo
- Web page: https://patentgrep.com/patent/US20220286788A1

## CPC

- H04R 25/407: {Circuits for combining signals of a plurality of transducers}
- H04R 1/1016: {Earpieces of the intra-aural type}
- H04R 1/406: {microphones}
- H04R 25/405: {by combining a plurality of transducers}
- H04R 25/505: {using digital signal processing}
- H04R 25/552: {Binaural}
- H04R 25/604: {of acoustic or vibrational transducers}
- H04S 7/30: {Control circuits for electronic adaptation of the sound field}
- H04R 1/1041: {Mechanical or electronic switches, or control elements (switches in general H01H)}
- H04R 3/005: {for combining the signals of two or more microphones (specially adapted for hearing aids H04R25/407)}
- H04R 25/60: {Mounting or interconnection of hearing aid parts, e.g. inside tips, housings or to ossicles (ear wax retarders, e.g. mounting thereof H04R25/654)}
- H04R 25/652: {Ear tips; Ear moulds (hybrid ear moulds or post-processing thereof for their customisation H04R25/659)}
- H04R 2201/401: 2D or 3D arrays of transducers
- H04R 2225/43: Signal processing in hearing aids to enhance the speech intelligibility
- H04R 2225/61: Aspects relating to mechanical or electronic switches or control elements, e.g. functioning
- H04R 2430/23: Direction finding using a sum-delay beam-former
- H04R 2430/25: Array processing for suppression of unwanted side-lobes in directivity characteristics, e.g. a blocking matrix
- H04R 2460/01: Hearing devices using active noise cancellation
- H04S 2400/15: Aspects of sound capture and related signal processing for recording or reproduction
- H04S 2420/01: Enhancing the perception of the sound image or of the spatial distribution using head related transfer functions [HRTF's] or equivalents thereof, e.g. interaural time difference [ITD] or interaural level difference [ILD]
- H04R: LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS (producing sounds with frequency not determined by supply frequency G10K)
- H04S: STEREOPHONIC SYSTEMS

## Abstract

Techniques described herein include generating first audio signals representative of sounds emanating from an environment and captured with an array of microphones disposed within an ear-mountable listing device. A rotational position of the array of microphones is determined. A rotational correction is applied to the first audio signals to generate a second audio signal. The rotational correction is based at least in part upon the determined rotational position. A speaker of the ear-mountable listening device is driven with the second audio signal to output audio into an ear.

## Claims

### Claim 1

An ear-mountable listening device, comprising:
an array of microphones configured to capture sounds emanating from an environment and output first audio signals representative of the sounds, wherein the array of microphones has a rotational position that is variable relative to an ear of a user when the ear-mountable listening device is mounted to the ear or is variable while the ear-mountable listening device is worn in the ear;
a speaker arranged to emit audio into the ear in response to a second audio signal; and
electronics coupled to the array of microphones and the speaker, the electronics including logic that when executed by the electronics causes the ear-mountable listening device to perform operations including:
discovering a direction of incidence of a voice of the user upon the array of microphones mounted to the ear of the user; and
applying a rotational correction to the first audio signals to generate the second audio signal that drives the speaker, wherein the rotational correction is based at least in part upon the direction of incidence of the voice.

### Claim 2 (depends on 1)

The ear-mountable listening device of claim 1, wherein the electronics include further logic that when executed by the electronics causes the ear-mountable listening device to perform further operations comprising:
determining a rotational position of the array of microphones relative to a mouth of the user based upon the direction of incidence of the voice; and
applying an ear-to-mouth angular offset to the rotational position to determine the rotational correction.

### Claim 3 (depends on 2)

The ear-mountable listening device of claim 2, wherein the ear-to-mouth angular offset is a customized value calibrated on a per user basis.

### Claim 4 (depends on 3)

The ear-mountable listening device of claim 3, wherein the ear-to-mouth angular offset is based upon at least one of a profile picture of the user or execution of an initial voice direction discover routine.

### Claim 5 (depends on 1)

The ear-mountable listening device of claim 1, further comprising:
an internal microphone coupled to the electronics and oriented within the ear-mountable listening device to focus on the voice emanating via an ear canal when the ear-mountable listening device is worn,
wherein the electronics include further logic that when executed by the electronics causes the ear-mountable listening device to perform further operations comprising:
monitoring the internal microphone for the voice; and
commencing discovering the direction of incidence after the voice exceeds a threshold level as measured by the internal microphone.

### Claim 6 (depends on 1)

The ear-mountable listening device of claim 1, wherein the electronics include further logic that when executed by the electronics causes the ear-mountable listening device to perform further operations comprising:
monitoring an inertial monitoring unit (IMU) of the ear-mountable listening device; and
commencing discovering the direction of incidence of the voice when a motion or an orientation of the ear-mountable listening device falls within one or more prescribed ranges.

### Claim 7 (depends on 1)

The ear-mountable listening device of claim 1, wherein discovering the direction of the voice comprises one or more of:
comparing relative times of arrival of sounds across the array of microphones;
comparing sound amplitudes across the array of microphones; or
beamforming the microphone array to identify the direction of incidence.

### Claim 8 (depends on 1)

The ear-mountable listening device of claim 1, wherein the array of microphones is disposed within a rotatable component of the ear-mountable listening device, the rotatable component rotatable to provide a user interface for controlling at least one user selectable function of the ear-mountable listening device.

### Claim 9 (depends on 1)

The ear-mountable listening device of claim 1, wherein the rotational correction applied to the first audio signals comprises a rotational transformation applied by the electronics to the first audio signals that preserves spaciousness of the sounds emanating from the environment such that the user can localize the sounds based upon the audio output from the speaker despite rotation of the array of microphones.

### Claim 10 (depends on 1)

The ear-mountable listening device of claim 1, wherein the electronics include further logic that when executed by the electronics causes the ear-mountable listening device to perform further operations comprising:
reasserting a head related transfer function (HRTF) of the user with the audio output from the speaker despite rotation of the array of microphones.

### Claim 11 (depends on 1)

The ear-mountable listening device of claim 1, wherein the electronics include further logic that when executed by the electronics causes the ear-mountable listening device to perform further operations comprising:
determining the rotational correction based at least in part upon a direction indication output from an inertial measurement unit (IMU) of the ear-mountable listening device that changes with rotation of the rotational position of the array of microphones.

### Claim 12

A method of operation of an ear-mountable listening device, the method comprising:
generating first audio signals representative of sounds emanating from an environment and captured with an array of microphones of the ear-mountable listing device mounted to an ear;
determining a rotational position of the array of microphones;
applying a rotational correction to the first audio signals to generate a second audio signal, wherein the rotational correction is based at least in part upon the rotational position; and
driving a speaker of the ear-mountable listening device with the second audio signal to output audio into the ear.

### Claim 13 (depends on 12)

The method of claim 12, further comprising:
sensing a rotational change of the array of microphones; and
revising the rotational correction applied to the first audio signals based upon the rotational change.

### Claim 14 (depends on 13)

The method of claim 13, further comprising:
adjusting a user function of the ear-mountable listening device in response to the rotational change.

### Claim 15 (depends on 14)

The method of claim 14, wherein adjusting the user function in response to the rotational change comprises:
adjusting a volume of the speaker in response to the rotational change of the array of microphones, wherein the array of microphones is disposed within a rotatable component of the ear-mountable listening device.

### Claim 16 (depends on 12)

The method of claim 12, wherein determining the rotational position of the array of microphones comprises:
discovering a direction of incidence of a voice of a user upon the array of microphones while the ear-mountable listening device is worn in the ear of the user; and
applying an ear-to-mouth angular offset to the direction of incidence.

### Claim 17 (depends on 16)

The method of claim 16, wherein the ear-to-mouth angular offset is determined based upon at least one of a profile picture of the user or execution of an initial voice direction discover routine.

### Claim 18 (depends on 16)

The method of claim 16, further comprising:
monitoring an internal microphone of the ear-mountable listening device for the voice, wherein the internal microphone is positioned and oriented within the ear-mountable listening device to focus on the voice emanating via an ear canal of the user when the ear-mountable listening device is worn in the ear; and
commencing discovering the direction of incidence after the voice exceeds a threshold level as measured by the internal microphone.

### Claim 19 (depends on 18)

The method of claim 18, wherein discovering the direction of the voice comprises one or more of:
comparing relative times of arrival of sounds across the array of microphones;
comparing sound amplitudes across the array of microphones; or
beamforming the microphone array to identify the direction of incidence.

### Claim 20 (depends on 12)

The method of claim 12, wherein the rotational correction applied to the first audio signals comprises a rotational transformation applied by electronics of the ear-mountable listening device to the first audio signals that preserves spaciousness of the sounds emanating from the environment such that the user can localize the sounds based upon the audio output from the speaker despite rotation of the array of microphones.
