# US 10,873,813 B2 · Method and apparatus for audio pass-through

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 10,873,813 B2
- Document ID: US10873813B2
- Status: Granted
- Kind: B2
- Application number: 16/237,577
- Filed: 2018-12-31
- Published: 2019-07-11
- Granted: 2020-12-22
- Earliest claimed: 2017-02-24
- Assignees: Fitbit, Inc.
- Applicants: Fitbit, Inc.
- Inventors: Michael Pate; Morgan Pate
- Web page: https://patentgrep.com/patent/US10873813B2

## CPC

- H04R 5/04: Circuit arrangements, {e.g. for selective connection of amplifier inputs/outputs to loudspeakers, for loudspeaker detection, or for adaptation of settings to personal preferences or hearing impairments (combinations of amplifiers H03F3/68; stereophonic systems H04S)}
- G06F 3/165: {Management of the audio stream, e.g. setting of volume, audio stream path}
- H04R 1/1041: {Mechanical or electronic switches, or control elements (switches in general H01H)}
- H04R 1/1083: {Reduction of ambient noise (active noise reduction per se G10K11/175; protective devices for the ear, e.g. providing acoustic protection A61F11/06)}
- H04S 7/303: {Tracking of listener position or orientation}
- H04S 7/304: {For headphones}
- H04R 5/033: Headphones for stereophonic communication {(details thereof, e.g. relating to batteries, cables or control elements H04R1/10)}
- H04R 2420/01: Input selection or mixing for amplifiers or loudspeakers
- H04R 2420/07: Applications of wireless loudspeakers or wireless microphones
- H04R 2430/01: Aspects of volume control, not necessarily automatic, in sound systems
- H04R 2460/01: Hearing devices using active noise cancellation
- H04R 2460/07: Use of position data from wide-area or local-area positioning systems in hearing devices, e.g. program or information selection
- H04R: LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS (producing sounds with frequency not determined by supply frequency G10K)
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- H04S: STEREOPHONIC SYSTEMS

## Abstract

Methods and apparatuses for audio pass-through are disclosed. In one aspect, a method of operating a wearable audio device may involve receiving an ambient audio signal, detecting a first audio signal from within the received ambient audio signal, and determining that the first audio signal meets a first metric for pass-through to a user of the wearable audio device. The first metric may be indicative of a first priority level of the first audio signal to the user. The method may further involve isolating the first audio signal based on filtering the ambient audio signal in response to determining that the first audio signal meets the first metric and adjusting playback of the isolated first audio signal for the user via a speaker.

## Claims

### Claim 1

A system, comprising:
a speaker;
a microphone;
a processor; and
memory including instructions that, when executed by the at least one processor, cause the system to:
detect a first audio signal within a received ambient audio signal, the received ambient audio signal including the first audio signal and background noise;
determine the first audio signal meets a priority level, the priority level based at least in part on a characteristic of the first audio signal;
isolate the first audio signal from the ambient audio signal to generate an isolated first audio signal, absent the background noise;
play the isolated first audio signal via the speaker;
receive feedback, from a user, in response to the isolated first audio signal, after the isolated first audio signal is played via the speaker; and
in response to the feedback, adjust the priority level.

### Claim 2 (depends on 1)

The system of claim 1, wherein the feedback includes movement of the user, an auditory response from the user, a tactile response from the user, or a signal received from a secondary device.

### Claim 3 (depends on 1)

The system of claim 1, wherein the instructions when executed further cause the system to:
receive, from a secondary device, information regarding a remote audio signal;
prompt the user to accept or reject playback of the remote audio signal; and
receive, from the secondary device, the remote audio signal after the user accepts playback.

### Claim 4 (depends on 1)

The system of claim 1, wherein the instructions when executed further cause the system to:
receive a second audio signal within a second received ambient audio signal;
isolate the second audio signal from the ambient audio signal to generate an isolated second audio signal;
determine the isolated second audio signal fails to meet the priority level for pass-through to the user;
determine the isolated second audio signal meets a second priority level for pass-through to the user, the second priority level being lower than the priority level;
prompt the user to accept or reject playback of the second isolated remote audio signal; and
play the second isolated remote audio signal, via the speaker, in response to the user accepting playback.

### Claim 5 (depends on 4)

The system of claim 4, wherein the instructions when executed further cause the system to:
adjust the second priority level in response to the user rejecting playback.

### Claim 6 (depends on 1)

The system of claim 1, wherein the instructions when executed further cause the system to:
calculate a distance from the microphone to the source of the first audio signal; and
determine the first audio signal fails to meet the priority level when the distance exceeds a threshold amount; and
disregard the first audio signal.

### Claim 7 (depends on 6)

The system of claim 6, wherein the priority level is based, at least partially, on the distance of the source of the first audio signal from the microphone.

### Claim 8 (depends on 1)

The system of claim 1, wherein the priority level is based, at least in part, on a source of the first audio signal, a volume of the first audio signal, a frequency of the first audio signal, a keyword within the first audio signal, or a combination thereof.

### Claim 9

A computer-implemented method, comprising:
detecting a first audio signal within a received ambient audio signal, the received ambient audio signal including the first audio signal and background noise;
determining the first audio signal meets a priority level, the priority level based at least in part on a characteristic of the first audio signal;
isolating the first audio signal from the ambient audio signal to generate an isolated first audio signal, absent the background noise;
playing the isolated first audio signal;
receiving feedback, from a user, in response to the isolated first audio signal, after the isolated first audio signal is played; and
in response to the feedback, adjusting the priority level.

### Claim 10 (depends on 9)

The method of claim 9, wherein the feedback includes movement of the user, an auditory response from the user, a tactile response from the user, or a signal received from a secondary device.

### Claim 11 (depends on 9)

The method of claim 9, further comprising:
receiving, from a secondary device, information regarding a remote audio signal;
prompting the user to accept or reject playback of the remote audio signal; and
receiving, from the secondary device, the remote audio signal.

### Claim 12 (depends on 9)

The method of claim 9, further comprising:
receiving a second audio signal within a second received ambient audio signal;
isolating the second audio signal from the ambient audio signal to generate an isolated second audio signal;
determining the isolated second audio signal fails to meet the priority level for pass-through to the user;
determining the isolated second audio signal meets a second priority level for pass-through to the user, the second priority level being lower than the priority level;
prompting the user to accept or reject playback of the second isolated remote audio signal; and
playing the second isolated remote audio signal, in response to the user accepting playback.

### Claim 13 (depends on 12)

The method of claim 12, further comprising:
adjusting the second priority level in response to the user rejecting playback.

### Claim 14 (depends on 9)

The method of claim 9, further comprising:
calculating a distance from a microphone to the source of the first audio signal; and
determining the first audio signal fails to meet the priority level when the distance exceeds a threshold amount; and
disregarding the first audio signal.

### Claim 15 (depends on 14)

The method of claim 14, wherein the priority level is based, at least partially, on the distance of the source of the first audio signal from the microphone.

### Claim 16 (depends on 9)

The method of claim 9, wherein the priority level is based, at least in part, on a source of the first audio signal, a volume of the first audio signal, a frequency of the first audio signal, a keyword within the first audio signal, or a combination thereof.

### Claim 17

A system, comprising:
a speaker;
a microphone;
a processor; and
memory including instructions that, when executed by the at least one processor, cause the system to:
detect a first audio signal within a received ambient audio signal, the received ambient audio signal including the first audio signal and background noise;
determine the first audio signal meets a priority level for pass-through to a user, the priority level associated, at least in part, with a predetermined property of the first audio signal;
isolate the first audio signal from the ambient audio signal to generate an isolated first audio signal, absent the background noise;
play the isolated first audio signal, via the speaker;
receive first feedback, from the user, after the isolated first audio signal is played via the speaker;
receive second feedback, from the user, in response to the isolated first audio signal; and
stop playing the isolated first audio signal, in response to the second feedback.

### Claim 18 (depends on 17)

The system of claim 17, wherein the instructions when executed further cause the system to:
in response to the first feedback, adjust the priority level.

### Claim 19 (depends on 17)

The system of claim 17, wherein the priority level is based, at least in part, on a source of the first audio signal, a volume of the first audio signal, a frequency of the first audio signal, a keyword within the first audio signal, or a combination thereof.

### Claim 20 (depends on 17)

The system of claim 17, wherein the instructions when executed further cause the system to:
receive a second audio signal within a second received ambient audio signal;
isolate the second audio signal from the ambient audio signal to generate an isolated second audio signal;
determine the isolated second audio signal fails to meet the priority level for pass-through to the user;
determine the isolated second audio signal meets a second priority level for pass-through to the user, the second priority level being lower than the priority level;
prompt the user to accept or reject playback of the second isolated remote audio signal; and
play the second isolated remote audio signal, via the speaker, in response to the user accepting playback.
