# US 2026/0095710 A1 · Estimation of hearing loss of a user from interactions with a local environment by the user identified from captured audio and information describing the local area

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2026/0095710 A1
- Document ID: US20260095710A1
- Status: Published application
- Kind: A1
- Application number: 19/413,913
- Filed: 2025-12-09
- Published: 2026-04-02
- Earliest claimed: 2022-04-24
- Assignees: Meta Platforms Technologies, LLC
- Applicants: Meta Platforms Technologies, LLC
- Inventors: Christi Miller; Sara Ng; Calvin Murdock; Nils Thomas Fritiof Lunner; William Owen Brimijoin, II; Vamsi Krishna Ithapu
- Web page: https://patentgrep.com/patent/US20260095710A1

## CPC

- A61B 5/125: {objective methods}
- H04R 25/70: {Adaptation of deaf aid to hearing loss, e.g. initial electronic fitting}
- A61B 5/121: {evaluating hearing capacity}
- A61B 5/6814: {Head}
- H04R 2225/41: Detection or adaptation of hearing aid parameters or programs to listening situation, e.g. pub, forest
- A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D)
- H04R: LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS (producing sounds with frequency not determined by supply frequency G10K)

## Abstract

An audio system includes one or more acoustic sensors capturing audio from a local area surrounding the audio system and one or more additional sensors capturing data describing the local area. An audio controller in the audio system identifies interactions by a user based on the captured audio and the data describing the local area. The audio controller determines attributes associated with each interaction, such as metrics describing speaking by the user, metrics describing requests for clarification by the user, and metrics based on a topic determined from audio captured by the user. Based on the interactions and associated attributes, the audio controller estimates a sound profile for the user that identifies ranges of frequencies where the user has hearing loss. The audio controller may leverage the sound profile to determine one or more filters to offset hearing loss of the user.

## Claims

### Claim 1

A method comprising:
capturing audio from a local area surrounding an audio controller using one or more acoustic sensors;
capturing information describing the local area from one or more additional sensors;
identifying, by the audio controller, one or more interactions with the local area by a user based on the captured audio and the information describing the local area; and
estimating a sound profile of the user from the identified one or more interactions and attributes associated with the one or more interactions, the sound profile identifying hearing loss of the user for one or more ranges of frequencies,
wherein an attribute associated with an interaction includes at least one of:
an indication whether a sound source providing audio during the interaction is within a field of view of an imaging device that overlaps with a field of view of the user;
data describing repair initiations by the user during the interaction, a repair initiation indicating initiation of a request for clarification of audio from a sound source providing audio during the interaction;
one or more turn-taking metrics for the interaction, a turn-taking metric describing speaking activity by the user during the interaction; or
a semantic metric based on a topic determined for captured audio from the user during the interaction.

### Claim 2 (depends on 1)

The method of claim 1, further comprising:
determining one or more filters to apply to audio for presentation to the user based on the sound profile;
generating augmented audio by applying the one or more filters to the audio for presentation to the user, the augmented audio increasing an amplitude of a portion of the audio having frequencies within a range of frequencies for which the sound profile identifies hearing loss; and
presenting the augmented audio to the user through one or more transducers.

### Claim 3 (depends on 1)

The method of claim 1, wherein estimating the sound profile of the user from the identified one or more interactions and attributes associated with the one or more interactions comprises:
applying a model to the identified one or more interactions and attributes associated with the one or more interactions, the model outputting the sound profiles based on the identified one or more interactions and attributes associated with the one or more interactions.

### Claim 4 (depends on 1)

The method of claim 1, wherein the attribute associated with the interaction includes an indication whether a sound source providing audio during the interaction is within a field of view of an imaging device that overlaps with a field of view of the user.

### Claim 5 (depends on 1)

The method of claim 1, wherein the attribute associated with the interaction is a location of a sound source providing audio during the interaction relative to the audio controller.

### Claim 6 (depends on 1)

The method of claim 1, wherein the attribute associated with the interaction includes data describing repair initiations by the user during the interaction, a repair initiation indicating initiation of a request for clarification of audio from a sound source providing audio during the interaction.

### Claim 7 (depends on 1)

The method of claim 1, wherein the attribute associated with the interaction includes one or more turn-taking metrics for the interaction, a turn-taking metric describing speaking activity by the user during the interaction.

### Claim 8 (depends on 7)

The method of claim 7, wherein the turn-taking metric is selected from a group consisting of: a length of time the user produces audio during the interaction, a percentage of time the user produces audio during the interaction, an amount of time between a sound source providing audio during the interaction and the user providing audio during the interaction, and any combination thereof.

### Claim 9 (depends on 1)

The method of claim 1 wherein the attribute associated with the interaction includes a semantic metric based on a topic determined for captured audio from the user during the interaction.

### Claim 10

A computer program product comprising a non-transitory computer-readable storage medium having instructions encoded thereon that, when executed by a processor, cause the processor to:
capture audio from a local area surrounding an audio controller using one or more acoustic sensors;
capture information describing the local area from one or more additional sensors;
identify, by the audio controller, one or more interactions with the local area by a user based on the captured audio and the information describing the local area; and
estimate a sound profile of the user from the identified one or more interactions and attributes associated with the one or more interactions, the sound profile identifying hearing loss of the user for one or more ranges of frequencies,
wherein an attribute associated with an interaction includes at least one of:
an indication whether a sound source providing audio during the interaction is within a field of view of an imaging device that overlaps with a field of view of the user;
data describing repair initiations by the user during the interaction, a repair initiation indicating initiation of a request for clarification of audio from a sound source providing audio during the interaction;
one or more turn-taking metrics for the interaction, a turn-taking metric describing speaking activity by the user during the interaction; or
a semantic metric based on a topic determined for captured audio from the user during the interaction.

### Claim 11 (depends on 10)

The computer program product of claim 10, wherein the non-transitory computer-readable storage medium further has instructions encoded thereon that, when executed by the processor, cause the processor to:
determine one or more filters to apply to audio for presentation to the user based on the sound profile;
generate augmented audio by applying the one or more filters to the audio for presentation to the user, the augmented audio increasing an amplitude of a portion of the audio having frequencies within a range of frequencies for which the sound profile identifies hearing loss; and
present the augmented audio to the user through one or more transducers.

### Claim 12 (depends on 10)

The computer program product of claim 10, wherein estimate the sound profile of the user from the identified one or more interactions and attributes associated with the one or more interactions comprises:
apply a model to the identified one or more interactions and attributes associated with the one or more interactions, the model outputting the sound profiles based on the identified one or more interactions and attributes associated with the one or more interactions.

### Claim 13 (depends on 10)

The computer program product of claim 10, wherein the attribute associated with the interaction includes an indication whether a sound source providing audio during the interaction is within a field of view of an imaging device that overlaps with a field of view of the user.

### Claim 14 (depends on 10)

The computer program product of claim 10, wherein the attribute associated with the interaction includes a location of a sound source providing audio during the interaction relative to the audio controller.

### Claim 15 (depends on 10)

The computer program product of claim 10, wherein the attribute associated with the interaction includes data describing repair initiations by the user during the interaction, a repair initiation indicating initiation of a request for clarification of audio from a sound source providing audio during the interaction.

### Claim 16 (depends on 10)

The computer program product of claim 10, wherein the attribute associated with the interaction includes one or more turn-taking metrics for the interaction, a turn-taking metric describing speaking activity by the user during the interaction.

### Claim 17 (depends on 16)

The computer program product of claim 16, wherein the turn-taking metric is selected from a group consisting of: a length of time the user produces audio during the interaction, a percentage of time the user produces audio during the interaction, an amount of time between a sound source providing audio during the interaction and the user providing audio during the interaction, and any combination thereof.

### Claim 18 (depends on 10)

The computer program product of claim 10, wherein the attribute associated with the interaction includes a semantic metric based on a of a topic determined for captured audio from the user during the interaction.

### Claim 19

A headset comprising:
a frame;
one or more display elements coupled to the frame, each display element configured to generate image light for presentation to a user;
one or more acoustic sensors configured to capture audio from a local area surrounding the headset;
one or more additional sensors configured to capture information describing the local area surrounding the headset; and
an audio controller including a processor and a non-transitory computer readable storage medium having instructions encoded thereon that, when executed by the processor, cause the processor to:
identify, by the audio controller, one or more interactions with the local area by a user based on the captured audio and the information describing the local area; and
estimate a sound profile of the user from the identified one or more interactions and attributes associated with the one or more interactions, the sound profile identifying hearing loss of the user for one or more ranges of frequencies,
wherein an attribute associated with an interaction includes at least one of:
an indication whether a sound source providing audio during the interaction is within a field of view of an imaging device that overlaps with a field of view of the user;
data describing repair initiations by the user during the interaction, a repair initiation indicating initiation of a request for clarification of audio from a sound source providing audio during the interaction;
one or more turn-taking metrics for the interaction, a turn-taking metric describing speaking activity by the user during the interaction; or
a semantic metric based on a topic determined for captured audio from the user during the interaction.

### Claim 20 (depends on 19)

The headset of claim 19, further comprising a transducer array for presenting audio to a user, and wherein the audio controller further includes instructions encoded thereon that, when executed by the processor, cause the processor to:
determine one or more filters to apply to audio for presentation to the user based on the sound profile;
generate augmented audio by applying the one or more filters to the audio for presentation to the user, the augmented audio increasing an amplitude of a portion of the audio having frequencies within a range of frequencies for which the sound profile identifies hearing loss; and
present the augmented audio to the user through one or more transducers.
