# US 2020/0404445 A1 · Audio system for artificial reality environment

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2020/0404445 A1
- Document ID: US20200404445A1
- Status: Published application
- Kind: A1
- Application number: 16/836,430
- Filed: 2020-03-31
- Published: 2020-12-24
- Earliest claimed: 2019-06-24
- Assignees: Facebook Technologies, LLC
- Applicants: Facebook Technologies, LLC
- Inventors: Sebastià Vicenç Amengual Gari; Carl Schissler; Peter Henry Maresh; Andrew Lovitt; Philip Robinson
- Web page: https://patentgrep.com/patent/US20200404445A1

## CPC

- H04S 7/304: {For headphones}
- G10L 21/0232: Processing in the frequency domain
- H04R 3/04: for correcting frequency response
- H04R 5/033: Headphones for stereophonic communication {(details thereof, e.g. relating to batteries, cables or control elements H04R1/10)}
- H04R 5/04: Circuit arrangements, {e.g. for selective connection of amplifier inputs/outputs to loudspeakers, for loudspeaker detection, or for adaptation of settings to personal preferences or hearing impairments (combinations of amplifiers H03F3/68; stereophonic systems H04S)}
- H04S 3/008: {in which the audio signals are in digital form, i.e. employing more than two discrete digital channels (data reduction aspects thereof based on psychoacoustics G10L19/02)}
- H04S 7/306: {For headphones}
- H04S 2400/01: Multi-channel, i.e. more than two input channels, sound reproduction with two speakers wherein the multi-channel information is substantially preserved
- H04S 2400/15: Aspects of sound capture and related signal processing for recording or reproduction
- H04S 2420/01: Enhancing the perception of the sound image or of the spatial distribution using head related transfer functions [HRTF's] or equivalents thereof, e.g. interaural time difference [ITD] or interaural level difference [ILD]
- H04S: STEREOPHONIC SYSTEMS
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- H04R: LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS (producing sounds with frequency not determined by supply frequency G10K)

## Abstract

An audio system on a headset presents, to a user, audio content simulating a target artificial reality environment. The system receives audio content from an environment and analyzes the audio content to determine a set of acoustic properties associated with the environment. The audio content may be user generated or ambient sound. After receiving a set of target acoustic properties for a target environment, the system determines a transfer function by comparing the set of acoustic properties and the target environment's acoustic properties. The system adjusts the audio content based on the transfer function and presents the adjusted audio content to the user. The presented adjusted audio content includes one or more of the target acoustic properties for the target environment.

## Claims

### Claim 1

A method comprising:
comparing acoustic properties of an environment to target acoustic properties of a target environment;
adjusting audio content based on the comparison of the acoustic properties to the target acoustic properties; and
presenting the adjusted audio content to a user, wherein the adjusted audio content is perceived by the user to have been generated in the target environment.

### Claim 2 (depends on 1)

The method of claim 1, wherein adjusting the audio content based on the comparison of the acoustic properties to the target acoustic properties comprises:
identifying ambient sound in the environment; and
filtering the ambient sound out of the adjusted audio content for the user.

### Claim 3 (depends on 1)

The method of claim 1, further comprising:
providing the user with a plurality of target environment options, each of the plurality of target environment options corresponding to a different target environment; and
receiving, from the user, a selection of the target environment from the plurality of target environment options.

### Claim 4 (depends on 3)

The method of claim 3, wherein each of the plurality of target environment options is associated with a different set of acoustic properties for the target environment.

### Claim 5 (depends on 1)

The method of claim 1, further comprising:
determining an original response characterizing the set of acoustic properties associated with the environment; and
determining a target response characterizing the set of target acoustic properties for the target environment.

### Claim 6 (depends on 5)

The method of claim 5, further comprising:
determining a transfer function, the determining comprising:
comparing the original response and the target response; and
determining, based on the comparison, differences between the set of acoustic parameters associated with the environment and the set of acoustic parameters associated with the target environment.

### Claim 7 (depends on 6)

The method of claim 6, further comprising:
generating sound filters using the transfer function, wherein the adjusted audio content is based in part on the sound filters.

### Claim 8 (depends on 6)

The method of claim 6, wherein determining the transfer function is based on at least one previously measured room impulse or algorithmic reverberation.

### Claim 9 (depends on 6)

The method of claim 6, wherein adjusting the audio content further comprises:
receiving audio content generated within the environment; and
convolving the transfer function with the received audio content.

### Claim 10 (depends on 9)

The method of claim 9, wherein the received audio content is generated by at least one user of a plurality of users.

### Claim 11

An audio system comprising:
one or more sensors configured to receive audio content within an environment;
one or more speakers configured to present audio content to a user; and
a controller configured to:
compare acoustic properties of the environment to target acoustic properties of a target environment; and
adjust audio content based on the comparison of the acoustic properties to the target acoustic properties such that the adjusted audio content is perceived by the user to have been generated in the target environment.

### Claim 12 (depends on 11)

The system of claim 11, wherein the audio system is part of a headset.

### Claim 13 (depends on 11)

The system of claim 11, wherein adjusting the audio content further comprises:
identifying ambient sound in the environment; and
filtering the ambient sound out of the adjusted audio content for the user.

### Claim 14 (depends on 11)

The system of claim 11, wherein the controller is further configured to:
provide the user with a plurality of target environment options, each of the plurality of target environment options corresponding to a different target environment; and
receive, from the user, a selection of the target environment from the plurality of target environment options.

### Claim 15 (depends on 14)

The system of claim 14, wherein each of the plurality of target environment options is associated with a set of target acoustic properties for the target environment.

### Claim 16 (depends on 11)

The system of claim 11, wherein the controller is further configured to:
determine an original response characterizing the set of acoustic properties associated with the environment; and
determine a target response characterizing the set of target acoustic properties for the target environment.

### Claim 17 (depends on 16)

The system of claim 16, wherein the controller is further configured to:
estimate a room impulse response of the environment, wherein the room impulse response is used to generate the original response.

### Claim 18 (depends on 11)

The system of claim 11, wherein the controller is further configured to:
determine a transfer function based on the comparison of the acoustic properties to the target acoustic properties;
generate sound filters using the transfer function; and
adjust the audio content based in part on the sound filters.

### Claim 19 (depends on 18)

The system of claim 18, wherein the controller is further configured to:
determine the transfer function using at least one previously measured room impulse response or algorithmic reverberation.

### Claim 20 (depends on 18)

The system of claim 18, wherein the controller is configured to:
adjust the audio content by convolving the transfer function with audio content received by the one or more sensors.
