# US 2019/0356999 A1 · Directional propagation

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0356999 A1
- Document ID: US20190356999A1
- Status: Published application
- Kind: A1
- Application number: 16/103,702
- Filed: 2018-08-14
- Published: 2019-11-21
- Earliest claimed: 2018-05-15
- Assignees: Microsoft Technology Licensing, LLC
- Applicants: Microsoft Technology Licensing, LLC
- Inventors: Nikunj RAGHUVANSHI; John SNYDER
- Web page: https://patentgrep.com/patent/US20190356999A1

## CPC

- H04S 7/303: {Tracking of listener position or orientation}
- H04S 7/304: {For headphones}
- G10K 15/02: Synthesis of acoustic waves (synthesis of speech G10L13/00)
- G10K 15/08: Arrangements for producing a reverberation or echo sound {(modifying acoustic properties to change reverberation time G10K11/002)}
- H04S 3/008: {in which the audio signals are in digital form, i.e. employing more than two discrete digital channels (data reduction aspects thereof based on psychoacoustics G10L19/02)}
- H04S 5/005: {of the pseudo five- or more-channel type, e.g. virtual surround}
- H04S 7/305: {Electronic adaptation of stereophonic audio signals to reverberation of the listening space (H04S7/301 takes precedence)}
- H04S 7/306: {For headphones}
- H04S 2400/01: Multi-channel, i.e. more than two input channels, sound reproduction with two speakers wherein the multi-channel information is substantially preserved
- H04S 2400/11: Positioning of individual sound objects, e.g. moving airplane, within a sound field (H04S2420/13 takes precedence)
- H04S 2420/01: Enhancing the perception of the sound image or of the spatial distribution using head related transfer functions [HRTF's] or equivalents thereof, e.g. interaural time difference [ITD] or interaural level difference [ILD]
- H04S 2420/03: Application of parametric coding in stereophonic audio systems
- H04S: STEREOPHONIC SYSTEMS
- G10K: SOUND-PRODUCING DEVICES; METHODS OR DEVICES FOR PROTECTING AGAINST, OR FOR DAMPING, NOISE OR OTHER ACOUSTIC WAVES IN GENERAL; ACOUSTICS NOT OTHERWISE PROVIDED FOR

## Abstract

The description relates to parametric directional propagation for sound modeling and rendering. One implementation includes receiving virtual reality space data corresponding to a virtual reality space. The implementation can include using the virtual reality space data to simulate directional impulse responses for initial sounds emanating from multiple moving sound sources and arriving at multiple moving listeners. The implementation can include using the virtual reality space data to simulate directional impulse responses for sound reflections in the virtual reality space. The directional impulse responses can be encoded and used to render sound that accounts for a geometry of the virtual reality space.

## Claims

### Claim 1

A system, comprising:
a processor; and
storage storing computer-readable instructions which, when executed by the processor, cause the processor to:
receive directional impulse responses corresponding to a virtual reality space, the directional impulse responses corresponding to multiple sound source locations and multiple listener locations in the virtual reality space, and specifying directionality of sounds for pairs of individual sound source locations and individual listener locations based on geometry included in the virtual reality space;
compress the directional impulse responses using parameterized encoding to generate perceptual parameter fields; and
store the perceptual parameter fields on the storage.

### Claim 2 (depends on 1)

The system of claim 1, wherein the parameterized encoding uses 9D parameterization that accounts for incoming directionality of initial sounds at an individual listener location.

### Claim 3 (depends on 1)

The system of claim 1, wherein the perceptual parameter fields relate to both initial sounds and sound reflections.

### Claim 4 (depends on 3)

The system of claim 3, wherein the perceptual parameter fields account for an initial sound delay before the initial sounds.

### Claim 5 (depends on 3)

The system of claim 3, wherein the perceptual parameter fields account for a reflection delay between the initial sounds and the sound reflections.

### Claim 6 (depends on 3)

The system of claim 3, wherein the perceptual parameter fields account for a decay of the sound reflections over time.

### Claim 7

A system, comprising:
a processor; and
storage storing computer-readable instructions which, when executed by the processor, cause the processor to:
receive sound event input including sound source data related to a sound source and listener data related to a listener in a virtual reality space;
receive perceptual parameter fields corresponding to the virtual reality space, the perceptual parameter fields based at least on encoded directional impulse responses specifying directionality of sounds corresponding to the received sound event input; and
using the sound event input and the perceptual parameter fields, render an initial sound at an initial sound direction and sound reflections at respective sound reflection directions.

### Claim 8 (depends on 7)

The system of claim 7, wherein the initial sound direction is an incoming direction of the initial sound at a location of the listener in the virtual reality space.

### Claim 9 (depends on 7)

The system of claim 7, wherein the perceptual parameter fields include the initial sound direction at a location of the listener and the respective sound reflection directions at the location of the listener.

### Claim 10 (depends on 9)

The system of claim 9, wherein the perceptual parameter fields account for an occluder in the virtual reality space between a location of the sound source and the location of the listener.

### Claim 11 (depends on 7)

The system of claim 7, wherein the computer-readable instructions further cause the processor to render the initial sound on a per sound event basis.

### Claim 12 (depends on 11)

The system of claim 11, wherein the sound event input corresponds to multiple sound events and wherein the computer-readable instructions further cause the processor to render the sound reflections by aggregating the sound source data from the multiple sound events.

### Claim 13 (depends on 12)

The system of claim 12, wherein the computer-readable instructions further cause the processor to aggregate the sound source data from the multiple sound events using directional canonical filters.

### Claim 14 (depends on 13)

The system of claim 13, wherein the directional canonical filters group the sound source data from the multiple sound events into the respective sound reflection directions, and wherein the directional canonical filters are each associated with a direction.

### Claim 15 (depends on 13)

The system of claim 13, wherein the sound event input corresponds to multiple sound sources and wherein the computer-readable instructions further cause the processor to aggregate the sound source data with additional sound source data related to at least one additional sound source in the virtual reality space using the directional canonical filters to render the sound reflections.

### Claim 16 (depends on 13)

The system of claim 13, wherein the directional canonical filters sum a portion of the sound source data corresponding to a decay time.

### Claim 17

A system, comprising:
a processor; and
storage storing computer-readable instructions which, when executed by the processor, cause the processor to:
generate a visual representation of a virtual reality space;
receive sound event input that includes a sound source location and a listener location in the virtual reality space;
access perceptual parameter fields associated with the virtual reality space, the perceptual parameter fields based at least on encoded directional impulse responses specifying directionality of sounds corresponding to the received sound event input; and
produce rendered sound based at least in part on the perceptual parameter fields such that the rendered sound is directionally accurate for the listener location and a geometry of the virtual reality space.

### Claim 18 (depends on 17)

The system of claim 17, wherein the computer-readable instructions further cause the processor to generate the visual representation and produce the rendered sound based at least in part on a voxel map for the virtual reality space.

### Claim 19 (depends on 18)

The system of claim 18, wherein the perceptual parameter fields are generated based at least in part on the voxel map.

### Claim 20 (depends on 18)

The system of claim 18, wherein the voxel map includes an occluder located between the sound source location and the listener location, and the rendered sound accounts for the occluder.
