US 2022/0191639 A1 · SCALABLE BINAURAL AUDIO STREAM GENERATION

Abstract

Described is a method performed by a computation device for generating a binaural audio stream, comprising: receiving an audio stream for a sound source; determining a measure of processing capability of the computation device; selecting, based on the determined measure, a filtering mode from among a predefined set of filtering modes for use in an audio filtering process intended to convert the audio stream into a binaural audio stream; determining, based on a relative position of the virtual source location to a virtual listener location in a virtual listening environment, filter parameters for a set of filters specified by the selected filtering mode; generating the binaural audio stream by applying the audio filtering process to the audio stream, using the set of filters specified by the selected filtering mode; and outputting the binaural audio stream for playback. Further described are corresponding computation devices, computer programs, and computer-readable storage media.

Claims20

Dependent claims

A method performed by a computation device for generating a binaural audio stream based on a virtual environment, the method comprising:

panning one or more audio streams of one or more sound sources to a set of virtual loudspeakers at respective virtual loudspeaker locations to yield a set of virtual loudspeaker audio streams, wherein each of the one or more sound sources is assigned to a different virtual source location in the virtual environment;
performing a binaural audio filtering process on the set of virtual loudspeaker audio streams to yield a set of individual binaural audio streams, based on relative positions of respective virtual loudspeaker locations to a virtual listener location;
and
generating a binaural audio stream by combining one or more of the set of individual binaural audio streams, wherein the binaural audio stream is configured to enable a listener at the virtual listener location to perceive a sound from the one or more sound sources as emanating from respective virtual source locations.

1 more element

A system for generating a binaural audio stream based on a virtual environment, comprising:

at least one processor;
and
a memory storing instructions thereon that, when executed by the at least one processor, cause the at least one processor to perform operations, comprising:
panning one or more audio streams of one or more sound sources to a set of virtual loudspeakers at respective virtual loudspeaker locations to yield a set of virtual loudspeaker audio streams, wherein each of the one or more sound sources is assigned to a different virtual source location in the virtual environment;
performing a binaural audio filtering process on the set of virtual loudspeaker audio streams to yield a set of individual binaural audio streams, based on relative positions of respective virtual loudspeaker locations to a virtual listener location;
and
generating a binaural audio stream by combining one or more of the set of individual binaural audio streams, wherein the binaural audio stream is configured to enable a listener at the virtual listener location to perceive a sound from the one or more sound sources as emanating from respective virtual source locations.

4 more elements

A non-transitory, computer-readable storage medium having instructions stored thereon, that when executed by at least one processor, cause the at least one processor to perform operations, comprising:

panning one or more audio streams of one or more sound sources to a set of virtual loudspeakers at respective virtual loudspeaker locations to yield a set of virtual loudspeaker audio streams, wherein each of the one or more sound sources is assigned to a different virtual source location in a virtual environment;
performing a binaural audio filtering process on the set of virtual loudspeaker audio streams to yield a set of individual binaural audio streams, based on relative positions of respective virtual loudspeaker locations to a virtual listener location;
and
generating a binaural audio stream by combining one or more of the set of individual binaural audio streams, wherein the binaural audio stream is configured to enable a listener at the virtual listener location to perceive a sound from the one or more sound sources as emanating from respective virtual source locations.

1 more element

Dependencies are inferred from the claim text.

Scalable binaural audio stream generation

Life of this patent

Scalable binaural audio stream generation

Life of this patent

Abstract

Claims20