System for and method of controlling a three-dimensional audio engine
AssigneeAudible Reality Inc.
InventorLasse Vetter
Life of this patent
Estimating the term…
Abstract
A system for and a method of controlling generation of a 3D audio stream are disclosed. The method comprises accessing an audio stream; determining a value of a feature associated with the audio stream; selecting one or more 3D control parameters from a set of 3D control parameters, the selecting being based on the value of the feature associated with the audio stream; and generating the 3D audio stream based on the selected one or more 3D control parameters. In some embodiments, the feature is a metric associated with a frequency distribution of correlations of the audio stream.
Claims20
A method of controlling generation of a 3D audio stream, the method comprising:
- accessing an audio stream;
- generating a feature vector associated with the audio stream by a Deep Neural Network (DNN) which takes for input the audio stream in either time or frequency domain and which outputs the feature vector;
- selecting one or more 3D control parameters from a set of 3D control parameters, the selecting being based on the feature vector associated with the audio stream;
- and
- generating the 3D audio stream based on the selected one or more 3D control parameters.
A computer-implemented system, the system comprising at least one processor and memory storing a plurality of executable instructions which, when executed by the at least one processor, cause the system to:
- access an audio stream;
- generate a feature vector associated with the audio stream by a Deep Neural Network (DNN) which takes for input the audio stream and which outputs the feature vector;
- select one or more 3D control parameters from a set of 3D control parameters, the selecting being based on the feature vector associated with the audio stream;
- and
- generate the 3D audio stream based on the selected one or more 3D control parameters.
A non-transitory computer-readable medium storing program instructions which upon being executed by a processor cause to perform:
- accessing an audio stream;
- generating a feature vector associated with the audio stream by a Deep Neural Network (DNN) which takes for input the audio stream and which outputs the feature vector;
- selecting one or more 3D control parameters from a set of 3D control parameters, the selecting being based on the feature vector associated with the audio stream;
- and
- generating the 3D audio stream based on the selected one or more 3D control parameters.
A method of controlling generation of a 3D audio stream, the method comprising:
- accessing an audio stream;
- generating a feature vector associated with the audio stream, wherein the feature vector comprises a metric associated with a frequency distribution of correlations of left and right channels of the audio stream;
- selecting, based on the feature vector associated with the audio stream, one or more 3D control parameters from a set of 3D control parameters;
- and
- generating the 3D audio stream based on the one or more 3D control parameters, wherein the frequency distribution of correlations of left and right channels of the audio stream is calculated based on the following equations:
- ϕ
- =
- tan
- -
- 1
- (
- x
- l
- x
- r
- )
-
- x
-
- =
- x
- l
- 2
- +
- x
- r
- 2
- corr
- (
- x
- l
- ,
- x
- r
- )
- =
- ϕ
-
-
- x
-
- wherein xl and xr are left and right channels sample values at a given time of the audio stream, Phi is the phase between the left and right channels, ∥x∥ is a vector length of the feature vector and the correlation (corr) is a product of the phase and the vector length.
A computer-implemented system, the system comprising at least one processor and memory storing a plurality of executable instructions which, when executed by the at least one processor, cause the system to:
- generate a feature vector associated with an audio stream, wherein the feature vector comprises a metric associated with a frequency distribution of correlations of left and right channels of the audio stream;
- select, based on the feature vector associated with the audio stream, one or more 3D control parameters from a set of 3D control parameters;
- and
- generate a 3D audio stream based on the selected one or more 3D control parameters, wherein the frequency distribution of correlations of left and right channels of the audio stream is calculated based on the following equations:
- ϕ
- =
- tan
- -
- 1
- (
- x
- l
- x
- r
- )
-
- x
-
- =
- x
- l
- 2
- +
- x
- r
- 2
- corr
- (
- x
- l
- ,
- x
- r
- )
- =
- ϕ
-
-
- x
-
- wherein xl and xr are left and right channels sample values at a given time of the audio stream, Phi is the phase between the left and right channels, ∥x∥ is a vector length of the feature vector and the correlation (corr) is a product of the phase and the vector length.
Dependencies are inferred from the claim text.