Back to results
US 12,706,108 B2Granted
Signal transformation based on unique key-based network guidance and conditioning
AssigneeDTS, Inc.
InventorsAtti Venkatraman, Zoran Fejzo, Antonius Kalker
Life of this patent
Estimating the term…
Abstract
A method comprises receiving input audio and target audio having a target audio characteristic. The method includes estimating key parameters that represent the target audio characteristic based on one or more of the target audio and the input audio. The method further comprises configuring a neural network, trained to be configured by the key parameters, with the key parameters to cause the neural network to perform a signal transformation of the input audio, to produce output audio having an output audio characteristic corresponding to and that matches the target audio characteristic.
Claims13
A method comprising:
- receiving input audio and target audio having a target audio characteristic, wherein the input audio and the target audio are received as separate signals;
- estimating frame-specific key parameters that include quantized representations of the target audio characteristic derived from a joint analysis of corresponding frames from the target audio and the input audio, wherein the frame-specific key parameters vary from frame to frame, wherein the quantized representations are based on an analysis including a temporal analysis and at least one of a spectral analysis or a frequency harmonic analysis;
- encoding the input audio and the frame-specific key parameters;
- multiplexing the encoded frame-specific key parameters in alignment with the encoded input audio at a frame level into a combined bit-stream for transmission to a neural network;
- demultiplexing the combined bit-stream to generate decoded input audio and decoded frame-specific key parameters;
- configuring the neural network, trained to be configured by the frame-specific key parameters, with the decoded frame-specific key parameters to cause the neural network to perform a signal transformation of the decoded input audio;
- and
- producing output audio having an output audio characteristic corresponding to and that matches the target audio characteristic, wherein the output audio has perceptually-improved signal quality with frequency bandwidth extension as compared to the decoded input audio.
5 more elements
An apparatus comprising:
- a decoder to decode encoded input audio and encoded frame-specific key parameters in a received combined bit-stream from a transmission channel to produce decoded input audio and decoded frame-specific key parameters, respectively, wherein the received combined bit-stream includes the encoded frame-specific key parameters in alignment with the encoded input audio at a frame level, wherein the decoded frame-specific key parameters include quantized representations of a target audio characteristic derived from a joint analysis of corresponding frames from target audio and the decoded input audio, wherein the decoded frame-specific key parameters vary from frame to frame and the quantized representations are based on an analysis including a temporal analysis and at least one of a spectral analysis or a frequency harmonic analysis;
- and
- a neural network trained to be configured by the decoded frame-specific key parameters as produced by the decoder to perform a signal transformation of audio representative of the decoded input audio and
- to produce output audio having an output audio characteristic corresponding to and that matches the target audio characteristic, wherein the output audio has perceptually-improved signal quality with frequency bandwidth extension as compared to the decoded input audio.
1 more element
A method comprising:
- receiving input audio and frame-specific key parameters that are representative of a target audio characteristic in a multiplexed and combined bit-stream in which both the input audio and the frame-specific key parameters are encoded, wherein the received combined bit-stream includes the encoded frame-specific key parameters in alignment with the encoded input audio at a frame level, wherein the frame-specific key parameters include quantized representations of the target audio characteristic derived from a joint analysis of corresponding frames from target audio and the input audio, wherein the frame-specific key parameters vary from frame to frame and the quantized representations are based on an analysis including a temporal analysis and at least one of a spectral analysis or a frequency harmonic analysis;
- demultiplexing and decoding the encoded input audio and the encoded frame-specific key parameters to recover the input audio and the frame-specific key parameters;
- configuring a neural network, that was previously trained to be configured by the frame-specific key parameters, with the frame-specific key parameters as decoded to cause the neural network to perform a signal transformation of audio that is representative of the input audio;
- and
- producing output audio with an output audio characteristic that matches the target audio characteristic, wherein the output audio has perceptually-improved signal quality with frequency bandwidth extension as compared to the input audio.
2 more elements
Dependencies are inferred from the claim text.