Back to results
US 12,749,498 B2Granted
Quality estimation model for packet loss concealment
AssigneeMicrosoft Technology Licensing, LLC
InventorCarl Lorenz Diener
Life of this patent
Estimating the term…
Abstract
This document relates to training and employing a quality estimation model. One example includes a method or technique that can be performed on a computing device. The method or technique can include providing degraded audio signals to one or more packet loss concealment models, and obtaining enhanced audio signals output by the one or more packet loss concealment models. The method or technique can also include obtaining quality labels for the enhanced audio signals and training a quality estimation model to estimate audio signal quality based at least on the enhanced audio signals and the quality labels.
Claims18
A computer-implemented method comprising:
- providing as input to one or more packet loss concealment models audio signals having missing portions due to network packet loss and receiving from the one or more packet loss concealment models enhanced audio signals comprising restored portions that replace the missing portions of the audio signals using the one or more packet loss concealment models;
- obtaining quality labels for the enhanced audio signals output by the one or more packet loss concealment models, wherein the quality labels represent perceived audio quality ratings that characterize how effectively the one or more packet loss concealment models enhanced the degraded audio signals by restoring the missing portions of the audio signals lost due to network packet loss;
- using the enhanced audio signals and the quality labels, training a quality estimation model through supervised learning to receive as input an audio signal enhanced by a packet loss concealment model and to generate as output a synthetic quality label indicating a quality of the audio signal as enhanced by the packet loss concealment model, the training comprising updating parameters of the quality estimation model based on differences between synthetic quality labels output by the quality estimation model and the quality labels;
- providing new enhanced audio signals, generated by the one or more packet loss concealment models, as input to the trained quality estimation model and generating as output synthetic quality labels for the new enhanced audio signals, each synthetic quality label and its corresponding enhanced audio signal forming a training data pair;
- and
- using the training data pairs to improve packet loss concealment performance in an audio application.
3 more elements
A system comprising:
- a processor;
- and
- a storage medium storing instructions which, when executed by the processor, cause the processor to:
- providing as input to one or more packet loss concealment models audio signals having missing portions due to network packet loss and receiving from the one or more packet loss concealment models enhanced audio signals comprising restored portions that replace the missing portions of the audio signals using the one or more packet loss concealment models
- obtaining quality labels for the enhanced audio signals output by the one or more packet loss concealment models, wherein the quality labels represent perceived audio quality ratings that characterize how effectively the one or more packet loss concealment models enhanced the degraded audio signals by restoring the missing portions of the audio signals lost due to network packet loss;
- using the enhanced audio signals and the quality labels, training a quality estimation model through supervised learning to receive as input an audio signal enhanced by a packet loss concealment model and to generate as output a synthetic quality label indicating a quality of the audio signal as enhanced by the packet loss concealment model, the training comprising updating parameters of the quality estimation model based on differences between synthetic quality labels output by the quality estimation model and the quality labels;
- providing new enhanced audio signals, generated by the one or more packet loss concealment models, as input to the trained quality estimation model and generating as output synthetic quality labels for the new enhanced audio signals, each synthetic quality label and its corresponding enhanced audio signal forming a training data pair;
- and
- using the training data pairs to improve packet loss concealment performance in an audio application.
6 more elements
A non-transitory computer-readable storage medium storing instructions which, when executed by a computing device, cause the computing device to perform acts comprising:
- providing as input to one or more packet loss concealment models audio signals having missing portions due to network packet loss and receiving from the one or more packet loss concealment models enhanced audio signals comprising restored portions that replace the missing portions of the audio signals using the one or more packet loss concealment models;
- obtaining quality labels for the enhanced audio signals output by the one or more packet loss concealment models, wherein the quality labels represent perceived audio quality ratings that characterize how effectively the one or more packet loss concealment models enhanced the degraded audio signals by restoring the missing portions of the audio signals lost due to network packet loss;
- using the enhanced audio signals and the quality labels, training a quality estimation model through supervised learning to receive as input an audio signal enhanced by a packet loss concealment model and to generate as output a synthetic quality label indicating a quality of the audio signal as enhanced by the packet loss concealment model, the training comprising updating parameters of the quality estimation model based on differences between synthetic quality labels output by the quality estimation model and the quality labels;
- providing new enhanced audio signals, generated by the one or more packet loss concealment models, as input to the trained quality estimation model and generating as output synthetic quality labels for the new enhanced audio signals, each synthetic quality label and its corresponding enhanced audio signal forming a training data pair;
- and
- using the training data pairs to improve packet loss concealment performance in an audio application.
3 more elements
Dependencies are inferred from the claim text.