Systems and methods for joint optimization training and encoder side downsampling
AssigneeOP Solutions, LLC
InventorsHari Kalva, Borivoje Furht, Velibor Adzic
Life of this patent
Estimating the term…
Abstract
A method of joint optimization-training, the method comprising identifying, by a feature extractor, an input feature, generating, by the feature extractor, a feature map for the input feature, wherein generating the feature map further comprises receiving an initial parameter set, instantiating a loss function representing a feature representation precision and an encoding complexity level as a function of the input feature and the initial parameter set, and generating the feature map that minimizes the loss function, and transmitting, by the feature extractor, the feature map to an encoder.
Claims35
A method of joint optimization-training, the method comprising:
- identifying, by a feature extractor, an input feature;
- generating, by the feature extractor, a feature map for the input feature, wherein generating the feature map further comprises:
- receiving an initial parameter set;
- instantiating a loss function representing a feature representation precision and an encoding complexity level as a function of the input feature and the initial parameter set;
- and
- generating the feature map that minimizes the loss function;
- and
- transmitting, by the feature extractor, the feature map to an encoder.
A system for joint optimization-training, wherein the system comprises a feature extractor, wherein the feature extractor is configured to:
- identify an input feature;
- generate a feature map for the input feature, wherein generating the feature map further comprises:
- receiving an initial parameter set;
- instantiating a loss function representing a feature representation precision and an encoding complexity level as a function of the input feature and the initial parameter set;
- and
- generating the feature map that minimizes the loss function;
- and transmit the feature map to an encoder.
A method of dual-purpose encoder-side downsampling, the method comprising:
- receiving, by an encoder, an input video;
- and
- generating, by the encoder, a downsampling parameter set for the input video, wherein generating the downsampling parameter set further comprises:
- generating an initial parameter set;
- instantiating a loss function representing a downsampling error rate and an encoding complexity level as a function of a current parameter set based on the initial parameter set and the input video;
- and
- selecting a downsampling parameter set that minimizes the loss function.
An encoder for dual-purpose encoder-side downsampling, the encoder configured to:
- receive an input video;
- and
- generate a downsampling parameter set for the input video, wherein generating the downsampling parameter set further comprises:
- generating an initial parameter set;
- instantiating a loss function representing a downsampling error rate and an encoding complexity level as a function of a current parameter set based on the initial parameter set and the input video;
- and
- selecting a downsampling parameter set that minimizes the loss function.
A method of dual-purpose encoder-side preprocessing, the method comprising:
- receiving, by an encoder, an input video;
- and
- generating, by the encoder, a pre-processing parameter set for the input video, wherein generating the pre-processing parameter set further comprises:
- generating an initial parameter set;
- instantiating a loss function representing a pre-processing error rate and an encoding complexity level as a function of a current parameter set based on the initial parameter set and the input video;
- and
- selecting a pre-processing parameter set that minimizes the loss function.
Dependencies are inferred from the claim text.