Adaptive Learning Rates for Training Adversarial Models with Improved Computational Efficiency
AssigneeGoogle Inc.
InventorsHussein Hazimeh, Natalia Borisovna Ponomareva
Life of this patent
Estimating the term…
Abstract
Provided are systems and methods that use a novel learning rate scheduling technique to dynamically adapt the learning rate of an adversarial model to maintain an appropriate balance between adversarial components of the model. The scheduling technique is driven by the fact that, in some settings, the loss of an ideal adversarial network can be analytically determined a priori. A scheduler component can thus operate to keep the loss of the optimized network close to that of an ideal adversarial net.
Claims20
A computer-implemented method for training adversarial models with improved computational efficiency, the method comprising:
- obtaining, by a computing system comprising one or more computing devices, one or more training samples;
- processing, by the computing system, the one or more training samples with an adversarial machine learning model to generate one or more outputs, wherein the adversarial machine learning model comprises at least a first model component and a second model component that are adversarial to each other;
- evaluating, by the computing system, a loss function based at least in part on the one or more outputs to determine a current loss value associated with the adversarial machine learning model;
- determining, by the computing system, a distance between the current loss value associated with the adversarial machine learning model and an ideal loss value for the adversarial machine learning model;
- determining, by the computing system, an adaptive learning rate value for at least one of the first model component and the second model component based at least in part on the distance between the current loss value associated with the adversarial machine learning model and the ideal loss value for the adversarial machine learning model;
- and
- updating, by the computing system, the at least one of the first model component and the second model component according to the adaptive learning rate value.
A computer system comprising:
- one or more processors;
- at least a first machine learning component,
- wherein the first machine learning component was trained using the adaptive learning rate as described in any preceding claim, or
- wherein the first machine learning component was jointly trained with a second machine learning component trained using the adaptive learning rate as described in any preceding claim;
- and
- one or more non-transitory computer-readable media that store instructions that, when executed by the one or more processors, cause the computer system to run at least the first machine learning component.
Dependencies are inferred from the claim text.