Performing classification using post-hoc augmentation
AssigneeGoogle Inc.
InventorsMariano Ruben Schain, Elad Eban
Life of this patent
Estimating the term…
Abstract
Methods, systems, and apparatus, including computer programs encoded on computer storage media, for processing network inputs by applying augmentations to internal representations of the network inputs.
Claims21
A method performed by one or more computers, the method comprising:
- obtaining a network input;
- and
- generating a final classification output for the network input using a neural network that comprises a neural network body and a neural network head, the generating comprising:
- processing the network input using the neural network body to generate an internal representation of the network input;
- generating, from the internal representation of the network input, a plurality of augmented representations of the internal representation;
- processing each augmented representation using the neural network head to generate a respective initial classification output for each augmented representation;
- and
- combining at least the respective initial classification outputs for the augmented representations to generate the final classification output for the network input.
(canceled)
One or non-transitory more computer-readable storage media storing instructions that when executed by one or more computers cause the one or more computers to perform operations comprising:
- obtaining a network input;
- and
- generating a final classification output for the network input using a neural network that comprises a neural network body and a neural network head, the generating comprising:
- processing the network input using the neural network body to generate an internal representation of the network input;
- generating, from the internal representation of the network input, a plurality of augmented representations of the internal representation;
- processing each augmented representation using the neural network head to generate a respective initial classification output for each augmented representation;
- and
- combining at least the respective initial classification outputs for the augmented representations to generate the final classification output for the network input.
A system comprising one or more computers and one or more storage devices storing instructions that when executed by one or more computers cause the one or more computers to perform operations comprising:
- obtaining a network input;
- and
- generating a final classification output for the network input using a neural network that comprises a neural network body and a neural network head, the generating comprising:
- processing the network input using the neural network body to generate an internal representation of the network input;
- generating, from the internal representation of the network input, a plurality of augmented representations of the internal representation;
- processing each augmented representation using the neural network head to generate a respective initial classification output for each augmented representation;
- and
- combining at least the respective initial classification outputs for the augmented representations to generate the final classification output for the network input.
Dependencies are inferred from the claim text.