Learning contrastive representation for semantic correspondence
AssigneeNVIDIA Corporation
InventorsTaihong Xiao, Sifei Liu, Shalini De Mello, Zhiding Yu, Jan Kautz
Life of this patent
Estimating the term…
Loading patent…
AssigneeNVIDIA Corporation
InventorsTaihong Xiao, Sifei Liu, Shalini De Mello, Zhiding Yu, Jan Kautz
Estimating the term…
A multi-level contrastive training strategy for training a neural network relies on image pairs (no other labels) to learn semantic correspondences at the image level and region or pixel level. The neural network is trained using contrasting image pairs including different objects and corresponding image pairs including different views of the same object. Conceptually, contrastive training pulls corresponding image pairs closer and pushes contrasting image pairs apart. An image-level contrastive loss is computed from the outputs (predictions) of the neural network and used to update parameters (weights) of the neural network via backpropagation. The neural network is also trained via pixel-level contrastive learning using only image pairs. Pixel-level contrastive learning receives an image pair, where each image includes an object in a particular category.
A computer-implemented method, comprising:
A system, comprising:
A non-transitory computer-readable media storing computer instructions that, when executed by one or more processors, cause the one or more processors to perform the steps of:
Dependencies are inferred from the claim text.