Machine learning system with two encoder towers for semantic matching
AssigneeMicrosoft Technology Licensing, LLC
InventorsSudipto MUKHERJEE, Liang DU, Ke JIANG, Robin ABRAHAM
Life of this patent
Estimating the term…
Loading patent…
AssigneeMicrosoft Technology Licensing, LLC
InventorsSudipto MUKHERJEE, Liang DU, Ke JIANG, Robin ABRAHAM
Estimating the term…
This disclosure describes a machine learning system that includes a contrastive learning based two-tower model for retrieval of relevant chemical reaction procedures given a query chemical reaction. The two-tower model uses attention-based transformers and neural networks to convert tokenized representations of chemical reactions and chemical reaction procedures to embeddings in a shared embedding space. Each tower can include a transformer network, a pooling layer, a normalization layer, and a neural network. The model is trained with labeled data pairs that include a chemical reaction and the text of a chemical reaction procedure for that chemical reaction. New queries can locate chemical reaction procedures for performing a given chemical reaction as well as procedures for similar chemical reactions. The architecture and training of the model make it possible to perform semantic matching based on chemical structures. The model is highly accurate providing an average recall at K=5 of 95.9%.
A machine learning system for identifying one or more candidate chemical reaction procedures from a chemical reaction sketch, the system comprising:
A computer-implemented method of identifying one or more chemical reaction procedures from a chemical reaction sketch comprising:
A computer-implemented method of training a machine learning system for identifying chemical reaction procedures from chemical reaction sketches comprising:
Dependencies are inferred from the claim text.