Meaning and Sense Preserving Textual Encoding and Embedding
AssigneeInternational Business Machines Corporation
InventorTanveer Syeda-Mahmood
Life of this patent
Estimating the term…
Loading patent…
AssigneeInternational Business Machines Corporation
InventorTanveer Syeda-Mahmood
Estimating the term…
Mechanisms for implementing a text encoder and text encoder operations are provided. A contrastive machine learning training operation trains an encoder of a machine learning computer model, to learn a sense and similarity preserving embedding that operates to encode input natural language text data to generate encoded natural language text data based on a sense attribute of one or more terms in the input natural language text data. The contrastive machine learning training operation learns to separate positive samples in training data from negative samples in the training data. The trained encoder processes a term specified in an input natural language text to generate an encoded natural language text based on the learned embedding and inputs, to a downstream computing system, the encoded natural language text to cause the downstream computing system to perform a computer natural language processing operation based on the embedding.
A method, in a data processing system comprising at least one processor and at least one memory, the at least one memory comprising instructions that are executed by the at least on processor to cause the at least one processor to be specifically configured to implement a text encoder that encodes natural language text data input at least by:
A computer program product comprising a computer readable storage medium having a computer readable program stored therein, wherein the computer readable program, when executed on data processing system, causes the data processing system to:
An apparatus comprising:
Dependencies are inferred from the claim text.