Predictive Embeddings
AssigneeInternational Business Machines Corporation
InventorDaniel P. Gonzalez
Life of this patent
Estimating the term…
Abstract
An approach is provided in which an information handling system detects an unknown word in a sentence and generates a context embedding using known words in proximity to the unknown word in the sentence. Next, the information handling system creates a predictive embedding of to the unknown word based upon the context embedding. The predictive embedding corresponds to an embedding area of the unknown word without specifying the unknown word. In turn, the information handling system utilizes the predictive embedding to generate natural language processing results corresponding to the sentence.
Claims20
A method implemented by an information handling system that includes a memory and a processor, the method comprising:
- generating a context embedding corresponding to a plurality of known words in a sentence that are in proximity to an unknown word in the sentence;
- creating a predictive embedding corresponding to the unknown word based on the context embedding, wherein the predictive embedding corresponds to an embedding area of the unknown word without specifying the unknown word;
- and
- utilizing the predictive embedding to generate one or more natural language processing results corresponding to the sentence.
An information handling system comprising:
- one or more processors;
- a memory coupled to at least one of the processors;
- and
- a set of computer program instructions stored in the memory and executed by at least one of the processors in order to perform actions of:
- generating a context embedding corresponding to a plurality of known words in a sentence that are in proximity to an unknown word in the sentence;
- creating a predictive embedding corresponding to the unknown word based on the context embedding, wherein the predictive embedding corresponds to an embedding area of the unknown word without specifying the unknown word;
- and
- utilizing the predictive embedding to generate one or more natural language processing results corresponding to the sentence.
A computer program product stored in a computer readable storage medium, comprising computer program code that, when executed by an information handling system, causes the information handling system to perform actions comprising:
- generating a context embedding corresponding to a plurality of known words in a sentence that are in proximity to an unknown word in the sentence;
- creating a predictive embedding corresponding to the unknown word based on the context embedding, wherein the predictive embedding corresponds to an embedding area of the unknown word without specifying the unknown word;
- and
- utilizing the predictive embedding to generate one or more natural language processing results corresponding to the sentence.
Dependencies are inferred from the claim text.