Deep embedding for natural language content based on semantic dependencies

A computer program product comprising a computer readable storage medium having a computer readable program stored therein, wherein the computer readable program, when executed in a data processing system, causes data processing system to:

• receive, by a natural language embedding engine executing in the data processing system, a document data object of an electronic document;
• analyzing, by the natural language embedding engine, a structure of the electronic document to identify one or more structural document elements that have a relationship with the document data object;
• generate, by the natural language embedding engine, a dependency data structure representing the electronic document, wherein edges in the dependency data structure define relationships between document elements, and wherein at least one edge is generated in the dependency data structure to represent at least one relationship between the one or more structural document elements and the document data object;
• execute, by the natural language embedding engine, an embedding operation on the document data object based on the at least one relationship in the dependency data structure to thereby represent the document data object as a vector data structure;
• and
• perform, by a natural language processing engine executing in the data processing system, a natural language processing operation on the document data object based on the vector data structure, wherein the one or more structural document elements comprise one or more structural document elements that are non-local non-contiguous with the document data object, wherein the natural language processing system is a question and answer system, and wherein preforming the natural language processing operation on the document data object based on the vector data structure comprises performing, by the question and answer system, a question answering operation based on a received input natural language question, and generating at least one answer to the received input natural language question based on the vector data structure associated with the document data object.

An apparatus comprising:

• at least one processor;
• and
• at least one memory coupled to the at least one processor, wherein the at least one memory comprises instructions which, when executed by one or mom processors of the at least one processor, causes the one or more processors to:
• receive, by a natural language embedding engine executing on the one or more processors, a document data object of an electronic document;
• analyzing, by the natural language embedding engine, a structure of the electronic document to identify one or more structural document elements that have a relationship with the document data object;
• generate, by the natural language embedding engine, a dependency data structure representing the electronic document, wherein edges in the dependency data structure define relationships between document elements, and wherein at least one edge is generated in the dependency data structure to represent at least one relationship between the one or more structural document elements and the document data object;
• execute, by the natural language embedding engine, an embedding operation on the document data object based on the at least one relationship in the dependency data structure to thereby represent the document data object as a vector data structure;
• and
• perform, by a natural language processing engine executing on one or more of the processors, a natural language processing operation on the document data object based on the vector data structure, wherein the one or more structural document elements comprise one or more structural document elements that are non-local non-contiguous with the document data object, wherein the natural language processing system is a question and answer system, and wherein preforming the natural language processing operation on the document data object based on the vector data structure comprises performing, by the question and answer system, a question answering operation based on a received input natural language question, and generating at least one answer to the received input natural language question based on the vector data structure associated with the document data object.