US 10,949,409 B2Granted

On-demand, dynamic and optimized indexing in natural language processing

AssigneeSap SE

InventorsRahul Tiwari, Harikrishnan Mangayil, Nikita Jain, Rakesh Kelappan

Life of this patent

Estimating the term…

Loading patent…

Abstract

Indexing natural language processing, a request is received from a user to access a document at a server, the server routes the request to an indexing server. A validation service checks if the CUID of the document is available in the indexing server repository or a file system associated with the indexing server. If the CUID of dataset exists, determine if a timestamp of the new document matches the timestamp of the previously indexed document. Upon determining that the above conditions are fulfilled, the previously indexed data is returned to the server. If it is determined that the above conditions do not match, then a transformation service is invoked at the indexing server. The transformation service compares a hash value of a dataset. If the transformation service determines that the hash value of a dataset in the document is not available, an indexing service is invoked to index the document.

Claims17

Dependent claims

A non-transitory computer-readable medium to store instructions, which when executed by a computer, cause the computer to perform operations comprising:

route a query received at a server to an indexing server, wherein the query is generated by transforming a natural language input, and wherein the query is for accessing a document;
in response to determining that the document is indexed and available in the indexing server:
retrieve the document from the indexing server, wherein the determination is performed by services that are executed at the indexing server as background tasks;
and
provide the document to the server from the indexing server for accessing the document from the server;
in response to determining that the document is not available in the indexing server:
using a transformation service to determine whether a hash of a dataset of the document is available in the indexing server;
in response to determining that the hash of the dataset of the document is available in the indexing server, compare metadata associated with the dataset with metadata previously stored at the indexing server;
in response to determining that the metadata associated with the dataset is a subset of the metadata previously stored at the indexing server, reuse a previously indexed dataset from the indexing server;
and
provide a document including the indexed dataset to the server for accessing.

8 more elements

A computer-implemented method of optimized indexing in natural language processing, the method comprising:

routing a query received at a server to an indexing server, wherein the query is generated by transforming a natural language input, and wherein the query is for accessing a document;
in response to determining that the document is indexed and available in the indexing server:
retrieving the document from the indexing server, wherein the determination is performed by services that are executed at the indexing server as background tasks;
and
providing the document to the server from the indexing server for accessing the document from the server;
in response to determining that the document is not available in the indexing server:
using a transformation service to determine whether a hash of a dataset of the document is available in the indexing server;
in response to determining that the hash of the dataset of the document is available in the indexing server, compare metadata associated with the dataset with metadata previously stored at the indexing server;
in response to determining that the metadata associated with the dataset is a subset of the metadata previously stored at the indexing server, reuse a previously indexed dataset from the indexing server;
and
provide a document including the indexed dataset to the server for accessing.

8 more elements

A computer system for optimized indexing in natural language processing, comprising:

a computer memory to store program code;
and
a processor to execute the program code to:
route a query received at a server to an indexing server, wherein the query is generated by transforming a natural language input, and wherein the query is for accessing a document;
in response to determining that the document is indexed and available in the indexing server:
retrieve the document from the indexing server, wherein the determination is performed by services that are executed at the indexing server as background tasks;
and
provide the document to the server from the indexing server for accessing the document from the server;
in response to determining that the document is not available in the indexing server:
using a transformation service to determine whether a hash of a dataset of the document is available in the indexing server;
in response to determining that the hash of the dataset of the document is available in the indexing server, compare metadata associated with the dataset with metadata previously stored at the indexing server;
in response to determining that the metadata associated with the dataset is a subset of the metadata previously stored at the indexing server, reuse a previously indexed dataset from the indexing server;
and
provide a document including the indexed dataset to the server for accessing.

11 more elements

Dependencies are inferred from the claim text.

Facts

Application: 15/926,856Filed 20 Mar 2018
Priority: IN 20174104472413 Dec 2017
Published: US 2019/0179928 A113 Jun 2019
Granted: 16 Mar 2021
Term ends: Not estimatedThe source records don’t support an estimate.

Classification8 codes

G06F 16/2272
Indexing structures: management thereof
G06F 16/2255
Indexing structures: hash tables
G06F 16/2477
Special types of queries, e.g. statistical queries, fuzzy queries or distributed queries: temporal data queries
G06F 16/316
Indexing; Data structures therefor; Storage structures: indexing structures