Systems and Methods for Automating the Retrieval of Partitionable Search Results from a Search Engine

A system that improves the delivery of partitionable search results from a search engine comprising:

• a database;
• a search engine that provides a plurality of partitions of a set of search results responsive to the at least one natural language query, wherein the set of search results contain all search results from the database that are responsive to the at least one natural language query, and wherein the specific form of the database is abstracted such that the search engine is capable of searching partitioned and unpartitioned databases and enables a size to be determined of the set of search results;
• a server configured to:
• receive from a client the least one natural language query input by a user for searching the database,
• partition the set of search results into the plurality of partitions of the set of search results after the at least one natural language query is received from the client, execute a set of processing tasks in parallel with other processing tasks, wherein each processing:
• submits at least one request to the search engine,
• creates a response message for the client, the response message comprising an assigned subset of search results and metadata related to each of the search results in the assigned subset, wherein the response message repackages the assigned subset of search results and metadata by excluding unused and irrelevant information, and sending the response message to the client, wherein the set of processing tasks execute asynchronously with respect to each other, causing the server to receive the assigned subsets of search results in different amounts of time and concurrently with respect to each other,
• wherein the response message is sent to the client upon being created such that when a first assigned subset of search results takes longer to retrieve from the search engine than a second assigned subset of search results, a response message containing the second assigned subset of search results can be created and sent to the client before the first assigned subset of search results is received at the server,
• wherein the set of processing tasks continuously send a plurality of response messages to the client,
• wherein the client begins displaying each response message of the plurality of response messages once they are received by the client and before the server has finished sending response messages, and
• wherein all search results are received without loading an additional page or initiating a page refresh.

A non-transitory computer-readable storage medium having instructions stored thereon that are executed by one or more processors to perform operations comprising:

• receiving from a client at least one natural language query input by a user for searching a database with a search engine that provides a plurality of partitions of a set of search results responsive to the at least one natural language query, wherein the set of search results contain all search results from the database that are responsive to the at least one natural language query and wherein the form of the database is abstracted such that the search engine is capable of searching partitioned and unpartitioned databases;
• partitioning the set of search results into the plurality of partitions of the set of search results after the at least one natural language query is received;
• executing a set of processing tasks in parallel with other processing tasks wherein each processing task submits at least one request to the search engine and creates a response message for the client, the response message comprising an assigned subset of search results and metadata related to each of the search results in the assigned subset, wherein the response message repackages the assigned subset of search results and metadata by excluding unused and irrelevant information;
• and
• sending the response message to the client, wherein the set of processing tasks execute asynchronously with respect to each other, causing a server to receive the assigned subsets of search results in different amounts of time and concurrently with respect to each other,
• wherein the response message is sent to the client upon being created such that when a first assigned subset of search results takes longer to retrieve from the search engine than a second assigned subset of search results, a response message containing the second assigned subset of search results can be created and sent to the client before the first assigned subset of search results is received at the server,
• wherein the set of processing tasks continuously send a plurality of response messages to the client,
• wherein the client begins displaying each response message of the plurality of response messages once they are received by the client and before the server has finished sending response messages, and
• wherein all search results are received without loading an additional page or initiating a page refresh.