US 10,885,023 B1Granted

Asynchronous processing for synchronous requests in a database

AssigneeAmazon Technologies, Inc.

InventorsAnurag Windlass Gupta, Alexandre Olegovich Verbitski, Kamal Kant Gupta

Life of this patent

Estimating the term…

Loading patent…

Abstract

A database system may implement asynchronous processing for synchronous requests received at the database. A pool of request processing threads may be maintained. As access requests for the database are received from clients, an available request processing thread in the pool may process the access request. The access request may be dependent on a persistent storage I/O operation, such that processing of the access request waits at least until the persistent storage I/O operation is complete. The request processing thread may perform processing operations for the access request so that persistent storage I/O operation is performed and become available to process other access requests. A response processing thread may determine that the persistent storage I/O operation for the access request is complete, and send a response to the client.

Claims20

Dependent claims

A system, comprising:

at least one processor;
a memory, comprising program instructions that when executed by the at least one processor cause the at least one processor to implement a database engine, wherein the database engine comprises:
a request processing thread pool that comprises a plurality of request processing threads, wherein a number of the plurality of request processing threads is determined according to a thread pool size;
one or more response processing threads different from the plurality of request processing threads of the request processing thread pool;
the database engine, configured to:
while a particular response processing thread of the one or more response processing threads executes to detect completions of persistent storage I/O operations and process responses to access requests:
receive access requests for portions of data maintained as part of a database from one or more clients, wherein the access requests are dependent upon respective persistent storage input/output (I/O) operations to service the access requests such that processing of a particular access request enters a wait state until a respective persistent storage I/O operation is complete;
perform, by each request processing thread of two or more request processing threads from the request processing thread pool:
one or more processing operations to service a respective access request of the access requests such that the respective persistent storage I/O operation is performed for the respective access request;
in response to completion of the one or more processing operations for the access request, return the respective request processing thread to the request processing thread pool to make the respective request processing thread available to process another access request received at the database engine;
detect, by the executing particular response processing thread, that respective ones of the persistent storage I/O operations corresponding to respective access requests serviced by different ones of the plurality of request processing threads, are complete;
and
in response to detection by the particular response processing thread that respective ones of the persistent storage operation are complete, send, by the particular response processing thread, respective responses for the respective access requests serviced by the different ones of the plurality of request processing threads to a client of the one or more clients, wherein the responses are based, at least in part, on respective results of the persistent storage I/O operations.

10 more elements

A method, comprising:

performing, by one or more computing devices:
while a response processing thread executes to detect completions of persistent storage I/O operations and process responses to access requests:
receiving, at a database engine, access requests for portions of data maintained as part of a database from one or more clients, wherein the access requests are dependent upon respective persistent storage input/output (I/O) operations to service the access requests such that processing of a particular access request enters a wait state until a respective persistent storage I/O operation is complete;
performing, by each request processing thread of two or more request processing threads from a request processing thread pool:
one or more processing operations to service a respective access request of the access requests such that the respective persistent storage I/O operation is performed for the respective access request;
and
in response to completing the one or more processing operations for the access request, making the respective request processing thread available to process another access request received at the database engine;
detecting, by the executing response processing thread, that respective ones of the persistent storage I/O operations, corresponding to respective access requests serviced by different request processing threads of the plurality of request processing thread pool, are complete, wherein the response processing thread is different from request processing threads of the request processing thread pool including the two or more request processing threads;
and
sending, by the response processing thread in response to detecting that the respective ones of persistent storage I/O operations are complete, respective responses for the respective access requests including serviced by the different ones of the request processing threads to a client of the one or more clients, wherein the responses are based, at least in part, on respective results of the persistent storage I/O operations.

7 more elements

A non-transitory, computer-readable storage medium, storing program instructions that when executed by one or more computing devices cause the one or more computing devices to implement a database engine that implements:

while a response processing thread executes to detect completions of persistent storage I/O operations and process responses to access requests:
receiving, at a database engine, access requests for portions of data maintained as part of a database from one or more clients, wherein the access requests are dependent upon respective persistent storage input/output (I/O) operations to service the access requests such that processing of a particular access request enters a wait state until a respective persistent storage I/O operation is complete;
performing, by each request processing thread of two or more request processing threads from a request processing thread pool:
one or more processing operations to service a respective access request of the access requests such that the respective persistent storage I/O operation is performed for the respective access request;
and
in response to completing the one or more processing operations for the access request, making the respective request processing thread available to process another access request received at the database engine;
detecting, by the executing response processing thread, that respective ones of the persistent storage I/O operations, corresponding to respective access requests serviced by different request processing threads of the request processing thread pool, are complete, wherein the response processing thread is different from request processing threads of the request processing thread pool including the two or more request processing threads;
and
sending, by the response processing thread in response to detecting that the respective ones of persistent storage I/O operations are complete, respective responses for the respective access requests serviced by the different ones of the request processing threads to a client of the one or more clients, wherein the responses are based, at least in part, on respective results of the persistent storage I/O operations.

6 more elements

Dependencies are inferred from the claim text.