Resource optimization for serverless query processing

A device in a serverless query processing system, comprising:

• at least one processor;
• and
• at least one memory in communication with the at least one processor, wherein the at least one memory comprises instructions executed by the at least one processor to process queries including:
• receiving a query;
• determining whether the query is a recurring query or a non-recurring query;
• predicting, in response to determining that the query is the recurring query, a peak resource requirement during an execution of the query;
• computing, in response to determining that the query is the non-recurring query, a tight resource requirement corresponding to an amount of resources that satisfy a performance requirement over the execution of the query, wherein the tight resource requirement is less than the peak resource requirement;
• allocating resources to the query based on an applicable one of the peak resource requirement or the tight resource requirement;
• and
• starting the execution of the query using the resources.

A non-transitory computer-readable medium storing instructions that, when executed by at least one processor of a serverless query processing system, cause the serverless query processing system to process queries including:

• receiving a query;
• determining whether the query is a recurring query or a non-recurring query;
• predicting, in response to determining that the query is the recurring query, a peak resource requirement during an execution of the query;
• computing, in response to determining that the query is the non-recurring query, a tight resource requirement corresponding to an amount of resources that satisfy a performance requirement over the execution of the query, wherein the tight resource requirement is less than the peak resource requirement;
• allocating resources to the query based on an applicable one of the peak resource requirement or the tight resource requirement;
• and
• starting the execution of the query using the resources.