Multi-phase query plan caching

A method comprising:

• receiving a query, the query including a statement for performing the query;
• performing a first lookup operation on a multi-phase cache based on the query;
• performing, in response to a first cache miss of the multi-phase cache, parsing of the statement from the query;
• performing a partial auto-parameterization process based on the parsed statement;
• performing a second lookup operation on the multi-phase cache based on the partial auto-parameterization process;
• performing, in response to a second cache miss of the multi-phase cache, a compilation process on the query to generate a compiled query plan;
• determining that the compiled query plan is cacheable;
• registering, in response to the compiled query plan being cacheable, a dummy entry in the multi-phase cache;
• receiving a second query, the second query including a second statement for performing the second query;
• performing the first lookup operation on the multi-phase cache based on the second query;
• determining whether a first cache hit of the multi-phase cache has occurred based on the first lookup operation locating the dummy entry;
• performing the compilation process on the second query to generate a compiled second query plan, the compilation process using a set of generalization requirements;
• determining that the compiled second query plan is cacheable;
• registering, in response to the compiled second query plan being cacheable, a generalized query plan in the multi-phase cache;
• and
• removing the dummy entry from the multi-phase cache.

A non-transitory computer-storage medium comprising instructions that, when executed by one or more processors of a machine, configure the machine to perform operations comprising:

• receiving a query, the query including a statement for performing the query;
• performing a first lookup operation on a multi-phase cache based on the query;
• performing, in response to a first cache miss of the multi-phase cache, parsing of the statement from the query;
• performing a partial auto-parameterization process based on the parsed statement;
• performing a second lookup operation on the multi-phase cache based on the partial auto-parameterization process;
• performing, in response to a second cache miss of the multi-phase cache, a compilation process on the query to generate a compiled query plan;
• determining that the compiled query plan is cacheable;
• registering, in response to the compiled query plan being cacheable, a dummy entry in the multi-phase cache;
• receiving a second query, the second query including a second statement for performing the second query;
• performing the first lookup operation on the multi-phase cache based on the second query;
• determining whether a first cache hit of the multi-phase cache has occurred based on the first lookup operation locating the dummy entry;
• performing the compilation process on the second query to generate a compiled second query plan, the compilation process using a set of generalization requirements;
• determining that the compiled second query plan is cacheable;
• registering, in response to the compiled second query plan being cacheable, a generalized query plan in the multi-phase cache;
• and
• removing the dummy entry from the multi-phase cache.