Staged query compilation with common data structure

A system for query compilation comprising:

• one or more hardware processors, with memory coupled thereto;
• and
• computer-readable media storing program instructions executable by the one or more hardware processors, the program instructions comprising:
• first instructions which, when executed, cause a logical plan for a database query to be received from a first software module;
• and
• second instructions which, when executed, cause a second software module to determine a physical plan for the logical plan;
• wherein the logical plan and the physical plan each comprise one or more data sources and a plan flow stored according to a common data structure specification, the physical plan further comprising one or more annotations (which are metadata for guiding downstream compilation or execution stages) also stored according to the common data structure specification.

One or more computer-readable media storing program instructions for query compilation, executable by one or more hardware processors, the program instructions comprising:

• first instructions which, upon execution, cause receipt of a query which is a declarative database query;
• second instructions which, upon execution, instruct a first software module to determine a first intermediate plan for the query;
• third instructions which, upon execution, instruct a second software module to determine an execution plan for a second intermediate plan;
• fourth instructions which, upon execution, cause a third intermediate plan to be received from a third software module;
• and
• fifth instructions which, upon execution, cause a fourth intermediate plan to be stored or retrieved;
• wherein each intermediate plan of the first, second, third, and fourth intermediate plans comprise one or more data sources and a plan flow, the each intermediate plan organized as a serialized data structure conforming to a common data structure specification providing a field for the plan flow and additional one or more fields for the one or more data sources;
• wherein the common data structure specification further provides, for a case in which a given plan of the first, second, third, or fourth intermediate plans comprises one or more annotations, one or more additional fields for the one or more annotations;
• and
• wherein the annotations are metadata for guiding downstream compilation or execution stages.