Back to results
US 10,762,106 B2Granted
Query plans for analytic SQL constructs
AssigneeSnowflake Inc.
InventorsBenoit Dageville, Thierry Cruanes, Allison Waingold Lee
Life of this patent
Estimating the term…
Abstract
A system and method for managing data storage and data access with querying data in a distributed system without buffering the results on intermediate operations in disk storage.
Claims26
A method comprising:
- initiating, within a first execution node of an execution platform, a first operator in a query plan to process a set of data and generate an intermediate result of a query;
- determining whether the first operator has produced an output from processing the set of data;
- responsive to determining that the first operator has generated some output:
- pushing, during execution of the query plan, the output of the first operator to a plurality of secondary operators in the query plan for concurrent processing by the plurality of secondary operators;
- and
- initiating each of the other secondary operators to process the intermediate result to generate a plurality of second results;
- operating on the intermediate result to generate a final result;
- and
- storing the final result to disk storage within a storage platform that is separate from the execution platform.
6 more elements
A non-transitory machine readable medium storing instructions that, when executed by the one or more processors, cause the one or more processors to:
- initiate, within a first execution node of an execution platform, a first operator in a query plan to process a set of data and generate an intermediate result of a query;
- determine, by the one or more processors, whether the first operator has produced an output from processing the set of data;
- and
- responsive to determining that the first operator has generated some output:
- push, during execution of the query plan, the first operator output to a plurality of secondary operators in the query plan for concurrent processing by the plurality of secondary operators;
- and
- initiate each of the other secondary operators to process the intermediate result to generate a plurality of second results;
- operate on the intermediate result to generate a final result;
- and
- store the final result to disk storage within a storage platform that is separate from the execution platform.
7 more elements
A system, comprising:
- one or more processors to:
- initiate, within a first execution node of an execution platform, a first operator in a query plan to process a set of data and generate an intermediate result of a query without writing result data to the disk storage within a storage platform that is separate from the execution platform;
- push, during execution of the query plan, the output of the first operator to a plurality of secondary operators in the query plan for concurrent processing by the plurality of secondary operators to generate a plurality of second results;
- and
- operate on the intermediate result to generate a final result;
- and
- store the final result to disk storage within the storage platform.
4 more elements
A system, comprising:
- one or more processors to:
- initiate, within a first execution node of an execution platform, a first operator in a query plan to process a set of data and generate an intermediate result of a query;
- determine whether the first operator has produced an output from processing the set of data;
- responsive to determining that the first operator has generated some output:
- push, during execution of the query plan, the output of the first operator to a plurality of secondary operators in the query plan for concurrent processing by the plurality of secondary operators;
- and
- initiate each of the other secondary operators to process the intermediate result to generate a plurality of second results;
- operate on the intermediate result to generate a final result;
- and
- store the final result to disk storage within a storage platform that is separate from the execution platform.
7 more elements
Dependencies are inferred from the claim text.