Data pruning based on metadata
AssigneeSnowflake Inc.
InventorsMarcin Zukowski, Benoit Dageville, Thierry Cruanes, Ashish Motivala
Life of this patent
Estimating the term…
Abstract
A system and method for pruning data based on metadata. The method may include receiving a query comprising a plurality of predicates and identifying one or more applicable files comprising database data satisfying at least one of the plurality of predicates. The identifying the one or more applicable files including reading metadata stored in a metadata. store that is separate from the database data. The method further includes pruning inapplicable files comprising database data that does not satisfy at least one of the plurality of predicates to create a reduced set of files and reading the reduced set of files to execute the query.
Claims30
A system comprising:
- a metadata store to store metadata;
- and
- a processor, operatively coupled with the metadata store, to:
- receive a query comprising a plurality of predicates;
- identify one or more applicable files comprising database data satisfying at least one of the plurality of predicates, wherein identifying the one or more applicable files comprises reading the metadata stored in the metadata store that is separate from the database data;
- prune inapplicable files comprising database data that does not satisfy at least one of the plurality of predicates to create a reduced set of files;
- and
- read the reduced set of files to execute the query.
A method comprising:
- receiving a query comprising a plurality of predicates;
- identifying, by a processor, one or more applicable files comprising database data satisfying at least one of the plurality of predicates, wherein the identifying the one or more applicable files comprises reading metadata stored in a metadata store that is separate from the database data;
- pruning inapplicable files comprising database data that does not satisfy at least one of the plurality of predicates to create a reduced set of files;
- and
- reading the reduced set of files to execute the query.
A non-transitory computer readable storage media, programmable to execute instructions that, when executed by a processor, cause the processor to:
- receive a query comprising a plurality of predicates;
- identify one or more applicable files comprising database data satisfying at least one of the plurality of predicates, wherein to identify the one or more applicable files, the processor to read metadata stored in a metadata store that is separate from the database data;
- prune, by the processor, inapplicable files comprising database data that does not satisfy at least one of the plurality of predicates to create a reduced set of files;
- and
- read the reduced set of files to execute the query.
Dependencies are inferred from the claim text.