Back to results
US 2023/0401180 A1Published application
Schema evolution
AssigneeSnowflake Inc.
InventorsIstvan Cseri, Benoit Dageville, Ganeshan Ramachandran Iyer, Yucan Liu, Jiaqi Yan
Life of this patent
Estimating the term…
Abstract
Techniques for schema mismatch detection and evolution are described. When data is being uploaded into a source table, schema of the data to be uploaded can be compared with the schema for the source table. If a schema mismatch is detected, the schema of the source table can be modified, and the upload can be continued without data loss.
Claims24
A method comprising:
- receiving, by at least one hardware processor, a notification of a schema mismatch between a file to be ingested and a source table;
- modifying a schema for the source table based on the notification;
- quarantining at least one ingest task associated with the file to be ingested based on detecting the schema mismatch;
- compiling a modified query plan for the at least one quarantined ingest task based on the modified schema of the source table;
- executing the at least one quarantined ingest task based on the modified query plan;
- and
- ingesting the file into the source table using the modified schema.
4 more elements
A machine-storage medium embodying instructions that, when executed by one or more machines, cause the one or more machines to perform operations comprising:
- receiving a notification of a schema mismatch between a file to be ingested and a source table;
- modifying a schema for the source table based on the notification;
- quarantining at least one ingest task associated with the file to be ingested based on detecting the schema mismatch;
- compiling a modified query plan for the at least one quarantined ingest task based on the modified schema of the source table;
- executing the at least one quarantined ingest task based on the modified query plan;
- and
- ingesting the file into the source table using the modified schema.
4 more elements
A system comprising:
- at least one hardware processor;
- and
- at least one memory storing instructions that, when executed by the at least one hardware processor, cause the at least one hardware processor to perform operations comprising:
- receiving a notification of a schema mismatch between a file to be ingested and a source table;
- modifying a schema for the source table based on the notification;
- quarantining at least one ingest task associated with the file to be ingested based on detecting the schema mismatch;
- compiling a modified query plan for the at least one quarantined ingest task based on the modified schema of the source table;
- executing the at least one quarantined ingest task based on the modified query plan;
- and
- ingesting the file into the source table using the modified schema.
7 more elements
Dependencies are inferred from the claim text.