US 2023/0401193 A1Published application

Providing table data access in user-specified formats on user-managed storage

AssigneeSnowflake Inc.

InventorsSelcuk Aya, Thierry Cruanes, Istvan Cseri, Benoit Dageville, Marcia Feitel, Steven P. Herbert, Xinglian Liu, James Malone, Subramanian Muralidhar, Muthunagappan Muthuraman, Polita Paulus, Marianne Shaw, Nileema Shingte, Wai Sing Wong, Jiaqi Yan

Life of this patent

Estimating the term…

patentgrep

Loading patent…

Abstract

The subject technology receives a command to commit a table in a different table format on an external volume. The subject technology generates a first snapshot of the table on internal storage. The subject technology generates a first list of metadata files on the internal storage. The subject technology generates, based on the first list of metadata files, a first set of metadata files on the internal storage. The subject technology generates a second snapshot of the table on the external volume. The subject technology generates a second list of metadata files on the external volume. The subject technology generates, based on the second list of metadata files, a second set of metadata files on the external volume. The subject technology generates a first set of data files in a different file format on the external volume.

Claims30

Dependent claims

A network-based database system comprising:

at least one hardware processor;
and
a memory storing instructions that cause the at least one hardware processor to perform operations comprising:
receiving a command to commit a table in a different table format on an external volume, the external volume provided by a storage platform of a cloud storage provider system, the different table format being different than a first table format utilized for storing a set of tables in internal storage;
generating a first snapshot of the table on the internal storage, the table being stored in the first table format different than the different table format;
generating a first list of metadata files on the internal storage;
generating, based on the first list of metadata files, a first set of metadata files on the internal storage, the first set of metadata files being stored in a metadata database on the internal storage;
generating a second snapshot of the table on the external volume;
generating a second list of metadata files on the external volume;
generating, based on the second list of metadata files, a second set of metadata files on the external volume;
generating a first set of data files in a different file format on the external volume;
and
sending an indication that the command to commit the table has completed.

10 more elements

A method comprising:

receiving a command to commit a table in a different table format on an external volume, the external volume provided by a storage platform of a cloud storage provider system, the different table format being different than a first table format utilized for storing a set of tables in internal storage;
generating a first snapshot of the table on the internal storage, the table being stored in the first table format different than the different table format;
generating a first list of metadata files on the internal storage;
generating, based on the first list of metadata files, a first set of metadata files on the internal storage, the first set of metadata files being stored in a metadata database on the internal storage;
generating a second snapshot of the table on the external volume;
generating a second list of metadata files on the external volume;
generating, based on the second list of metadata files, a second set of metadata files on the external volume;
generating a first set of data files in a different file format on the external volume;
and
sending an indication that the command to commit the table has completed.

7 more elements

A non-transitory computer-storage medium comprising instructions that, when executed by one or more processors of a machine, configure the machine to perform operations comprising:

receiving a command to commit a table in a different table format on an external volume, the external volume provided by a storage platform of a cloud storage provider system, the different table format being different than a first table format utilized for storing a set of tables in internal storage;
generating a first snapshot of the table on the internal storage, the table being stored in the first table format different than the different table format;
generating a first list of metadata files on the internal storage;
generating, based on the first list of metadata files, a first set of metadata files on the internal storage, the first set of metadata files being stored in a metadata database on the internal storage;
generating a second snapshot of the table on the external volume;
generating a second list of metadata files on the external volume;
generating, based on the second list of metadata files, a second set of metadata files on the external volume;
generating a first set of data files in a different file format on the external volume;
and
sending an indication that the command to commit the table has completed.

7 more elements

Dependencies are inferred from the claim text.

Facts

Application: 18/193,069Filed 30 Mar 2023
Priority: 10 Jun 2022
Published: 14 Dec 2023
Term ends: Not estimatedThe source records don’t support an estimate.

Classification4 codes

G06F 16/2282
Indexing; Data structures therefor; Storage structures: tablespace storage structures; Management thereof
G06F 16/2379
Updating: updates performed during online database operations; commit processing
G06F 16/258
Integrating or interfacing systems involving database management systems: data format conversion from or to a database
G06F
Computing and data processing