Auto refresh of directory tables for stages
AssigneeSnowflake Inc.
InventorsPolita Paulus, Aravind Ramarathinam, Saurin Shah
Life of this patent
Estimating the term…
Abstract
In one aspect, a method includes forming, at a database platform, a file stage in a user account on the database platform, the user account being associated with a client, forming, at the database platform, a hidden stage directory table and a data pipeline for the file stage, and binding the data pipeline to the file stage. The method also includes receiving a notification of an event of the file stage. The method also includes identifying the data pipeline corresponding to the file stage. The method also includes updating the hidden stage directory table of the identified data pipeline.
Claims20
A method comprising:
- storing an internal stage of a database platform;
- generating, at the database platform, a file stage of the internal stage based on file stage properties attributes indicating an auto-refresh setting enabled;
- in response to the auto-refresh setting enabled in the file stage properties attributes, generating, at the database platform, a hidden stage directory table and a data pipeline for the file stage;
- binding the data pipeline to the file stage of the internal stage;
- and
- updating the hidden stage directory table of the data pipeline with metadata extracted from the database platform.
A computing apparatus comprising:
- one or more processors;
- and
- a memory storing instructions that, when executed by the one or more processors, configure the apparatus to perform operations comprising:
- storing an internal stage of a database platform;
- generating, at the database platform, a file stage of the internal stage based on file stage properties attributes indicating an auto-refresh setting enabled;
- in response to the auto-refresh setting enabled in the file stage properties attributes, generating, at the database platform, a hidden stage directory table and a data pipeline for the file stage;
- binding the data pipeline to the file stage of the internal stage;
- and
- updating the hidden stage directory table of the data pipeline with metadata extracted from the database platform.
A non-transitory computer-readable storage medium, the computer-readable storage medium including instructions that when executed by a computer, cause the computer to perform operations comprising:
- storing an internal stage of a database platform;
- generating, at the database platform, a file stage of the internal stage based on file stage properties attributes indicating an auto-refresh setting enabled;
- in response to the auto-refresh setting enabled in the file stage properties attributes, generating, at the database platform, a hidden stage directory table and a data pipeline for the file stage;
- binding the data pipeline to the file stage of the internal stage;
- and
- updating the hidden stage directory table of the data pipeline with metadata extracted from the database platform.
Dependencies are inferred from the claim text.