Multi-level database catalog
AssigneeAmazon Technologies, Inc.
InventorsVinay Singh, Krishnaditya Kandregula, Sachet Saurabh, Parikshit S Pol, Maheshdatta Mishra
Life of this patent
Estimating the term…
Abstract
An improved data system supports creation of multiple hierarchical database catalogs under a particular account. Users or organizations have the flexibility to organize their data, native or external, into an n-level hierarchy of their choice. There is a root database catalog of the account, and other catalogs (1 or n-levels) are created under it. The data system has extract, transform, and load (ETL) features that allows data to be moved between different data sources and targets.
Claims20
A system comprising:
- one or more data storage media to store specific computer-executable instructions;
- and
- one or more computer hardware processors in communication with the one or more data storage media, wherein the specific computer-executable instructions configure the one or more computer hardware processors, upon execution of the specific computer-executable instructions, to at least:
- receive, via an Application Programming Interface (API), a first command to create a hierarchy of database catalogs;
- create, based at least in part on the first command, a catalog data structure comprising a first database catalog with a second database catalog, wherein the second database catalog is a child catalog of the first database catalog;
- receive, via the API, a second command to add or update a first governance policy for the first database catalog;
- update, based at least in part on the second command, the catalog data structure with the first governance policy for the first database catalog that results in a first updated catalog data structure;
- receive, via the API, a third command to add or update a second governance policy for the second database catalog;
- update, based at least in part on the third command, the first updated catalog data structure with the second governance policy for the second database catalog that results in a second updated catalog data structure;
- receive, via the API, a fourth command to create a first database associated with the second database catalog;
- determine that the fourth command is authorized based at least in part on the second governance policy;
- and
- create, based at least in part on the fourth command, the first database associated with the second database catalog that results in a third updated catalog data structure.
A computer-implemented method comprising:
- receiving, via an Application Programming Interface (API), a first command to create a hierarchy of database catalogs;
- creating, based at least in part on the first command, a catalog data structure comprising a first database catalog with a second database catalog, wherein the second database catalog is a child catalog of the first database catalog;
- receiving, via the API, a second command to add or update a governance policy for the second database catalog;
- updating, based at least in part on the second command, the catalog data structure with the governance policy for the second database catalog that results in a first updated catalog data structure;
- receiving, via the API, a third command to create a first database associated with the second database catalog;
- determining that the third command is authorized based at least in part on the governance policy;
- and
- creating, based at least in part on the third command, the first database associated with the second database catalog that results in a second updated catalog data structure.
A system comprising:
- one or more data storage media to store specific computer-executable instructions;
- and
- one or more computer hardware processors in communication with the one or more data storage media, wherein the specific computer-executable instructions configure the one or more computer hardware processors, upon execution of the specific computer-executable instructions, to at least:
- receive, via an Application Programming Interface (API), a first command to create a connection, the first command comprising (i) a connection type and (ii) a connection property indicating an external data store;
- establish the connection with the external data store based at least in part on (i) the connection type and (ii) the connection property;
- receive, via the API, a second command to mount an external catalog, a second command comprising (i) a first identifier identifying a first database catalog, (ii) the connection, and (iii) a second identifier identifying a catalog from the external data store;
- fetch, with the connection, a data set from the external data store associated with the second identifier;
- and
- create, based at least in part on the second command and the data set, a children node linked to the first database catalog that results in a catalog data structure.
Dependencies are inferred from the claim text.