US 11,899,806 B1Granted

Managing data permissions for disparate data sets

AssigneeAmazon Technologies, Inc.

InventorsJohn Thomas Winters, Guanxu Yu, Xuefeng Zhai, Vamshi Krishna Surabhi, Dinesh Thangaraju, Nitin Kishore Gupta

Life of this patent

Estimating the term…

Loading patent…

Abstract

Features are disclosed for managing multiple heterogeneously owned data stores (e.g., data sets, data lakes) and provisioning a framework for data consumers and data publishers. A computing device can obtain a plurality of data catalogs associated with the data stores. For example, the computing device may update a hybrid data catalog with information from the plurality of data catalogs. The computing device can further provide a portion of the plurality of data catalogs to a data consumer. The computing device may provide the portion of the plurality of data catalogs based on permissions provided by the data publisher. In response, the computing device can receive a request to access a data store associated with the plurality of data catalogs. The computing device can transmit the request to a corresponding data publisher and, based on a response by the data publisher, may modify the distinct access controls for the data store.

Claims21

Dependent claims

A computer-implemented method comprising:

under control of a computing system comprising one or more processors configured to execute specific instructions,
obtaining, from a data publisher account, a data management service request identifying publication information and a first data catalog corresponding to a first data store with distinct access controls, the distinct access controls identifying access granted to a data consumer account, wherein the first data catalog stores metadata corresponding to the first data store of a plurality of data stores, wherein the plurality of data stores are associated with a plurality of data publishers, wherein the first data catalog is associated with a first data publisher of the plurality of data publishers, wherein the first data catalog stores metadata identifying information associated with the first data store;
registering the first data catalog in a hybrid data catalog, wherein the hybrid data catalog consolidates a plurality of metadata from a plurality of data catalogs associated with the plurality of data stores;
causing display of at least a portion of the hybrid data catalog via a graphical user interface based at least in part on the publication information, wherein graphical user interface enables discovery of the information associated with the first data store by the data consumer account, wherein the graphical user interface displays at least a portion of the plurality of metadata;
obtaining, from the data consumer account, a request to access the first data store based on an interaction with the graphical user interface;
obtaining a request approval, from the data publisher account in response to the request to access the first data store, wherein the request approval identifies the data consumer account has been authorized to access the first data store;
and
modifying the distinct access controls of the first data store based on obtaining, from the data publisher account, the request approval.

5 more elements

A system comprising:

a data management system comprising computer-readable memory and one or more processors configured to:
obtain, from a first computing device, a data management service request identifying a first data catalog corresponding to a data store with distinct access controls, the distinct access controls identifying access granted to data consumers to access the data store, wherein the first data catalog stores metadata corresponding to the data store of a plurality of data stores, wherein the first data catalog is associated with a first data publisher of a plurality of data publishers, and wherein the first data catalog stores metadata identifying information associated with the data store;
transmit, to a second computing device, data catalog information comprising at least a portion of the first data catalog and at least a portion of a second data catalog associated with a second data publisher of the plurality of data publishers, wherein the data catalog information is based at least in part on data stored in the data store, wherein the distinct access controls identify data consumers authorized to access the data stored in the data store;
obtain, from the second computing device, a request to access at least a portion of the data store based on transmitting the data catalog information;
transmit, to the first computing device, the request to access the at least a portion of the data store;
in response to transmitting the request to access the at least a portion of the data store, obtain, from the first computing device, a response, wherein the response identifies the first computing device has been authorized or declined access to the at least a portion of the data store;
and
modify the distinct access controls of the data store based on obtaining, from the first computing device, the response.

5 more elements

A system comprising:

a data storage medium;
and
one or more computer hardware processors in communication with the data storage medium, wherein the one or more computer hardware processors are configured to execute computer-executable instructions to at least:
obtain, from a first computing device, a data management service request identifying a first data catalog corresponding to a data store with distinct access controls, the distinct access controls identifying access granted to data consumers to access the data store, wherein the first data catalog stores metadata corresponding to the data store of a plurality of data stores, wherein the first data catalog is associated with a first data publisher of a plurality of data publishers, wherein the first data catalog stores metadata identifying information associated with the data store;
transmit, to a second computing device, data catalog information comprising at least a portion of the first data catalog and at least a portion of a second data catalog associated with a second data publisher of the plurality of data publishers, wherein the data catalog information is based at least in part on data stored in the data store, wherein the distinct access controls identify data consumers authorized to access the data stored in the data store;
obtain, from the second computing device, a request to access at least a portion of the data store based on transmitting the data catalog information;
and
modify the distinct access controls of the data store based on the request to access the at least a portion of the data store.

5 more elements

Dependencies are inferred from the claim text.