# US 2016/0253340 A1 · Data management platform using metadata repository

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2016/0253340 A1
- Document ID: US20160253340A1
- Status: Published application
- Kind: A1
- Application number: 14/633,703
- Filed: 2015-02-27
- Published: 2016-09-01
- Earliest claimed: 2015-02-27
- Assignees: Podium Data, Inc.
- Applicants: Podium Data, Inc.
- Inventors: Paul S. Barth; Atif Majid; Robert Vecchione; Michael T. Howard
- Web page: https://patentgrep.com/patent/US20160253340A1

## CPC

- G06F 16/122: {using management policies (point-in-time backing up or restoration of persistent data G06F11/1446; file migration policies for HSM systems G06F16/185)}
- G06F 16/13: File access structures, e.g. distributed indices (arrangements of input from, or output to, record carriers G06F3/06)
- G06F 16/148: {File search processing}
- G06F 16/182: Distributed file systems
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

An analytical computing environment for large data sets comprises a software platform for data management. The platform provides various automation and self-service features to enable those users to rapidly provision and manage an agile analytics environment. The platform leverages a metadata repository, which tracks and manages all aspects of the data lifecycle. The repository maintains various types of platform metadata including, for example, status information (load dates, quality exceptions, access rights, etc.), definitions (business meaning, technical formats, etc.), lineage (data sources and processes creating a data set, etc.), and user data (user rights, access history, user comments, etc.). Within the platform, the metadata is integrated with all platform services, such as load processing, quality controls and system use. As the system is used, the metadata gets richer and more valuable, supporting additional automation and quality controls.

## Claims

### Claim 1

A data management platform, comprising:
a shared hardware and software infrastructure comprising a distributed file system cluster for data storage; and
a management server operative to receive and manage data from a set of data sources as a data analytics environment, the data being stored in the distributed file system cluster, the management server comprising a set of data management platform services to manage data throughout its lifecycle in the data management platform, the management server operative to generate and maintain platform metadata for use in managing the data, the platform metadata comprising information exposed and available to each data management platform service during the lifecycle.

### Claim 2 (depends on 1)

The data management platform as described in claim 1 wherein the information comprises status information that is one of: data load dates, data quality exceptions, data profiling information, and data access rights.

### Claim 3 (depends on 1)

The data management platform as described in claim 1 wherein the information comprises business and technical format definitions.

### Claim 4 (depends on 1)

The data management platform as described in claim 1 wherein the information comprises lineage information.

### Claim 5 (depends on 1)

The data management platform as described in claim 1 wherein the information comprises user data that is one of: user rights, access history, and user comment data.

### Claim 6 (depends on 1)

The data management platform as described in claim 1 wherein the data management platform services includes a load processing service to receive transfer of data from a data source, and to perform a quality control on the transferred data.

### Claim 7 (depends on 6)

The data management platform as described in claim 6 wherein the data management platform services include a source processing service to format and profile data received from the load processing service.

### Claim 8 (depends on 7)

The data management platform as described in claim 7 wherein the data management platform services include a subject processing service to standardize and transform data received from the source processing service.

### Claim 9 (depends on 1)

The data management platform as described in claim 1 wherein the data management platform services include an analytics processing service to format data to facilitate an analysis.

### Claim 10 (depends on 1)

The data management platform as described in claim 1 wherein the data management platform services includes an access service to enable receipt of a query with respect to the data.

### Claim 11 (depends on 1)

The data management platform as described in claim 1 further including an interface to the data.

### Claim 12 (depends on 1)

The data management platform as described in claim 1 wherein the interface provides a browse and search function with respect to one of: the data, and the platform metadata.

### Claim 13 (depends on 1)

The data management platform as described in claim 1 wherein the interface provides a browse, search and select function to enable definition of a given subset of the data or platform metadata for analysis.

### Claim 14 (depends on 13)

The data management platform as described in claim 13 wherein the interface is operative to create a view of selected data for interactive querying.

### Claim 15 (depends on 13)

The data management platform as described in claim 13 wherein the interface includes an interactive tool to design a custom data flow.

### Claim 16 (depends on 12)

The data management platform as described in claim 12 wherein information identified by the search and browse function is adapted to be tagged to facilitate a subsequent collaboration with respect to the tagged data.

### Claim 17 (depends on 1)

The data management platform as described in claim 1 wherein the data management platform services include a data protection service.

### Claim 18 (depends on 17)

The data management platform as described in claim 17 wherein the data protection service compresses and encrypts given data, wherein the given data is compressed at a block-based level.

### Claim 19 (depends on 1)

The data management platform as described in claim 1 wherein the distributed file system cluster is Hadoop.

### Claim 20 (depends on 1)

The data management platform as described in claim 1 wherein first and second data analytics environments are instantiated by the management server, the first data analytics environment associated with a first enterprise, and the second data analytics environment associated with a second enterprise distinct from the first enterprise.
