# US 10,311,019 B1 · Distributed architecture model and management

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 10,311,019 B1
- Document ID: US10311019B1
- Status: Granted
- Kind: B1
- Application number: 13/435,009
- Filed: 2012-03-30
- Granted: 2019-06-04
- Earliest claimed: 2011-12-21
- Assignees: EMC IP Holding Company LLC
- Applicants: Sudhir Vijendra; Patricia G. S. Florissi
- Inventors: Sudhir Vijendra; Patricia G. S. Florissi
- Web page: https://patentgrep.com/patent/US10311019B1

## CPC

- G06F 16/00: Information retrieval; Database structures therefor; File system structures therefor
- G06F 9/46: Multiprogramming arrangements
- G06F 9/5077: {Logical partitioning of resources; Management or configuration of virtualized resources (specific details on emulation or internal functioning of virtual machines G06F9/455)}
- G06F 16/11: File system administration, e.g. details of archiving or snapshots (error detection or correction of the data by redundancy in operations G06F11/14)
- G06F 16/188: Virtual file systems
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

A method, apparatus and computer program product including determining a set of objects to be represented in a computer model, determining the relationships between the object to be represented in the computer model, creating representations in the computer model of the set of objects and relationships between the objects, the representations including big data architecture representations and role representations, and where analysis may be performed on the representations of the computer model.

## Claims

### Claim 1

A computer implemented method for generating a file system for use in distributed storage systems, the method comprising:
determining a set of objects from a big data cloud architecture to be represented in a computer model implemented on one or more computers; wherein the determining the set of objects includes determining architecture sets; wherein the architecture sets are enabled to comprise racks, clusters, and nodes;
determining the relationships between the set of objects of the big data cloud architecture to be represented in the computer model; wherein determining the relationships between the set of objects includes determining the role of the determined set of objects including existence of master and slave relationships;
creating representations in the computer model of the set of objects of the big data cloud architecture and relationships between the objects of the set of objects of the big data cloud architecture by defining representations of the set of objects and relationships between the objects in the computer model to transform a portion of the big data cloud architecture into the computer model; wherein at least one of the representations is transformed from a data set representing the big data cloud architecture; wherein representations include big data cloud architecture representations and role representations between the representations of the big data cloud architecture;
determining a worldwide Hadoop file system that extends over a plurality of Hadoop clusters, the Hadoop clusters being created based on representations of the big data cloud architecture, the worldwide Hadoop file system being determined based on a worldwide Hadoop mapping, that maps out the Hadoop clusters into the file system, the worldwide Hadoop mapping being determined based on the big data cloud architecture and a big data cloud processing methodology, wherein the big data cloud processing methodology manages data flow and data analysis of the big data cloud architecture; and
using the worldwide Hadoop file system to perform at least one of scattering, replicating, or managing data in the Hadoop clusters.

### Claim 2 (depends on 1)

The method of claim 1 further comprising:
creating representations in the computer model of one or more skies, clouds, and data centers;
creating representations in the computer model of one or more file systems, files, and file system blocks;
creating layered over relationships between the one or more file system blocks and the representations of the one or more nodes; and
creating layered over representations of the one or more files over the one or more clouds.

### Claim 3 (depends on 2)

The method of claim 2 further comprising:
creating representations in the computer model of one or more master nodes, slave nodes, and data nodes;
creating tracked by relationship representations between the one or more name nodes and the one or more data nodes;
creating assumed by relationship representations between the one or more file system blocks and the one or more nodes; and
creating served by relationship representations between the one or more file system blocks and the one or more data nodes.

### Claim 4 (depends on 3)

The method of claim 3 further comprising:
creating assumed by relationship representations between the one or more nodes and the one or more data nodes; and
creating tracked by relationship representations between the one or more name nodes and the one or more nodes.

### Claim 5 (depends on 2)

The method of claim 2 further comprising:
creating assumed by relationship representations between the one or more nodes and the one or more file system blocks;
creating assumed by relationship representations between the one or more name nodes and the one or more nodes;
creating assumed by relationship representations between the one or more nodes and the one or more data nodes;
creating tracked by relationship representations between the one or more data nodes and the one or more name nodes;
creating assumed by relationship representations between the one or more nodes and the one or more data nodes;
creating served by relationship representations between the one or more file system blocks and the one or more data nodes;
creating served by relationship representations between the one or more files and the one or more name nodes.

### Claim 6 (depends on 2)

The method of claim 2 further comprising:
creating layered over relationships between the one or more clouds and the representations of the one or more files; and
creating layered over relationships between the one or more nodes and the representations of the one or more file system blocks.

### Claim 7

A computer program product for generating a file system for use in distributed storage systems, the computer program product comprising:
a non-transitory computer readable medium comprising computer executable program code for replication of data, the code configured to enable the execution across one or more processors of:
determining a set of objects from a big data cloud architecture to be represented in a computer model implemented on one or more computers; wherein the determining the set of objects includes determining architecture sets; wherein the architecture sets are enabled to comprise racks, clusters, and nodes;
determining the relationships between the set of objects of the big data cloud architecture to be represented in the computer model; wherein determining the relationships between the set of objects includes determining the role of the determined set of objects including existence of master and slave relationships;
creating representations in the computer model of the set of objects of the big data cloud architecture and relationships between the objects of the set of objects of the big data cloud architecture by defining representations of the set of objects and relationships between the objects in the computer model to transform a portion of the big data cloud architecture into the computer model; wherein at least one of the representations is transformed from a data set representing the big data cloud architecture; wherein representations include big data cloud architecture representations and role representations between the representations of the big data cloud architecture;
determining a worldwide Hadoop file system that extends over a plurality of Hadoop clusters, the Hadoop clusters being created based on representations of the big data cloud architecture, the worldwide Hadoop file system being determined based on a worldwide Hadoop mapping that maps out the Hadoop clusters into the file system, the worldwide Hadoop mapping being determined based on the big data cloud architecture and a big data cloud processing methodology, wherein the big data cloud processing methodology manages data flow and data analysis of the big data cloud architecture; and
using the worldwide Hadoop file system to perform at least one of scattering, replicating, or managing data in the Hadoop clusters.

### Claim 8 (depends on 7)

The computer program product of claim 7 wherein the code further enables execution of:
creating representations in the computer model of one or more skies, clouds, and data centers;
creating representations in the computer model of one or more file systems, files, and file system blocks;
creating layered over relationships between the one or more file system blocks and the representations of the one or more nodes; and
creating layered over representations of the one or more files over the one or more clouds.

### Claim 9 (depends on 8)

The computer program product of claim 8 wherein the code further enables execution of:
creating representations in the computer model of one or more master nodes, slave nodes, and data nodes;
creating tracked by relationship representations between the one or more name nodes and the one or more data nodes;
creating assumed by relationship representations between the one or more file system blocks and the one or more nodes; and
creating served by relationship representations between the one or more file system blocks and the one or more data nodes.

### Claim 10 (depends on 9)

The computer program product of claim 9 wherein the code further enables execution of:
creating assumed by relationship representations between the one or more nodes and the one or more data nodes
creating tracked by relationship representations between the one or more name nodes and the one or more nodes; and
creating assumed by relationship representations between the one or more nodes and the one or more data nodes.

### Claim 11 (depends on 9)

The computer program product of claim 9 wherein the code further enables execution of:
creating assumed by relationship representations between the one or more nodes and the one or more file system blocks;
creating assumed by relationship representations between the one or more name nodes and the one or more nodes;
creating assumed by relationship representations between the one or more nodes and the one or more data nodes;
creating tracked by relationship representations between the one or more data nodes and the one or more name nodes;
creating assumed by relationship representations between the one or more nodes and the one or more data nodes;
creating served by relationship representations between the one or more file system blocks and the one or more data nodes; and
creating served by relationship representations between the one or more files and the one or more name nodes.

### Claim 12 (depends on 9)

The computer program product of claim 9 wherein the code further enables execution of:
creating layered over relationships between the one or more clouds and the representations of the one or more files; and
creating layered over relationships between the one or more nodes and the representations of the one or more file system blocks.

### Claim 13

An apparatus for generating a file system for use in distributed storage systems, the apparatus comprising:
one or more processors;
computer executable program code for replication of data, the code configured to enable the execution across the one or more processors of:
determining a set of objects from a big data cloud architecture to be represented in a computer model implemented on one or more computers; wherein the determining the set of objects includes determining architecture sets; wherein the architecture sets are enabled to comprise racks, clusters, and nodes;
determining the relationships between the set of objects of the big data cloud architecture to be represented in the computer model; wherein determining the relationships between the set of objects includes determining the role of the determined set of objects including existence of master and slave relationships;
creating representations in the computer model of the set of objects of the big data cloud architecture and relationships between the objects of the set of objects of the big data cloud architecture by defining representations of the set of objects and relationships between the objects in the computer model to transform a portion of the big data cloud architecture into the computer model; wherein at least one of the representations is transformed from a data set representing the big data cloud architecture;
wherein representations include big data cloud architecture representations and role representations between the representations of the big data cloud architecture;
determining a worldwide Hadoop file system that extends over a plurality of Hadoop clusters, the Hadoop clusters being created based on representations of the big data cloud architecture, the worldwide Hadoop file system being determined based on a worldwide Hadoop mapping that maps out the Hadoop clusters into the file system, the worldwide Hadoop mapping being determined based on the big data cloud architecture and a big data cloud processing methodology, wherein the big data cloud processing methodology manages data flow and data analysis of the big data cloud architecture; and
using the worldwide Hadoop file system to perform at least one of scattering, replicating, or managing data in the Hadoop clusters.

### Claim 14 (depends on 13)

The apparatus of claim 13 the code further configured to enable:
creating representations in the computer model of one or more skies, clouds, and data centers;
creating representations in the computer model of one or more file systems, files, and file system blocks;
creating layered over relationships between the one or more file system blocks and the representations of the one or more nodes; and
creating layered over representations of the one or more files over the one or more clouds.

### Claim 15 (depends on 14)

The apparatus of claim 14 the code further configured to enable:
creating representations in the computer model of one or more master nodes, slave nodes, and data nodes;
creating tracked by relationship representations between the one or more name nodes and the one or more data nodes;
creating assumed by relationship representations between the one or more file system blocks and the one or more nodes; and
creating served by relationship representations between the one or more file system blocks and the one or more data nodes.

### Claim 16 (depends on 15)

The apparatus of claim 15 the code further configured to enable:
creating assumed by relationship representations between the one or more nodes and the one or more data nodes;
creating tracked by relationship representations between the one or more name nodes and the one or more nodes; and
creating assumed by relationship representations between the one or more nodes and the one or more data nodes.

### Claim 17 (depends on 15)

The apparatus of claim 15 the code further configured to enable:
creating assumed by relationship representations between the one or more nodes and the one or more file system blocks;
creating assumed by relationship representations between the one or more name nodes and the one or more nodes;
creating assumed by relationship representations between the one or more nodes and the one or more data nodes;
creating tracked by relationship representations between the one or more data nodes and the one or more name nodes;
creating assumed by relationship representations between the one or more nodes and the one or more data nodes;
a software module executing on one or more of the one or more processors for creating served by relationship representations between the one or more file system blocks and the one or more data nodes; and
creating served by relationship representations between the one or more files and the one or more name nodes.

### Claim 18 (depends on 15)

The apparatus of claim 15 the code further configured to enable:
creating layered over relationships between the one or more clouds and the representations of the one or more files; and
creating layered over relationships between the one or more nodes and the representations of the one or more file system blocks.
