# US 2022/0035769 A1 · Peer-to-peer global namespace for storage system metadata federations

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2022/0035769 A1
- Document ID: US20220035769A1
- Status: Published application
- Kind: A1
- Application number: 16/944,250
- Filed: 2020-07-31
- Published: 2022-02-03
- Earliest claimed: 2020-07-31
- Assignees: EMC IP Holding Company LLC
- Applicants: EMC IP Holding Company LLC
- Inventors: Qi Bao
- Web page: https://patentgrep.com/patent/US20220035769A1

## CPC

- G06F 16/178: Techniques for file synchronisation in file systems
- G06F 16/164: {File meta data generation}
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

A peer-to-peer global namespace for storage system metadata federations. Specifically, the disclosure proposes a peer-to-peer metadata federation architecture, where enterprise storage metadata for any and all geo-distributed sites may be distributed across and continually reconciled by a network of nodes, instead of being maintained by a single node assigned to a given geographic location. In implementing a federation, the network of nodes may lack exploitable, centralized points of vulnerability, and therefore, may exhibit no central point of failure. Furthermore, the disclosure proposes the implementation of a global metadata namespace for the enterprise storage metadata spanning the entirety of an enterprise (across all geographic locations). The global metadata namespace may be maintained on each node through event-based synchronization.

## Claims

### Claim 1

A method for synchronizing metadata across a plurality of federation member nodes, comprising:
detecting, by a first federation member node of the plurality of federation member nodes, a discrepancy between a slave metadata collection maintained on the first federation member node and a master metadata collection maintained on a second federation member node of the plurality of federation member nodes;
computing, by the first federation member node and in response to detecting the discrepancy, a local metadata namespace root delta;
transmitting, by the first federation member node and to the second federation member node, a namespace update request comprising the local metadata namespace root delta;
receiving, by the first federation member node, from the second federation member node, and in response to the namespace update request, a set of commits applied to the master metadata collection,
wherein the set of commits represents the discrepancy between the slave and master metadata collections; and
applying, by the first federation member node and to correct the discrepancy, the set of commits to the slave metadata collection.

### Claim 2 (depends on 1)

The method of claim 1, wherein the local metadata namespace root delta comprises a hash difference between a first local metadata namespace root of a first local metadata namespace maintained on the first federation member node and a second local metadata namespace root of a second local metadata namespace maintained on the second federation member node.

### Claim 3 (depends on 2)

The method of claim 2, wherein the first local metadata namespace represents a first hash-based data structure used to verify the slave metadata collection, wherein the second local metadata namespace represents a second hash-based data structure used to verify the master metadata collection.

### Claim 4 (depends on 1)

The method of claim 1, further comprising:
prior to detecting the discrepancy by the first federation member node:
receiving, by the first federation member node and from the second federation member node, a heartbeat message comprising a first metadata namespace summary for a first global metadata namespace maintained on the second federation member node;
obtaining, by the first federation member node, a second metadata namespace summary for a second global metadata namespace maintained on the first federation member node; and
comparing, by the first federation member node, the first and second metadata namespace summaries,
wherein a mismatch between, based on comparing, the first and second metadata namespace summaries leads to detecting the discrepancy.

### Claim 5 (depends on 4)

The method of claim 4, wherein the first global metadata namespace represents a first hash-based data structure used to verify all metadata currently maintained on the second federation member node, wherein the second global metadata namespace represents a second hash-based data structure used to verify all metadata currently maintained on the first federation member node.

### Claim 6 (depends on 5)

The method of claim 5, wherein the first metadata namespace summary comprises a first global metadata namespace root of the first global metadata namespace and a plurality of first local metadata namespace roots of a first plurality of local metadata namespaces for a first plurality of metadata collections maintained on the second federation member node.

### Claim 7 (depends on 6)

The method of claim 6, wherein the second metadata namespace summary comprises a second global metadata namespace root of the second global metadata namespace and a plurality of second local metadata namespace roots of a second plurality of local metadata namespaces for a second plurality of metadata collections maintained on the first federation member node.

### Claim 8 (depends on 4)

The method of claim 4, further comprising:
prior to receiving the heartbeat message by the first federation member node:
detecting, by the second federation member node, the set of commits applied to the master metadata collection maintained thereon; and
multicasting, by the second federation member node and to a remainder of the plurality of federation member nodes comprising the first federation member node, a namespace update message comprising the set of commits,
wherein the first federation member node fails to receive the namespace update message.

### Claim 9 (depends on 8)

The method of claim 8, further comprising:
prior to multicasting the namespace update message by the second federation member node:
obtaining, by the second federation member node, a current local metadata namespace root of a current local metadata namespace maintained on the second federation member node for the master metadata collection;
updating, by the second federation member node and to include the set of commits, the current metadata namespace to obtain a new current metadata namespace;
obtaining, by the second federation member node, a new current local metadata namespace root of the new current metadata namespace;
computing, by the second federation member node, the local metadata namespace root delta using the current and new current local metadata namespace roots; and
mapping, by the second federation member node and in a metadata changes log for the master metadata collection, the set of commits to the local metadata namespace delta.

### Claim 10

A non-transitory computer readable medium (CRM) comprising computer readable program code, which when executed by a first computer processor of a first federation member node, enables the first computer processor to:
detect a discrepancy between a slave metadata collection maintained on the first federation member node and a master metadata collection maintained on a second federation member node;
compute, in response to detecting the discrepancy, a local metadata namespace root delta;
transmit, to the second federation member node, a namespace update request comprising the local metadata namespace root delta;
receive, from the second federation member node and in response to the namespace update request, a set of commits applied to the master metadata collection,
wherein the set of commits represents the discrepancy between the slave and master metadata collections; and
apply, to correct the discrepancy, the set of commits to the slave metadata collection.

### Claim 11 (depends on 10)

The non-transitory CRM of claim 10, wherein the local metadata namespace root delta comprises a hash difference between a first local metadata namespace root of a first local metadata namespace maintained on the first federation member node and a second local metadata namespace root of a second local metadata namespace maintained on the second federation member node.

### Claim 12 (depends on 11)

The non-transitory CRM of claim 11, wherein the first local metadata namespace represents a first hash-based data structure used to verify the slave metadata collection, wherein the second local metadata namespace represents a second hash-based data structure used to verify the master metadata collection.

### Claim 13 (depends on 10)

The non-transitory CRM of claim 10, comprising computer readable program code, which when executed by the first computer processor of the first federation member node, further enables the first computer processor to:
prior to detecting the discrepancy:
receive, from the second federation member node, a heartbeat message comprising a first metadata namespace summary for a first global metadata namespace maintained on the second federation member node;
obtain a second metadata namespace summary for a second global metadata namespace maintained on the first federation member node; and
compare the first and second metadata namespace summaries,
wherein a mismatch between, based on comparing, the first and second metadata namespace summaries leads to detecting the discrepancy.

### Claim 14 (depends on 13)

The non-transitory CRM of claim 13, wherein the first global metadata namespace represents a first hash-based data structure used to verify all metadata currently maintained on the second federation member node, wherein the second global metadata namespace represents a second hash-based data structure used to verify all metadata currently maintained on the first federation member node.

### Claim 15 (depends on 14)

The non-transitory CRM of claim 14, wherein the first metadata namespace summary comprises a first global metadata namespace root of the first global metadata namespace and a plurality of first local metadata namespace roots of a first plurality of local metadata namespaces for a first plurality of metadata collections maintained on the second federation member node.

### Claim 16 (depends on 15)

The non-transitory CRM of claim 15, wherein the second metadata namespace summary comprises a second global metadata namespace root of the second global metadata namespace and a plurality of second local metadata namespace roots of a second plurality of local metadata namespaces for a second plurality of metadata collections maintained on the first federation member node.

### Claim 17 (depends on 13)

The non-transitory CRM of claim 13, comprising computer readable program code, which when executed by a second computer processor of the second federation member node, enables the second computer processor to:
prior to the first computer processor receiving the heartbeat message:
detect the set of commits applied to the master metadata collection maintained on the second federation member node; and
multicast to a remainder of the plurality of federation member nodes comprising the first federation member node, a namespace update message comprising the set of commits,
wherein the first computer processor of the first federation member node fails to receive the namespace update message.

### Claim 18 (depends on 17)

The non-transitory CRM of claim 17, comprising computer readable program code, which when executed by the second computer processor of the second federation member node, further enables the second computer processor to:
prior to multicasting the namespace update message:
obtain a current local metadata namespace root of a current local metadata namespace maintained on the second federation member node for the master metadata collection;
update, to include the set of commits, the current metadata namespace to obtain a new current metadata namespace;
obtain a new current local metadata namespace root of the new current metadata namespace;
compute the local metadata namespace root delta using the current and new current local metadata namespace roots; and
map, in a metadata changes log, the set of commits to the local metadata namespace delta.

### Claim 19

A system, comprising:
a plurality of federation member nodes comprising a first federation member node and a second federation member node,
wherein the first federation member node comprises a computer processor configured to:
detect a discrepancy between a slave metadata collection maintained on the first federation member node and a master metadata collection maintained on the second federation member node;
compute, in response to detecting the discrepancy, a local metadata namespace root delta;
transmit, to the second federation member node, a namespace update request comprising the local metadata namespace root delta;
receive, from the second federation member node and in response to the namespace update request, a set of commits applied to the master metadata collection,
wherein the set of commits represents the discrepancy between the slave and master metadata collections; and
apply, to correct the discrepancy, the set of commits to the slave metadata collection.

### Claim 20 (depends on 19)

The system of claim 19, wherein the plurality of federation member nodes forms a geo-distributed, decentralized peer-to-peer network.
