# US 2020/0404055 A1 · Data storage system with redundant internal networks

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2020/0404055 A1
- Document ID: US20200404055A1
- Status: Published application
- Kind: A1
- Application number: 17/013,430
- Filed: 2020-09-04
- Published: 2020-12-24
- Earliest claimed: 2016-12-28
- Assignees: Amazon Technologies, Inc.
- Applicants: Amazon Technologies, Inc.
- Inventors: Norbert P. Kusters; Nachiappan Arumugam; Christopher Nathan Watson; Marc John Brooker; David R. Richardson; Danny Wei; John Luther Guthrie, II
- Web page: https://patentgrep.com/patent/US20200404055A1

## CPC

- H04L 67/1095: Replication or mirroring of data, e.g. scheduling or transport for data synchronisation between network nodes
- G06F 3/0614: {Improving the reliability of storage systems}
- G06F 3/0635: {by changing the path, e.g. traffic rerouting, path reconfiguration}
- G06F 3/0647: {Migration mechanisms}
- G06F 3/065: {Replication mechanisms}
- G06F 3/067: {Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]}
- G06F 3/0685: {Hybrid storage combining heterogeneous device types, e.g. hierarchical storage, hybrid arrays}
- G06F 11/2005: {using redundant communication controllers}
- H04L 61/2503: Translation of Internet protocol [IP] addresses
- H04L 67/1097: for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
- H04L 67/2885: Hierarchically arranged intermediate devices, e.g. for hierarchical caching
- H04L 67/568: Storing data temporarily at an intermediate stage, e.g. caching
- G06F 11/1076: {Parity data used in redundant arrays of independent storages, e.g. in RAID systems}
- G06F 11/1662: {the resynchronized component or unit being a persistent storage device (re-synchronization of failed mirror storage G06F11/2082; rebuild or reconstruction of parity RAID storage G06F11/1008)}
- G06F 11/2015: {Redundant power supplies (power supply failure G06F1/30)}
- G06F 11/2082: {Data synchronisation}
- G06F 11/3409: {for performance assessment}
- H03M 13/154: {Error and erasure correction, e.g. by using the error and erasure locator or Forney polynomial}
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- H03M: CODING; DECODING; CODE CONVERSION IN GENERAL (using fluidic means F15C4/00; optical analogue/digital converters G02F7/00; coding, decoding or code conversion, specially adapted for particular applications, see the relevant subclasses, e.g. G01D, G01R, G06F, G06T, G09G, G10L, G11B, G11C, H04B, H04L, H04M, H04N; ciphering or deciphering for cryptography or other purposes involving the need for secrecy G09C)

## Abstract

A data storage system includes a rack, multiple head nodes, multiple data storage sleds, and at least two networking devices. The at least two network devices are configured to implement at least two redundant networks within the data storage system. Also, each of the head nodes is assigned at least two network addresses for communication with the data storage sleds of the data storage system via the at least two networking devices. The data storage sleds each include multiple mass storage devices and a sled controller that is configured to couple with the at least two network switches. IO In some embodiments, the data storage system further includes redundant power systems within a rack in which the head nodes, the data storage sleds, and the at least two networking devices are mounted.

## Claims

### Claim at position 1

-20. (canceled)

### Claim 21

A data storage system comprising:
a rack;
a plurality of head nodes mounted in the rack;
a plurality of data storage sleds mounted in the rack; and
at least two networking devices mounted in the rack;
wherein the at least two networking devices are configured to implement at least two redundant networks in the rack between the the head nodes and the data storage sleds; and
wherein to implement the at least two redundant networks:
each of the head nodes is coupled to each of the data storage sleds via a first one of the at least two networking devices; and
each of the head nodes is coupled to each of the data storage sleds via a second one of the at least two network devices.

### Claim 22 (depends on 21)

The data storage system of claim 21, wherein each of the head nodes comprises:
at least two redundant network interface cards, wherein:
a first one of the at least two redundant network interface cards couples the respective head node to a first one of the at least two redundant networks; and
a second one of the at least two redundant network interface cards couples the respective head node to a second one of the at least two redundant networks.

### Claim 23 (depends on 21)

The data storage system of claim 21, wherein each of the head nodes comprises:
a set of at least two ports configured to connect the respective head node to each of the at least two redundant networks; and
an additional set of two or more ports configured to couple the respective head node to one or more clients external to the data storage system.

### Claim 24 (depends on 21)

The data storage system of claim 21, wherein each of the head nodes is:
assigned at least two network addresses for communicating via the at least two redundant networks with the data storage sleds and the other head nodes mounted in the rack.

### Claim 25 (depends on 24)

The data storage system of claim 24, wherein the at least two network addresses assigned to each of the head nodes for communicating with the other head nodes and the data storage sleds via the at least two redundant networks are private IP addresses.

### Claim 26 (depends on 25)

The data storage system of claim 25, wherein each of the head nodes is:
further assigned at least two public IP addresses for communicating with client devices external to the data storage system.

### Claim 27 (depends on 21)

The data storage system of claim 21, wherein each of the at least two redundant networks connects respective ones of the head nodes to respective ones of the data storage sleds via a single network hop within the rack.

### Claim 28 (depends on 21)

The data storage system of claim 21, wherein each of the at least two redundant networks connects respective ones of the head nodes to other respective ones of the head nodes via a single network hop within the rack.

### Claim 29 (depends on 21)

The data storage system of claim 21, further comprising:
at least two connectors for coupling the data storage system to at least two independent electrical power sources; and
at least two power distribution systems within the rack configured to supply redundant power from the at least two independent electrical power sources to each of the head nodes and to each of the data storage sleds.

### Claim 30 (depends on 21)

The data storage system of claim 21, wherein each of the head nodes is configured to:
receive a request to write data to a volume stored in the data storage system;
write the data included with the request to a storage drive of the respective head node; and
cause the data to be replicated to another respective head node in the rack via one of the at least two redundant networks in the rack.

### Claim 32 (depends on 30)

The data storage system of claim 30, wherein if a connection to the other respective head node is not available via the one of the at least two redundant networks, the respective head node is configured to cause the data to be replicated to the other respective head node via another one of the at least two redundant networks in the rack.

### Claim 33 (depends on 21)

The data storage system of claim 21, wherein each of the head nodes is configured to:
flush data stored in a storage of the respective head node to a sub-set of the plurality of data storage sleds via one of the at least two redundant network in the rack,
wherein respective portions of the data transmitted to the sub-set of the plurality of data storage sleds are stored in respective portions of storage devices included in the sub-set of the plurality of data storage sleds.

### Claim 34 (depends on 33)

The data storage system of claim 33, wherein if a connection to the sub-set of the data storage sleds is not available via the one of the at least two redundant networks, the respective head node is configured to flush the data to the sub-set of the data storage sleds via another one of the at least two redundant networks in the rack.

### Claim 35

A head node for a data storage system, comprising:
a log-based storage configured to store write data for a volume stored in the data storage system; and
at least two redundant network interface cards,
wherein respective ones of the at least two redundant network interface cards are configured to couple the head node to respective ones of at least two networking devices mounted in a same rack with the head node,
wherein the head node is configured to:
communicate with other head nodes mounted in the same rack with the head node via redundant networks implemented in the same rack with the head node that are implemented via the at least two networking devices coupled to the network interface cards of the head node; and
communicative with data storage sleds mounted in the same rack with the head node via the redundant networks implemented in the same rack with the head node via the at least two networking devices coupled to the network interface cards of the head node.

### Claim 36 (depends on 35)

The system of claim 35, wherein the head node is assigned at least two private IP addresses for communicating with the other head nodes and data storage sleds in the same rack with the head node via the redundant networks implemented in the same rack with the head node.

### Claim 37 (depends on 36)

The system of claim 36, wherein the head node is assigned at least two public IP addresses for communicating with client devices external to the rack.

### Claim 38

A data storage sled, comprising:
a plurality of mass storage devices; and
a storage controller comprising at least two network interfaces configured to couple the data storage sled to a plurality of head nodes mounted in a same rack with the data storage sled via at least two redundant networks implemented in the rack.

### Claim 39 (depends on 38)

The data storage sled of claim 38, wherein:
the data storage sled is assigned at least two network addresses for communicating with respective ones of the head nodes via at least two networking devices mounted in the rack with the data storage sleds and the head nodes.

### Claim 40 (depends on 39)

The data storage sled of claim 39, wherein the at least two network addresses assigned to the data storage sled are private IP addresses.
