# US 2015/0103826 A1 · System and method for using a multi-protocol fabric module across a distributed server interconnect fabric

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2015/0103826 A1
- Document ID: US20150103826A1
- Status: Published application
- Kind: A1
- Application number: 14/052,723
- Filed: 2013-10-12
- Published: 2015-04-16
- Earliest claimed: 2013-10-12
- Assignees: Calxeda, Inc.
- Inventors: Mark Bradley Davis
- Web page: https://patentgrep.com/patent/US20150103826A1

## CPC

- H04L 49/25: Routing or path finding in a switch fabric
- H04L 49/602: {Multilayer or multiprotocol switching, e.g. IP switching}
- H04L 45/52: Multiprotocol routers
- H04L 45/74: Address processing for routing
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)

## Abstract

A multi-protocol personality module enabling load/store from remote memory, remote Direct Memory Access (DMA) transactions, and remote interrupts, which permits enhanced performance, power utilization and functionality. In one form, the module is used as a node in a network fabric and adds a routing header to packets entering the fabric, maintains the routing header for efficient node-to-node transport, and strips the header when the packet leaves the fabric. In particular, a remote bus personality component is described. Several use cases of the Remote Bus Fabric Personality Module are disclosed: 1) memory sharing across a fabric connected set of servers; 2) the ability to access physically remote Input Output (I/O) devices across this fabric of connected servers; and 3) the sharing of such physically remote I/O devices, such as storage peripherals, by multiple fabric connected servers.

## Claims

### Claim 1

In a network system having compute nodes connected by a switched interconnect fabric, a plurality of switching nodes each comprising:
one or more processors;
a bus fabric coupled to the one or more processors;
a fabric switch coupled to the switched interconnect fabric; and
a plurality of protocol specific personality modules each coupled to the bus fabric and to the fabric switch in parallel therebetween, wherein at least two of the protocol specific personality modules are configured in accordance with different protocols with respect to each other and wherein at least one of the protocol specific personality modules includes:
a routing header processor that inspects data packets received thereby and adds a routing header for data packets destined for entering the switched interconnect fabric and removes a routing header from data packets received from the switched interconnect fabric, wherein said adding and removing of the routing header is performed based on a protocol-dependent basis.

### Claim 2

A switching node, comprising:
a plurality of protocol specific personality modules, wherein at least two of the protocol specific personality modules are configured in accordance with different protocols with respect to each other and wherein at least one of the protocol specific personality modules includes:
a routing header processor that inspects data packets received thereby and adds a routing header for data packets destined for entering the switched interconnect fabric and removes a routing header from data packets received from the switched interconnect fabric, wherein said adding and removing of the routing header is performed based on a protocol-dependent basis.

### Claim 3

A System on a Chip (SoC) fabric node for transporting data packets across a fabric, comprising:
one or more processors;
a bus fabric coupled to the one or more processors;
a fabric switch coupled to the fabric, wherein the fabric switch allows a packet to be routed to a destination within the fabric using only information in a fabric routing header thereof without inspection of underlying data payload associated therewith;
a local area network data communication portion coupled to the bus fabric and to the fabric switch, wherein the local area network data communication portion includes:
a local area network data communication controller connected to the bus fabric and generating local data communication frames;
a local area network data communication Bridge Personality Module connected to said local area network data communication controller to add a fabric routing header to the local area network data communication frame to create a routing frame configured for being routed to a destination within the fabric using only information in the fabric routing header thereof;
the local area network data communication Bridge Personality Module coupled to the fabric switch, wherein the fabric switch accepts a routing frame and outputs the routing frame to another node of the fabric; and
a Remote Bus portion coupled to the bus fabric and the fabric switch in parallel with the local area network data communication portion for enabling bus transactions to be transported between nodes of the fabric, wherein the Remote Bus portion includes:
a remote address translation module connected to the bus fabric for converting a local address of a bus transaction to a remote node address;
a bus bridge connected to said remote address translation module to packetize the bus transaction;
a Remote Bus Personality Processor connected to said bus bridge for adding a fabric routing header to said packetized bus transactions to create a routing packet configured for being routed to a destination within the fabric using only information in the fabric routing header thereof; and
said Remote Bus Personality Processor being coupled to said fabric switch, wherein the fabric switch accepts the routing packet and outputs the routing packet to another node of the fabric.

### Claim 4 (depends on 3)

The SoC fabric node of claim 3, wherein the Remote Bus portion includes a remote interrupt manager connected to said Remote Bus Personality Processor and to an interrupt line, wherein said interrupt manager accepts an interrupt and creates a packet tagged as an interrupt packet and sent to said Remote Bus Personality Processor.

### Claim 5

A Remote Bus Personality Portion of a first one of a plurality of System on a Chip (SoC) fabric nodes, comprising:
a remote address translation module for accepting a data packet having a local address and converting the local address to a remote address of a second one of the plurality of SoC fabric nodes;
a bus bridge for transforming a bus transaction to one or more packets compatible with a switched interconnect fabric through which the first one of the plurality of SoC fabric nodes is coupled to the second one of the plurality of SoC fabric nodes; and
a remote bus processor module for adding a routing header to said one or more packet destined for entering the switched interconnect fabric through a fabric switch that allows the one or more packets to be routed to an intended destination thereof within the fabric using only information in the fabric routing header thereof without inspection of underlying data payload associated therewith, wherein information in the routing header is representative of the intended destination thereof.

### Claim 6 (depends on 5)

The Remote Bus Personality Portion of claim 5, including an interrupt line extending to an interrupt manager in said module, and said interrupt manager being connected to said remote bus processor module for generating an interrupt originating from one node in the fabric to another node in the fabric.

### Claim 7

A method of sharing memory across nodes in a fabric of interconnected nodes, comprising:
issuing a load/store transaction to a Remote Bus Personality Portion of a local System on a Chip (SoC) fabric node as a bus transaction;
packetizing at least a portion of the bus transaction and creating one or more packets compatible with the fabric;
creating a routing header for a destination SoC fabric node and adding the routing header to said one or more packets to create a routing frame configured for being routed to the destination SoC fabric node using only information in the fabric routing header thereof; and
transmitting the routing frame into said fabric and delivering the routing frame to said destination SoC fabric node using only information within the routing header.

### Claim 8

A method of accessing an Input/Output (I/O) device by a server where the I/O device and server are nodes in a fabric of interconnected nodes, comprising:
issuing a bus transaction to a Remote Bus Personality Portion of the server, wherein the Remote Bus Personality portion is coupled to a bus fabric and to a fabric switch of the server for enabling the bus transaction to be transported between nodes of the fabric, wherein the Remote Bus Personality portion includes a remote address translation module connected to the bus fabric for converting a local address of the bus transaction to a remote node address, a bus bridge connected to said remote address translation module to packetize the bus transaction, and a Remote Bus Personality Processor connected to said bus bridge for adding a fabric routing header to said packetized bus transactions to create a routing packet configured for being routed to a destination within the fabric using only information in the fabric routing header thereof;
sending the bus transaction from the Remote Bus Personality Portion to the I/O device via the fabric;
creating a routing header at the I/O device for said server and adding the routing header to a payload to create a routing frame configured for being routed to the destination SoC fabric node using only information in the fabric routing header thereof; and
transmitting the routing frame from the I/O device into said fabric and delivering the routing frame to said server using only information within the routing header.

### Claim 9 (depends on 8)

The method of claim 8, wherein said I/O device is a remote Peripheral Component Interconnect Express (PCIe) controller.

### Claim 10 (depends on 8)

The method of claim 8, wherein said I/O device is a remote Serial AT Attachment (SATA) controller.

### Claim 11 (depends on 8)

The method of claim 8, including a DMA engine in said I/O device.

### Claim 12 (depends on 8)

The method of claim 8, including routing DMA traffic bi-directionally via said fabric.

### Claim 13 (depends on 8)

The method of claim 8, including generating an interrupt by said I/O device and transmitted via said fabric to said server.

### Claim 14

A method of sharing storage among a plurality of servers and a plurality of storage peripherals where the peripherals and servers are nodes in a fabric of interconnected nodes, comprising:
sending a message from a server to a peripheral describing information to be accessed at the peripheral and the physical address on the server for said information;
issuing a transaction to a Remote Bus Personality Portion on the peripheral for said information;
packetizing said information into one or more packets;
creating a routing header for said server;
adding said routing header to said one or more packets to create routing frames each configured for being routed to the server using only information in the fabric routing header thereof; and
transmitting the routing frames into the fabric and delivering the routing frames to said server.

### Claim 15 (depends on 14)

The method of claim 14, wherein said peripheral is a SATA controller.

### Claim 16 (depends on 14)

The method of claim 14, wherein said message contains a description of the read address and the physical address in the server.

### Claim 17 (depends on 14)

The method of claim 14, said transmitting includes using a DMA engine to initiate a DMA transfer over the fabric from the peripheral to the server.
