US 11,960,429 B2 · Many-to-many PCIE switch

Abstract

Methods, apparatus, and computer platforms and architectures employing many-to-many and many-to-one peripheral switches. The methods and apparatus may be implemented on computer platforms having multiple nodes, such as those employing a Non-uniform Memory Access (NUMA) architecture, wherein each node comprises a plurality of components including a processor having at least one level of memory cache and being operatively coupled to system memory and operatively coupled to a many-to-many peripheral switch that includes a plurality of downstream ports to which NICs and/or peripheral expansion slots are operatively coupled, or a many-to-one switch that enables a peripheral device to be shared by multiple nodes. During operation, packets are received at the NICs and DMA memory writes are initiated using memory write transactions identifying a destination memory address. The many-to-many and many-to-one peripheral switches forwards the transaction packets internally within the switch based on the destination address such that the packets are forwarded to a node via which the memory address can be accessed. The platform architectures may also be configured to support migration operations in response to failure or replacement of a node.

Claims20

Dependent claims

A Peripheral Component Interconnect Express (PCIe) switch, comprising:

a first plurality of PCIe interfaces, configurable to be coupled to host nodes via a first plurality of PCIe links;
a second plurality of PCIe interfaces, configurable to be coupled to respective PCIe Input/Output (I/O) devices via a second plurality of respective PCIe links;
switching circuitry, configurable to selectively couple each PCIe interface in the first plurality of PCIe interfaces to one or more PCIe interfaces in the second plurality of PCIe interfaces and to selectively couple each PCIe interface in the second plurality of PCIe interfaces to one or more PCIe interfaces in the first plurality of PCIe interfaces;
and
mapping information for forwarding PCIe transactions originating from the PCIe I/O devices to host nodes based on memory address information associated with the PCIe transactions, wherein the memory address information for a PCIe transaction comprises at least one memory address in an application address space for a host node to which the PCIe transaction is to be sent.

2 more elements

An apparatus comprising:

a Peripheral Component Interconnect Express (PCIe) switch, including,
a plurality of PCIe upstream interfaces;
a plurality of PCIe downstream interfaces;
and
switching circuitry, configurable to selectively couple each PCIe upstream interface to one or more PCIe downstream interfaces and to selectively couple each PCIe downstream interface to one or more PCIe upstream interfaces;
wherein the apparatus is configured to be installed in a system including a plurality of host nodes having memory, the memory for a host node including one or more application address spaces, the system further including a plurality of PCIe Input/Output (I/O) devices,
wherein during operation of the system PCIe upstream interfaces are operatively coupled to host nodes via PCIe links, each PCIe I/O device is operatively coupled to a respective PCIe downstream interface via a respective PCIe link between the PCIe I/O device and the PCIe downstream interface, and the PCIe switch is configured to,
receive packets from the plurality of PCIe I/O devices at the PCIe downstream interfaces to which the PCIe I/O devices are operatively coupled, the packets relating to PCIe transactions initiated by the PCIe I/O devices;
for at least a portion of the packets that are received,
inspect the packet to determine its destination memory address, the destination memory address comprising a memory address in an application address space for one of the plurality of host nodes;
and
forward the packet internally within the PCIe switch from the PCIe downstream interface at which the packet is received to a PCIe upstream interface operatively coupled to a host node having an application address space including the destination memory address.

9 more elements

Dependencies are inferred from the claim text.

Many-to-many PCIE switch

Life of this patent

Many-to-many PCIE switch

Life of this patent

Abstract

Claims20