NVLink and CXL.io Translations for GPU Memory Disaggregation in Heterogeneous Cross-Fabric AI Systems

A system comprising:

• a first interface configured to communicate according to an NVLink-based protocol with a first entity;
• a second interface configured to communicate according to CXL.io with a second entity,
• wherein CXL denotes Compute Express Link;
• and
• a computer coupled between the first and second interfaces, configured to translate between NVLink-based requests received via the first interface and CXL.io requests transmitted via the second interface;
• wherein the computer is further configured to translate physical addresses between a first address space associated with the NVLink-based protocol and a second address space associated with CXL.io.

A method comprising:

• receiving, by a computer from a first entity via a first interface, a CXL.io request comprising a read-class Transaction Layer Packet (TLP) type and a first physical address, wherein CXL denotes Compute Express Link;
• translating, by the computer, the CXL.io request to an NVLink-based request comprising a second physical address;
• sending, by the computer via a second interface that communicates according to an NVLink-based protocol, the NVLink-based request to a second entity;
• receiving, by the computer from the second entity, an NVLink-based response comprising data;
• translating, by the computer, the NVLink-based response to a CXL.io completion comprising the data;
• and
• sending the CXL.io completion to the first entity.

A system comprising:

• a first interface configured to communicate according to CXL.io with a first entity, wherein CXL denotes Compute Express Link;
• a second interface configured to communicate according to an NVLink-based protocol with a second entity;
• and
• a computer coupled between the first and second interfaces, configured to translate between CXL.io requests received via the first interface and NVLink-based requests transmitted via the second interface.