Telemetry and load balancing in cxl systems

Abstract

A system can include a host configured to provide requests to, and receive responses from, multiple compute resources. In an example, the compute resources can be distributed on respective accelerator devices that can be configured to communicate with the host using various protocols, such as using compute express link (CXL). A first accelerator device can include a telemetry manager that can receive a queue utilization signal indicative of a volume of transaction request messages or response messages handled by the first accelerator device. The first accelerator device can determine a device loading metric about the first accelerator device based on the queue utilization signal, and can provide a control signal with information about the device loading metric to the host device. The host device can select the first accelerator device or a different device based on the control signal.

Dependencies are inferred from the claim text.