Techniques to dynamically enable and disable accelerator devices in compute environments

A computer-implemented method to dynamically control accelerator devices, comprising:

• sending a power operation initiation indication to an accelerator device via a subset of a plurality of interconnects, the power operation initiation indication to indicate a power operation to be performed on one or more of infrastructure devices of the accelerator device;
• receiving a response from the accelerator device, the response to indicate to a processor that the accelerator device is ready for the power operation;
• and
• causing the power operation to be performed on the accelerator device, the power operation to enable or disable power for the one or more of the infrastructure devices.

A non-transitory computer-readable storage medium, comprising a plurality of instructions, that when executed, enable processing circuitry to:

• send a power operation initiation indication to an accelerator device of a multi-chip package (MCP) via a subset of a plurality of interconnects, the power operation initiation indication to indicate a power operation to be performed on one or more of infrastructure devices of the accelerator device;
• receive a response from the accelerator device, the response to indicate to a processor of the MCP that the accelerator device is ready for the power operation;
• and
• cause the power operation to be performed on the accelerator device, the power operation to enable or disable power for the one or more of the infrastructure devices.