Metrics and security-based accelerator service rescheduling and auto-scaling using a programmable network device

A non-transitory computer-readable storage medium having stored thereon executable computer program instructions that, when executed by one or more processors, cause the one or more processors to perform operations comprising:

• collecting, by the one or more processors, metrics corresponding to communication links between microservices of a service managed by a service mesh;
• determining, based on analysis of the metrics, that a workload of the service can be accelerated by offload to a hardware accelerator device;
• generating a scaling request to cause the hardware accelerator device to be allocated to a cluster of hardware devices configured for the service;
• causing the scaling request to be transmitted to a programmable network device managing the hardware accelerator device, the programmable network device to allocate the hardware accelerator device to the cluster and to register the hardware accelerator device with the service mesh;
• and
• scheduling the workload of the service to the hardware accelerator device.

A method comprising:

• collecting, by one or more processors, metrics corresponding to communication links between microservices of a service managed by a service mesh;
• determining, based on analysis of the metrics by the one or processors, that a workload of the service can be accelerated by offload to a hardware accelerator device;
• generating, by the one or more processors, a scaling request to cause the hardware accelerator device to be allocated to a cluster of hardware devices configured for the service;
• causing, by the one or more processors, the scaling request to be transmitted to a programmable network device managing the hardware accelerator device, the programmable network device to allocate the hardware accelerator device to the cluster and to register the hardware accelerator device with the service mesh;
• and
• scheduling, by the one or more processors, the workload of the service to the hardware accelerator device.