Distributed ai platform mesh for machine learning workflows
AssigneeSap SE
InventorSrinivasa Byaiah Ramachandra Reddy
Life of this patent
Estimating the term…
Abstract
An AI platform mesh includes a machine learning control plane hosted in a container orchestration cluster. The machine learning control plane includes a worker plane manager and a set of machine learning services. One or more remote runtime environments configured to execute machine learning workloads can be registered with the machine learning control plane via the worker plane manager. The remote runtime environments can communicate with the set of machine learning services via the worker plane manager.
Claims20
A system comprising:
- a machine learning control plane deployed in a first computing environment, the machine learning control plane comprising a worker plane manager and a set of machine learning services, the worker plane manager comprising a service to register a remote runtime environment and a service to communicate with the remote runtime environment once registered;
- and
- a machine learning worker plane deployed in a second computing environment that is remote to the first computing environment, wherein the machine learning worker plane is a remote runtime environment configured to execute machine learning workloads, and wherein the machine learning worker plane is registered with the machine learning control plane via the worker plane manager.
A method comprising:
- running a machine learning control plane in a container orchestration cluster, wherein the machine learning control plane comprises a worker plane manager and a set of machine learning services;
- receiving a request to register a machine learning worker plane with the machine learning control plane, wherein the machine learning worker plane is a remote runtime environment configured to execute machine learning workloads;
- registering the machine learning worker plane in the worker plane manager;
- and
- configuring a communication connection between the worker plane manager and a machine learning service broker within the machine learning worker plane.
One or more non-transitory computer-readable storage media storing computer-executable instructions for causing a computer system to perform operations comprising:
- receiving a first request at a machine learning control plane deployed in a container orchestration cluster to register a remote runtime environment configured to execute machine learning workloads;
- registering the remote runtime environment at the machine learning control plane;
- receiving a second request at the machine learning control plane, the second request comprising a machine learning scenario specifying one or more machine learning services of the machine learning control plane;
- executing the machine learning scenario on the machine learning control plane;
- communicating information about execution of the machine learning service from the machine learning control plane to the remote runtime environment;
- and
- communicating information about machine learning workloads on the remote runtime environment to the machine learning control plane.
Dependencies are inferred from the claim text.