Back to results
US 2026/0093566 A1Published application
Systems and methods for compute orchestration utilizing distributed runners
AssigneeClarifai, Inc.
InventorsMatthew D. Zeiler, David Joshua Eigen
Life of this patent
Estimating the term…
Abstract
Systems, methods and computer program code are provided for processing compute workflows or task requests in a distributed environment.
Claims20
A computer implemented method to respond to a task request, the method comprising:
- receiving, at a control plane, a task request message, the task request message including information identifying a task to be performed, information identifying an application, and information identifying a requestor, the control plane in communication with a plurality of applications of a compute plane such that communication between the control plane and the compute plane is only initiated from the compute plane;
- receiving, by the control plane, a plurality of requests for work messages, each request for work message received from a runner application associated with a processor of compute plane over one of (i) a bidirectional streaming connection and (ii) a long polling communication protocol connection;
- determining, by the control plane, a selected one of the plurality of requests for work messages that is compatible with the task request message;
- transmitting, by the control plane, the task request message to the runner application associated with the selected one of the plurality of requests for work messages;
- receiving, from the runner application associated with the selected one of the plurality of requests for work messages, a response to the task request message;
- and
- transmitting the response to the task request message to the requestor.
4 more elements
(canceled)
A system, comprising:
- a processing unit;
- and
- a memory storage device including program code that when executed by the processing unit causes the system to:
- receive, at a control plane, a task request message, the task request message including information identifying a task to be performed, information identifying an application, and information identifying a requestor, the control plane in communication with a plurality of applications of a compute plane such that communication between the control plane and the compute plane is only initiated from the compute plane;
- receive, by the control plane, a plurality of requests for work messages, each request for work message received from a runner application associated with a processor of a compute plane over one of (i) a bidirectional streaming connection and (ii) a long polling communication protocol connection;
- determine, by the control plane, a selected one of the plurality of requests for work messages that is compatible with the task request message;
- transmit, by the control plane, the task request message to the runner application associated with the selected one of the plurality of requests for work messages;
- receive, from the runner application associated with the selected one of the plurality of requests for work messages, a response to the task request message;
- and
- transmit the response to the task request message to the requestor.
7 more elements
(canceled)
A non-transitory, machine-readable medium comprising instructions thereon that, when executed by a processor, cause the processor to execute operations to perform a method, the method comprising:
- receiving, at a control plane, a task request message, the task request message including information identifying a task to be performed, information identifying an application, and information identifying a requestor, the control plane in communication with a plurality of applications of a compute plane such that communication between the control plane and the compute plane is only initiated from the compute plane;
- receiving, by the control plane, a plurality of requests for work messages, each request for work message received from a runner application associated with a processor of a compute plane over one of (i) a bidirectional streaming connection and (ii) a long polling communication protocol connection;
- determining, by the control plane, a selected one of the plurality of requests for work messages that is compatible with the task request message;
- transmitting, by the control plane, the task request message to the runner application associated with the selected one of the plurality of requests for work messages;
- receiving, from the runner application associated with the selected one of the plurality of requests for work messages, a response to the task request message;
- and
- transmitting the response to the task request message to the requestor.
4 more elements
Dependencies are inferred from the claim text.