Back to results
US 2019/0163539 A1Published application
Managing Resource Allocation in a Stream Processing Framework
Assigneesalesforce.com, inc.
InventorsElden Gregory BISHOP, Jeffrey CHAO
Life of this patent
Estimating the term…
Loading patent…
Loading patent…
Assigneesalesforce.com, inc.
InventorsElden Gregory BISHOP, Jeffrey CHAO
Estimating the term…
The technology disclosed herein relates to method, system, and computer program product (computer-readable storage device) embodiments for managing resource allocation in a stream processing framework. An embodiment operates by configuring an allocation of a task sequence and machine resources to a container, partitioning a data stream into a plurality of batches arranged for parallel processing by the container via the machine resources allocated to the container, and running the task sequence, running at least one batch of the plurality of batches. Some embodiments may also include changing the allocation responsive to a determination of an increase in data volume, and may further include changing the allocation to a previous state of the allocation, responsive to a determination of a decrease in data volume. Additionally, time-based throughput of the data stream may be monitored for a given worker node configured to run a batch of the plurality of batches.
A method, comprising:
The method of claim 5, wherein the time-based throughput is monitored for a given worker node configured to run a batch of the plurality of batches.
The method of claim 7, wherein the trigger comprises a state transition and a rule, and wherein at least the rule is configured to be set via an interface.
A system, comprising:
A computer-readable storage device comprising computer-executable instructions that, when executed by at least one computer processor, cause the at least one computer processor to perform operations comprising:
Dependencies are inferred from the claim text.