Distributed processing of partitioned and ordered data
AssigneeAmazon Technologies, Inc.
InventorsSayantan Bhowmik, Matthew Jonathan Narksusook, Adam Charles Siefker, Francesco Maria Rizzi
Life of this patent
Estimating the term…
Loading patent…
AssigneeAmazon Technologies, Inc.
InventorsSayantan Bhowmik, Matthew Jonathan Narksusook, Adam Charles Siefker, Francesco Maria Rizzi
Estimating the term…
Scheduling of time-series data samples for processing according to client-specified criteria is performed. A client may submit a request to establish an execution pipeline to process time-series data, the request including a partitioning definition and an ordering definition. Responsive to this request, a scheduler may receive a time-series data sample and generate a partitioning key according to the partitioning definition to direct the sample to one of multiple partition queues. After enqueuing, the schedular may determine that the sample should be blocked from processing until satisfaction of an unblocking condition is achieved. This satisfaction may include processing of one or more other samples according to the ordering definition or a time period has elapsed. Blocking criteria may also include limitations in a number of simultaneously executing sample processes. Processing of samples of different queues may occur independently.
A system, comprising:
A method, comprising:
One or more non-transitory computer-accessible storage media storing program instructions that when executed on or across one or more computing devices cause the one or more computing devices to implement a scheduling service to perform:
Dependencies are inferred from the claim text.