Workload management service for first-in first-out queues for network-accessible queuing and messaging services

A system for managing workloads of a plurality of hosts providing a network-accessible queuing service within a service provider network, the system comprising:

• one or more processors;
• and
• at least one computer-readable storage medium having computer-executable instructions stored thereupon which, when executed by the one or more processors, cause the system to:
• evaluate workloads of hosts other than a first one or more hosts to determine a set of hosts having workloads below a threshold;
• select, from the set of hosts, a second one or more hosts;
• establish a first first-in, first-out (FIFO) queue fragment at the second one or more hosts for writing subsequent messages from a stream of messages to the first FIFO queue fragment at the second one or more hosts, the messages from the stream of messages comprising a first message group identifier;
• seal a second FIFO queue fragment at the first one or more hosts for writing of messages from the stream of messages at the second FIFO queue fragment at the first one or more hosts;
• and
• based at least in part on the first message group identifier, process, by a network-accessible message processing service provided by the service provider network, a message, wherein during processing of the message, the message and other messages that include the first message group identifier are inaccessible within the first FIFO queue fragment and the second FIFO queue fragment for retrieval from the first FIFO queue fragment and the second FIFO queue fragment by other network-accessible message processing services provided by the service provider network.

A non-transitory computer-readable storage medium within a service provider network, the non-transitory computer-readable storage medium having computer-executable instructions stored thereupon which, when executed by one or more processors, cause the one or more processors to:

• receive an alarm from a first one or more hosts that the first one or more hosts include one or more first first-in, first-out (FIFO) queues that are overloading the workload of the first one or more hosts;
• evaluate workloads of hosts other than the first one or more hosts to determine a set of hosts having workloads below a threshold;
• select, from the set of hosts, a second one or more hosts;
• establish a first FIFO queue fragment at the second one or more hosts for writing subsequent messages from a stream of messages to the first FIFO queue fragment at the second one or more hosts, the stream of messages comprising a first message group identifier;
• seal a second FIFO queue fragment at the first one or more hosts for writing of messages from the stream of messages at the second FIFO queue fragment at the first one or more hosts;
• and
• based at least in part on the first message group identifier, process, by a network-accessible message processing service provided by the service provider network, a message, wherein during processing of the message, the message and other messages that include the first message group identifier are inaccessible within the first FIFO queue fragment and the second FIFO queue fragment for retrieval from the first FIFO queue fragment and the second FIFO queue fragment by other network-accessible message processing services provided by the service provider network.