Streaming resource management

A system, comprising:

• a non-transitory memory storing instructions;
• and
• one or more hardware processors coupled to the non-transitory memory and configured to read the instructions from the non-transitory memory to cause the system to perform operations comprising:
• determining priorities for a plurality of queues;
• determining priorities and queue limits for a plurality of processes, wherein the plurality of processes are configured to process messages in the plurality of queues, the messages including content to be viewed at a plurality of computing devices;
• determining a set of queues from the plurality of queues, the set of queues having priorities that match a priority of a first process in the plurality of processes;
• determining batch numbers for the set of queues, each batch number of the batch numbers indicating a number of groups of messages to be processed from each queue of the set of queues;
• determining one or more first queues from the set of queues up to a queue limit of the first process, wherein the one or more first queues have higher batch numbers than one or more second queues in the set of queues;
• processing the one or more first queues using the first process over a configurable time interval;
• and
• processing the one or more second queues using a second process of the configurable time interval.

A non-transitory machine-readable medium having stored thereon machine-readable instructions executable to cause a machine to perform operations comprising:

• accessing, using a computer system, priorities for a plurality of queues, the plurality of queues storing messages that include content;
• accessing, using the computer system, priorities and queue limits for a plurality of processes, wherein the plurality of processes are configured to process the messages in the plurality of queues;
• determining a list of queues, the list of queues having queue identifiers of a set of queues in the plurality of queues with priorities that match a priority of a first process in the plurality of processes;
• determining batch numbers in the set of queues having the queue identifiers in the list of queues, each batch number of the batch numbers indicating a number of groups of messages to be processed from each queue of the set of queues;
• determining a plurality of first queues from the set of queues up to a queue limit of the first process, wherein the plurality of first queues have higher batch numbers than one or more other queues in the set of queues;
• processing the plurality of first queues using the first process over a configurable time interval, wherein processing the plurality of first queues includes transmitting the content in the messages in the plurality of first queues to a plurality of destinations;
• determining that a batch number for a first queue in the first plurality of queues increased after the processing for the configurable time interval, indicating that a total number of messages in the first queue has increased from before to the processing;
• and
• in response to determining that the batch number has increased, increasing the priority of the first queue