Techniques for improving resource utilization in a microservices architecture via priority queues

One or more non-transitory computer readable media including instructions that, when executed by one or more processors, cause the one or more processors to perform the steps of:

• receiving, from a first client, a first request to allocate a message from a priority queue;
• determining that a first message that is stored in the priority queue and is pending does not satisfy a first allocation constraint, wherein a first priority is associated with the first message;
• determining that a second message that is stored in the priority queue and is pending satisfies the first allocation constraint, wherein the first priority associated with the first message is higher than a second priority associated with the second message;
• and
• allocating the second message to the first client.

A system, comprising:

• one or more memories storing instructions;
• and
• one or more processors coupled to the one or more memories that, when executing the instructions, perform the steps of:
• receiving, from a first client, a first request to allocate a message from a priority queue;
• determining that a first message that is stored in the priority queue and is pending does not satisfy a first allocation constraint, wherein a first priority is associated with the first message;
• determining that a second message that is stored in the priority queue and is pending satisfies the first allocation constraint, wherein the first priority associated with the first message is higher than a second priority associated with the second message;
• and
• allocating the second message to the first client.