Back to results
US 11,115,365 B1Granted
Messaging overflow service
AssigneeAmazon Technologies, Inc.
InventorSrinivasan Dwarakanathan
Life of this patent
Estimating the term…
Abstract
A technology is provided for reducing latency in a messaging system. Unprocessed messages in a message queue are consumed via a messaging overflow service launched in response to an alarm triggered by a monitoring service that indicates the message queue has reached a predetermined threshold. The unprocessed messages are processed via the messaging overflow service to generate a processed data store values. The processed data store values are stored in a cache associated with the messaging overflow service.
Claims20
A non-transitory machine readable storage medium having instructions embodied thereon, the instructions when executed cause a processor to perform processing, comprising:
- consuming unprocessed messages pending in a message queue using a messaging overflow service launched in response to an alarm triggered by a monitoring service that indicates the message queue has filled to a predetermined threshold, wherein a message handler associated with the message queue processes a first set of messages from the message queue, in parallel to the messaging overflow service, and stores a first set of processed data store values associated with the first set of messages processed by the message handler to a data store;
- processing, by the messaging overflow service, a second set of messages from the unprocessed messages, in parallel to the first set of messages being processed by the message handler, to generate a second set of processed data store values;
- storing the second set of processed data store values in a cache associated with the messaging overflow service;
- enabling the first set of processed data store values and the second set of processed data store values to be available for delivery to a client;
- causing a query process making a query request to the data store to check both the data store and the cache associated with the messaging overflow service for the processed data store values;
- and
- the message queue receiving subsequent messages after the messaging overflow service is launched;
- wherein the subsequent messages are processed by the message handler associated with the message queue in parallel to the processing of the unprocessed messages using the messaging overflow service.
5 more elements
A method, under the control of at least one processor, comprising:
- consuming unprocessed messages from a message queue using a messaging overflow service launched in response to an alarm triggered by a monitoring service that indicates the message queue has reached a predetermined threshold, wherein a message handler associated with the message queue processes a first set of messages from the message queue, in parallel to the messaging overflow service, and stores a first set of data store values associated with the first set of messages processed by the message handler to a data store;
- processing, by the messaging overflow service, a second set of messages from the unprocessed messages, in parallel to the first set of messages being processed by the message handler, to generate a second set of processed data store values, using the at least one processor;
- storing the second set of processed data store values in a cache associated with the messaging overflow service;
- enabling the first processed data store values and the second set of processed data store values to be available for delivery to a client;
- and
- the message queue receiving subsequent messages after the messaging overflow service is launched;
- wherein the subsequent messages are processed by the message handler associated with the message queue in parallel to the processing of the unprocessed messages using the messaging overflow service.
4 more elements
A system for message processing, comprising:
- a messaging overflow service comprising:
- at least one processor;
- and
- a memory device including instructions to be executed by the at least one processor in order to:
- launch the messaging overflow service and consume unprocessed messages pending in a message queue in response to an alarm triggered by a monitoring service that indicates the message queue has reached a predetermined threshold, wherein a message handler associated with the message queue processes a first set of messages from the message queue, in parallel to the messaging overflow service, and stores a first set of data store values associated with the first set of messages processed by the message handler to a data store;
- process, by the messaging overflow service using the at least one processor, a second set of messages from the unprocessed messages, in parallel to the first set of messages being processed by the message handler, to generate a second set of processed data store values;
- store the second set of processed data store values in a cache associated with the messaging overflow service;
- enable the first processed data store values and the second set of processed data store values to be available for delivery to a client;
- and
- receive, by the message queue, subsequent messages after the messaging overflow service is launched;
- wherein the subsequent messages are processed by the message handler associated with the message queue in parallel to the processing of the unprocessed messages using the messaging overflow service.
8 more elements
Dependencies are inferred from the claim text.