Dead letter queue for smart fleet management
AssigneeAmazon Technologies, Inc.
InventorsGeorge Shipilov, Kerry Quintin Lee, Matthew James Eddey
Life of this patent
Estimating the term…
Abstract
A system and method for using a dead letter queue to regulate host computing systems performing transformation or migration operations. The system and method including reading a message from a queue, the message including one or more references to a set of data objects, with the set of data objects including one or more data objects selected for a transformation operation according to a transformation scheme. The system and method further including performing a mitigation action upon determination that the message is one of a number of unsuccessfully processed messages in the queue that are associated with the computer system, when the number of unsuccessfully processed messages exceed a threshold.
Claims25
A computer-implemented method, comprising:
- under the control of one or more computer systems configured with executable instructions, the one or more computer systems including a host computing system:
- detecting an occurrence of a trigger to check a queue of a queue service;
- reading a message from the queue, the message including a host identifier and further including a storage location of a data object selected for a transformation operation, the queue being a queue of messages corresponding to data objects that were not confirmed to have been successfully transformed;
- determining that the host identifier included in the message matches a host identifier of the host computing system;
- determining that the message has not been previously read from the queue by the host computing system;
- incrementing a message counter corresponding to the host computing system;
- determining that the message counter exceeds a message counter threshold;
- and
- performing a mitigation action and resetting the message counter.
A system, comprising:
- one or more processors;
- and
- memory including instructions that, when executed by the one or more processors, cause the system to:
- read a message from a queue, the message including one or more references to a set of data objects, the set of data objects including one or more data objects selected for a transformation operation;
- determine that the message corresponds to a failed attempt to transform or migrate the set of data objects by the system;
- and
- as a result of a determination that the message is associated with the failed attempt, determine whether to perform a mitigation action.
A non-transitory computer-readable storage medium having stored thereon executable instructions that, when executed by one or more processors of a computer system, cause the computer system to at least:
- read a message from a queue, the message including one or more references to a set of unsuccessfully processed data objects, the set of data objects including one or more data objects selected for a transformation operation according to a transformation scheme;
- and
- perform a mitigation action upon determination that the message in the queue is associated with an unsuccessful attempt to process the set of data objects.
Dependencies are inferred from the claim text.