US 9,959,143 B1Granted

Actor and thread message dispatching

AssigneeAmazon Technologies, Inc.

InventorsCheyne William Anderson, Adam Julio Villalobos, Qiang Fan

Life of this patent

Estimating the term…

Loading patent…

Abstract

Techniques for actor and thread message dispatching are described herein. In some examples, a computing system may include multiple actors and multiple processing threads. Upon receiving an incoming message associated with one of the actors, a dispatching component may select one of the multiple processing threads within the computing system to which to dispatch the message for processing. If the associated actor is already assigned to one of the processing threads, then that processing thread may be selected for processing of the message. By contrast, if the associated actor is not already assigned to one of the processing threads, then a processing thread may be selected based on various factors, such as a set of priorities associated with the processing threads.

Claims20

Dependent claims

A method for dispatching a first message for processing comprising:

receiving the first message, wherein the first message is associated with a first actor of a plurality of actors associated with a computing system;
determining whether the first actor is assigned to one of a plurality of processing threads within the computing system;
selecting a first processing thread for processing the first message based, at least in part, on whether the first actor is assigned to one of the plurality of processing threads;
queueing the first message for processing by the first processing thread;
and
performing a migration on the first processing thread, wherein the migration is performed based at least in part on a message wait time exceeding a threshold, wherein the migration comprises:
de-queueing second messages from a queue of the first processing thread;
re-queueing the second messages into another message queue;
and
re-dispatching each of the second messages, wherein the re-dispatching of each of the second messages comprises selecting a processing thread to which an associated actor is assigned or, when the associated actor is not assigned to any of the plurality of processing threads, selecting, based at least in part on a set of priorities associated with the plurality of processing threads, a processing thread for processing of the second message and assigning the associated actor to the processing thread that is selected for processing of the second message.

7 more elements

One or more non-transitory computer-readable storage media having stored thereon instructions that, upon execution by one or more compute nodes, cause the one or more compute nodes to perform operations comprising:

receiving a first message, wherein the first message is associated with a first actor of a plurality of actors associated with a computing system;
determining whether the first actor is assigned to one of a plurality of processing threads within the computing system;
selecting a first processing thread for processing the first message based, at least in part, on whether the first actor is assigned to one of the plurality of processing threads;
queueing the first message for processing by the first processing thread;
and
performing a migration on the first processing thread, wherein the migration is performed based at least in part on a message wait time exceeding a threshold, wherein the migration comprises:
de-queueing second messages from a queue of the first processing thread;
re-queueing the second messages into another message queue;
and
re-dispatching each of the second messages, wherein the re-dispatching of each of the second messages comprises selecting a processing thread to which an associated actor is assigned or, when the associated actor is not assigned to any of the plurality of processing threads, selecting, based at least in part on a set of priorities associated with the plurality of processing threads, a processing thread for processing of the second message and assigning the associated actor to the processing thread that is selected for processing of the second message.

7 more elements

A system comprising:

one or more processors;
and
one or more memories to store a set of instructions, which if executed by the one or more processors, causes the one or more processors to perform operations comprising:
receiving a first message, wherein the first message is associated with a first actor of a plurality of actors associated with a computing system;
determining whether the first actor is assigned to one of a plurality of processing threads within the computing system;
selecting a first processing thread for processing the first message based, at least in part, on whether the first actor is assigned to one of the plurality of processing threads;
queueing the first message for processing by the first processing thread;
and
performing a migration on the first processing thread, wherein the migration is performed based at least in part on a message wait time exceeding a threshold, wherein the migration comprises:
de-queueing second messages from a queue of the first processing thread;
re-queueing the second messages into another message queue;
and
re-dispatching each of the second messages, wherein the re-dispatching of each of the second messages comprises selecting a processing thread to which an associated actor is assigned or, when the associated actor is not assigned to any of the plurality of processing threads, selecting, based at least in part on a set of priorities associated with the plurality of processing threads, a processing thread for processing of the second message and assigning the associated actor to the processing thread that is selected for processing of the second message.

10 more elements

Dependencies are inferred from the claim text.