US 10,944,812 B1Granted

Dynamic throttling for data consensus groups

AssigneeAmazon Technologies, Inc.

InventorsThomas Tarak Mathew Veppumthara, Divya Ashok Kumar Jain, Amol Madhav Joshi

Life of this patent

Estimating the term…

Loading patent…

Abstract

Generally described, one or more aspects of the present application correspond to techniques for dynamically determining token bucket sizes for different types of transactions occurring at a node in a distributed consensus-based transaction system. For example, each node can store a number of cells, with such cells being replicated across a number of nodes. Each cell can assume various roles in consensus transactions, for example being a leader or simple juror, or being unsure of its leader's identity and requesting leadership. Each node can determine the overall number of transaction tokens that it will assign during a given time period based on the cell composition, and can allocate those tokens to a leader election token bucket and a customer traffic token bucket based on the cell composition.

Claims19

Dependent claims

A computer-implemented method of managing write transactions on a node in communication with a distributed consensus system and configured to store cells of consensus groups of the distributed consensus system, the node including a plurality of cells, wherein individual cells are one of a leased cell that knows its identity in a particular one of the consensus groups or an unleased cell that does not know its identity in a particular one of the consensus groups, wherein the identity is one of a leader or a non-leader juror in a particular one of the consensus groups, the computer-implemented method comprising:

determining a proportion of producers of writes stored on the node to a maximum cell capacity of the node, wherein producers of writes include, from among the plurality of cells stored on the node, cells who know their identity as leaders and unleased cells that do not know their identity;
determining a write transaction limit for the node based at least partly on the proportion, wherein the write transaction limit specifies a number of write transactions per time interval that the node is permitted to perform, and wherein the determined write transaction limit increases as the proportion increases and decreases as the proportion decreases;
and
authorizing or reject a write transaction request based on the write transaction limit.

1 more element

Non-transitory computer-readable media comprising computer-executable instructions for managing write transactions on a node in communication with a distributed consensus system and configured to store cells of consensus groups of the distributed consensus system, the node including a plurality of cells, wherein individual cells are one of a leased cell that knows its identity in a particular one of the consensus groups or an unleased cell that does not know its identity in a particular one of the consensus groups, wherein the identity is one of a leader or a non-leader juror in a particular one of the consensus groups, and wherein the instructions, when executed by a computing system, cause the computing system to:

determine a proportion of producers of writes stored on the node to a maximum cell capacity of the node, wherein producers of writes include, from among the plurality of cells stored on the node, cells who know their identity as leaders and unleased cells that do not know their identity;
determine a write transaction limit for the node based at least partly on the proportion, wherein the write transaction limit specifies a number of write transactions per time interval that the node is permitted to perform, and wherein the determined write transaction limit increases as the proportion increases and decreases as the proportion decreases;
and
authorize or reject a write transaction request based on the write transaction limit.

1 more element

A system comprising:

a node in communication with a distributed consensus system, wherein the node corresponds to an individual computing device configured to store cells of consensus groups of the distributed consensus system, each of the consensus groups comprising a group of cells distributed across multiple nodes of the distributed consensus system;
a plurality of cells stored on the node, wherein individual ones of the cells are one of a leased cell that knows its identity in a particular one of the consensus groups or an unleased cell that does not know its identity in a particular one of the consensus groups, wherein the identity is one of a leader or a non-leader juror in a particular one of the consensus groups;
and
one or more processors configured by computer-executable instructions to at least:
determine a proportion of producers of writes stored on the node to the maximum cell capacity of the node, wherein producers of writes include, from among the plurality of cells stored on the node, cells who know their identity as leaders and unleased cells that do not know their identity;
determine a write transaction limit for the node based at least partly on the proportion, wherein the write transaction limit specifies a number of write transactions per time interval that the node is permitted to perform, and wherein the determined write transaction limit increases as the proportion increases and decreases as the proportion decreases;
and
authorize or reject a write transaction request based on the write transaction limit.

5 more elements

Dependencies are inferred from the claim text.