Token-based policies burst-mode operations
AssigneeAmazon Technologies, Inc.
InventorsStuart Henry Seelye Marshall, Wei Xiao, Bjorn Patrick Swift, Kiran-Kumar Muniswamy-Reddy, Miguel Mascarenhas Filipe, Yijun Lu, Stefano Stefani, James R. Hamilton
Life of this patent
Estimating the term…
Abstract
A pricing policy to be applied to token population changes at a token bucket used for admission control during burst-mode operations at a work target is determined. Over a time period, changes to the token population of that bucket are recorded. An amount to be charged to a client is determined, based on the recorded changes in token population and an associated pricing amount indicated in the policy.
Claims20
A non-transitory computer-readable storage medium storing program instructions that when executed on one or more processors:
- determine a token policy to be applied to a burst-mode token bucket of one or more token buckets used for admission control decisions at a work target of a network-accessible service to which work requests are directed, wherein the token policy is to be applied during a burst mode of operation of the work target, and wherein the burst mode of operation includes receiving work requests at a rate higher than a specified capacity of the work target;
- record, over a time period and in accordance with the token policy, one or more changes to the token population of the burst-mode token bucket during the burst mode of operation;
- and
- for received requests, control access to the burst mode of operation at the work target of the network-accessible service based at least in part on whether the burst-mode token bucket has sufficient tokens, wherein the control of access to the burst mode of operation controls a rate of access to the work target of the network-accessible service for the received requests.
A system, comprising:
- one or more computing devices configured to:
- determine a token policy to be applied to a burst-mode token bucket of one or more token buckets used for admission control decisions at a work target of a network-accessible service to which work requests are directed, wherein the token policy is to be applied during a burst mode of operation of the work target, and wherein the burst mode of operation includes receiving work requests at a rate higher than a specified capacity of the work target;
- record, over a time period and in accordance with the token policy, one or more changes to the token population of the burst-mode token bucket during the burst mode of operation;
- and
- for received requests, control access to the burst mode of operation at the work target of the network-accessible service based at least in part on whether the burst-mode token bucket has sufficient tokens, wherein the control of access to the burst mode of operation controls a rate of access to the work target of the network-accessible service for the received requests.
A method, comprising:
- performing, by one or more computing devices:
- determining a token policy to be applied to a burst-mode token bucket of one or more token buckets used for admission control decisions at a work target of a network-accessible service to which work requests are directed, wherein the token policy is to be applied during a burst mode of operation of the work target, and wherein the burst mode of operation includes receiving work requests at a rate higher than a specified capacity of the work target;
- recording, over a time period and in accordance with the token policy, one or more changes to the token population of the burst-mode token bucket during the burst mode of operation;
- and
- for one or more received work requests, controlling access to the burst mode of operation at the work target of the network-accessible service based at least in part on whether the burst-mode token bucket has a sufficient number of tokens, wherein the controlling of access to the burst mode of operation controls a rate of access to the work target of the network-accessible service for the received requests.
Dependencies are inferred from the claim text.