Autoscaling and throttling in an elastic cloud service

A system comprising:

• one or more processors of a machine;
• and
• at least one memory storing instructions that, when executed by the one or more processors, cause the machine to perform operations comprising:
• monitoring, by a computing resource assigned to a cluster of a plurality of clusters, resource usage at the respective computing resource;
• throttling a number of new inbound requests received by the respective computing resource based on the monitored resource usage, the throttling comprising:
• determining that the resource usage has exceeded a maximum threshold;
• generating an estimate of an allotment of new inbound requests to be received by the respective computing resource to lower the resource usage below the maximum threshold;
• and
• setting a gateway limit of new inbound requests based on the estimate to throttle new inbound requests received by the respective computing resource;
• transmitting information and statistics of usage levels to a central sever, the central server being configured to adjust a number of computing resources assigned to each of the plurality of clusters based on the information and statistics;
• and
• receiving instructions from the central server regarding cluster assignment.

A machine-storage medium embodying instructions that, when executed by at least one machine, cause the at least one machine to perform operations comprising:

• monitoring, by a computing resource assigned to a cluster of a plurality of clusters, resource usage at the respective computing resource;
• throttling a number of new inbound requests received by the respective computing resource based on the monitored resource usage, the throttling comprising:
• determining that the resource usage has exceeded a maximum threshold;
• generating an estimate of an allotment of new inbound requests to be received by the respective computing resource to lower the resource usage below the maximum threshold;
• and
• setting a gateway limit of new inbound requests based on the estimate to throttle new inbound requests received by the respective computing resource;
• transmitting information and statistics of usage levels to a central sever, the central server being configured to adjust a number of computing resources assigned to each of the plurality of clusters based on the information and statistics;
• and
• receiving instructions from the central server regarding cluster assignment.