Regulation of resource requests to control rate of resource consumption

A computer implemented method, comprising:

• managing consume requests for a resource that are received from a plurality of computations that consume the resource and that are bound to one of a plurality of resource domains in which one or more respective resource policies for the resource are installed, wherein each of the consume requests specifies a measurable, consumable resource to be consumed during execution of one of the plurality of computations, and wherein said managing consume requests comprises determining whether servicing the consume requests would cause a threshold to be exceeded;
• and
• in response to determining that servicing the consume requests would cause the threshold to be exceeded, throttling one or more of the consume requests for at least a period of time sufficient to avoid exceeding the threshold;
• wherein the threshold is specified in one of the one or more respective resource policies installed in the one of the plurality of resource domains that are bound to the plurality of computations, wherein the one of the plurality of resource domains associates the one of the one or more respective resource policies for the resource with the plurality of computations that are bound to the one of the plurality of resource domains;
• wherein said managing consume requests further comprises a dispenser isolate managing resource requests based at least in part on a set of common attributes used to characterize the resource;
• wherein the set of common attributes is usable to characterize resources with respect to consuming or releasing the resources for a plurality of different resource types;
• wherein an isolate comprises a set of one or more encapsulated computations having a state that is independent of a state of other computations;
• and
• wherein the dispenser isolate is separate from the implementation of the resource.

A non-transitory machine-readable storage medium storing program instructions executable to implement:

• a posting facility that posts consume requests for resources;
• a rate controller that delays one or more resource consume requests for at least a period of time sufficient to avoid exceeding a threshold;
• and
• a plurality of resource domains that each associate one or more respective resource policies for a requested resource with a plurality of resource consuming isolates that are bound to the resource domain;
• wherein an isolate is a set of one or more computations that do not share computational state with other computations;
• wherein consume requests for the requested resource are received from one of the plurality of resource consuming isolates that are bound to one of the plurality of resource domains, and wherein each of the consume requests specifies a measurable, consumable resource to be consumed during execution of one or more computations of the one of the plurality of resource consuming isolates;
• wherein the threshold is specified in one of the one or more respective resource policies for the requested resource installed in the one of the plurality of resource domains that are bound to the one of the plurality of resource consuming isolates;
• wherein the rate controller is an isolate that is separate from the implementation of the requested resource;
• and
• wherein the rate controller delays resource consume requests based at least in part on a set of common attributes used to characterize the requested resource, wherein the set of common attributes is usable to characterize resources with respect to consuming or releasing the resources for a plurality of different resource types.

A non-transitory machine-readable storage medium storing program instructions executable to implement:

• a plurality of resource domains each associating one or more respective resource policies for a resource with a plurality of resource consuming isolates that are bound to the resource domain;
• a first sequence of instructions determining whether servicing a consume request from one of the plurality of resource consuming isolates that are bound to one of the plurality of resource domains will cause a threshold to be exceeded, wherein the consume request specifies a measurable, consumable resource to be consumed during execution of one or more computations of the one of the plurality of resource consuming isolates;
• and
• a second sequence of instructions determining a period of time to delay the request that is sufficient to avoid exceeding the threshold;
• wherein an isolate is a set of one or more computations that do not share computational state with other computations;
• wherein the threshold is specified in one of the one or more respective resource policies for the requested resource installed in the one of the plurality of resource domains;
• wherein at least one of the first sequence of instructions and the second sequence of instructions is an isolate that is separate from the implementation of the requested resource;
• wherein at least one of said determining whether servicing a consume request will cause a threshold to be exceeded and said determining the period of time to delay is based at least in part on a set of common attributes used to characterize the requested resource;
• and
• wherein the set of common attributes is usable to characterize resources with respect to consuming or releasing the resources for a plurality of different resource types.

An apparatus, comprising:

• system memory;
• means for determining that servicing a plurality of requests for a resource would cause a threshold to be exceeded;
• and
• means for throttling one or more of the plurality of requests for the resource for at least a period of time sufficient to avoid exceeding the threshold;
• wherein the plurality of requests are received from a plurality of resource consuming isolates that are bound to one of a plurality of resource domains in which one or more respective resource policies for the resource are installed, wherein each of the requests specifies a measurable, consumable resource to be consumed during execution of one or more computations of one of the plurality of resource consuming isolates;
• wherein an isolate is a set of one or more computations that do not share computational state with other computations;
• wherein the threshold is specified in one of the one or more respective resource policies installed in the one of the plurality of resource domains that are bound to the plurality of resource consuming isolates, wherein the one of the plurality of resource domains associates the one of the one or more respective resource policies for the resource with the plurality of resource consuming isolates that are bound to the one of the plurality of resource domains;
• wherein the means for throttling requests is separate from the implementation of the resource;
• wherein said throttling requests is based at least in part on a set of common attributes used to characterize the resource;
• and
• wherein the set of common attributes is usable to characterize resources with respect to consuming or releasing the resources for a plurality of different resource types.