Extensible mechanisms for workload shaping and anomaly mitigation

A non-transitory computer-readable medium having instructions stored thereon that, when executed, cause one or more processors to servicing requests for utilization of resources within a computing environment, the instructions comprising instructions to cause the processors to:

• receive, with a regulator agent, a request from a remote electronic computing device, the request to utilize resources of at least one computing device within the computing environment, the regulator to determine whether to regulate a request or to allow the request to be delivered without regulation, wherein regulating the request comprises causing the request to be one of rejected, re-routed, isolated and delayed based on at least one of a specific organization, user, request performance trait, and target node data source, wherein the regulator makes the determination at the application level based on a resource cost analysis and whether the request represents an anomaly with respect to requests in a request stream;
• provide, with a computing device, an application server communicatively coupled with the regulator, the computing device having resources to generate a response to the request and to cause the response to be transmitted to the remote electronic computing device;
• wherein the regulator selectively regulates the request based on application-level resources to be utilized by the application server in response to the request by analyzing the request prior to delivery to the application server, wherein the selective regulation at least routes requests to consume excessive portions of a resource class to a queue for subsequent service at a controlled rate, wherein the selective regulation further comprises filtering to select among incoming requests and an action that determines a handling behavior based on the requests that satisfies the filter predicates;
• wherein the regulator receives application-level feedback information from one or more application servers configured to process requests to modify subsequent request filtering based, at least in part, on the application-level feedback information.

A method for servicing requests for utilization of resources within a computing environment, the method comprising:

• receiving, with a regulator agent, a request from a remote electronic computing device, the request to utilize resources of at least one computing device within the computing environment, the regulator to determine whether to regulate a request or to allow the request to be delivered without regulation, wherein regulating the request comprises causing the request to be one of rejected, re-routed, isolated and delayed based on at least one of a specific organization, user, request performance trait, and target node data source, wherein the regulator makes the determination at the application level based on a resource cost analysis and whether the request represents an anomaly with respect to requests in a request stream;
• providing, with a computing device, an application server communicatively coupled with the regulator, the computing device having resources to generate a response to the request and to cause the response to be transmitted to the remote electronic computing device;
• wherein the regulator selectively regulates the request based on application-level resources to be utilized by the application server in response to the request by analyzing the request prior to delivery to the application server, wherein the selective regulation at least routes requests to consume excessive portions of a resource class to a queue for subsequent service at a controlled rate, wherein the selective regulation further comprises filtering to select among incoming requests and an action that determines a handling behavior based on the requests that satisfies the filter predicates;
• wherein the regulator receives application-level feedback information from one or more application servers configured to process requests to modify subsequent request filtering based, at least in part, on the application-level feedback information.