# US 2012/0254413 A1 · Proxy server, hierarchical network system, and distributed workload management method

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2012/0254413 A1
- Document ID: US20120254413A1
- Status: Published application
- Kind: A1
- Application number: 13/430,948
- Filed: 2012-03-27
- Published: 2012-10-04
- Earliest claimed: 2011-03-30
- Assignees: International Business Machines Corporation
- Inventors: Wen Jie Wang; Hai Shan Wu; Bo Yang; Yi Xin Zhao
- Web page: https://patentgrep.com/patent/US20120254413A1

## CPC

- H04L 47/22: Traffic shaping
- H04L 67/1097: for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
- H04L 67/51: Discovery or management thereof, e.g. service location protocol [SLP] or web services
- H04L 47/2425: for supporting services specification, e.g. SLA
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)

## Abstract

A proxy server and a hierarchical network system and a distributed workload management method. According to one embodiment of this disclosure, the proxy server includes: a rate controller configured to, based on measured request-related information and service quality parameters relative to service levels of requests, periodically determine a dispatch rate for requests of each service level, wherein the sum of the dispatch rate for respective service levels is less than or equal to a predetermined rate; and a request dispatcher configured to dispatch the requests of the corresponding service level in accordance with the dispatch rate determined by the rate controller. One aspect of the disclosure realizes a low overhead, highly scalable, simple and efficient workload management system to achieve QoS assurance and overload protection.

## Claims

### Claim 1

A proxy server, comprising:
a rate controller configured to, based on measured request-related information and service quality parameters relative to service levels of requests, periodically determine a dispatch rate for requests of each service level, wherein a sum of said dispatch rate for respective service levels is less than or equal to a predetermined rate; and
a request dispatcher configured to dispatch said requests of the corresponding service level in accordance with said dispatch rate determined by said rate controller.

### Claim 2 (depends on 1)

The proxy server according to claim 1, wherein:
said measured request-related information is a current request response time; and
said service quality parameters comprise a target response time and an importance of said requests of the corresponding service level.

### Claim 3 (depends on 1)

The proxy server according to claim 1, wherein said rate controller:
correlates said measured request-related information and said service quality parameters relative to service levels of requests by using a utility function;
correlates said measured request-related information and said dispatch rate through a queuing model; and
obtains said dispatch rate for said corresponding service level through minimizing said utility function.

### Claim 4 (depends on 1)

The proxy server according to claim 1, wherein said predetermined rate is determined by an application server serving for said proxy server, independent of said information about said proxy server.

### Claim 5 (depends on 1)

The proxy server according to claim 1, further comprising:
a request classifier configured to receive requests from clients, and classify said requests into at least one service level; and
a queuing module configured to maintain at least one request queue, wherein different queues correspond to different service levels of requests.

### Claim 6

A hierarchical network system, comprising:
at least one proxy server, comprising: a rate controller configured to, based on measured request-related information and service quality parameters relative to service levels of requests, periodically determine a dispatch rate for requests of each service level, wherein a sum of said dispatch rate for respective service levels is less than or equal to a predetermined rate; and a request dispatcher configured to dispatch said requests of the corresponding service level in accordance with said dispatch rate determined by said rate controller; and
an application server configured to serve said at least one proxy server, comprising:
a resource detector configured to periodically detect a current usage of resources of said application server and a current request arrival rate;
a maximum rate calculator configured to, based on said detected current resource usage, said current request arrival rate and a target usage of the resource, calculate a maximum admitted rate of requests for a next management cycle; and
a rate distributor configured to distribute the maximum admitted rate for each proxy server as its predetermined rate based on a predetermined policy.

### Claim 7 (depends on 6)

The hierarchical network system according to claim 6, wherein said predetermined policy is to evenly allocate said maximum admitted rate to said proxy server.

### Claim 8 (depends on 6)

The hierarchical network system according to claim 6, wherein said resource comprises at least one of CPU usage, memory usage, I/O, and bandwidth.

### Claim 9 (depends on 8)

The hierarchical network system according to claim 8, wherein when said resource is CPU usage, said maximum rate calculator adopts proportional-integral controller technologies to calculate said maximum allowable rate.

### Claim 10 (depends on 6)

The hierarchical network system according to claim 6, wherein the calculation period of said proxy server is in synchronization with said management cycle of the application server.

### Claim 11

A method for distributed workload management in hierarchical network system, comprising:
periodically determining a dispatch rate for requests of each service level based on measured request-related information and service quality parameters relative to service levels of requests, wherein a sum of said dispatch rate for respective service levels is less than or equal to a predetermined rate; and
dispatching the requests of said corresponding service level in accordance with said determined dispatch rate.

### Claim 12 (depends on 11)

The method according to claim 11, wherein said measured request-related information is a current request response time, and said service quality parameters comprise a target response time and an importance of said requests of the corresponding service level.

### Claim 13 (depends on 11)

The method according to claim 11, wherein periodically determining a dispatch rate for requests of each service level comprises:
correlating said measured request-related information and said service quality parameters relative to service levels of requests by using a utility function;
correlating the measured request-related information and the dispatch rate through a queuing model; and
obtaining the dispatch rate for the corresponding service level through minimizing the utility function.

### Claim 14 (depends on 11)

The method according to claim 11, wherein said predetermined rate is determined by an application server serving for said proxy server in said hierarchical network system, independent of said information about said proxy server.

### Claim 15 (depends on 11)

The method according to claim 11, further comprising:
receiving requests from clients, and classifying said requests into one or more service levels; and
maintaining one or more request queues, wherein different queues correspond to different service levels of requests.

### Claim 16 (depends on 11)

The method according to claim 11, wherein said predetermined rate is obtained through:
periodically detecting a current usage of a resource of said application server in said hierarchical network system and a current request arrival rate;
calculating a maximum allowable rate of requests for the next management cycle based on said detected current resource usage, said current request arrival rate and a target usage of the resource; and
allocating said maximum allowable rate to each proxy server in said hierarchical network system as its predetermined rate based on a predetermined policy.

### Claim 17 (depends on 16)

The method according to claim 16, wherein said predetermined policy is to evenly allocate said maximum allowed rate to said proxy server.

### Claim 18 (depends on 16)

The method according to claim 16, wherein said resources comprises at least one of CPU usage, memory usage, I/O, and bandwidth.

### Claim 19 (depends on 18)

The method according to claim 18, wherein when said resource is CPU usage, said maximum rate calculator adopts a proportional-integral controller technology to calculate said maximum allowed rate.

### Claim 20 (depends on 16)

The method according to claim 16, wherein the calculation period of said proxy server is in synchronization with said management cycle of the application server.
