# US 2012/0254443 A1 · Information processing system, information processing apparatus, method of scaling, program, and recording medium

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2012/0254443 A1
- Document ID: US20120254443A1
- Status: Published application
- Kind: A1
- Application number: 13/435,037
- Filed: 2012-03-30
- Published: 2012-10-04
- Earliest claimed: 2011-03-30
- Assignees: International Business Machines Corporation
- Inventors: Yohei Ueda
- Web page: https://patentgrep.com/patent/US20120254443A1

## CPC

- G06F 9/5083: {Techniques for rebalancing the load in a distributed system}
- H04L 67/1008: based on parameters of servers, e.g. available memory or workload (monitoring of computer activity G06F11/30)
- H04L 67/1031: Controlling of the operation of servers by a load balancer, e.g. adding or removing servers that serve requests
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)

## Abstract

An information processing system 100 includes a processing server group 120 including processing servers 122; an alternate server 124 for responding to requests on behalf of the processing server group 120; and a load balancer 110 distributing traffic within the processing server group 120 and, when the processing server group 120 is overloaded, transferring traffic to the alternate server 124. The information processing system 100 further calculates a target size of the processing server group 120 on the basis of the amount of traffic transferred by the load balancer 110 to the processing server group 120 and the amount of traffic transferred by the load balancer 110 to the alternate server 124, and prepares the processing servers in the processing server group in order to increase the size of the processing server group to the target size.

## Claims

### Claim 1

1) An information processing system comprising:
a processing server group comprising a plurality of processing servers;
an alternate server for responding to a request on behalf of the processing server group;
a load balancer distributing traffic among the processing servers in the processing server group and transferring traffic to the alternate server on condition that the processing server group becomes overloaded;
a target size calculating unit calculating a target size of the processing server group on the basis of the amount of traffic transferred by the load balancer to the processing server group and the amount of traffic transferred by the load balancer to the alternate server; and
a server preparation unit preparing the processing servers in the processing server group in order to increase the size of the processing server group to the target size.

### Claim 2 (depends on 1)

2) The information processing system according to claim 1, wherein the target size calculating unit calculates the target size of the processing server group depending on an evaluation index representing a local load observed for the processing servers in the processing server group.

### Claim 3 (depends on 2)

3) The information processing system according to claim 2, further comprising a second server group provided in a stage following the processing server group,
wherein the target size calculating unit determines a bottleneck from the evaluation index observed for the processing servers in the processing server group and, on condition that it is determined that the bottleneck is in the stage following the processing server group, calculates a target size of the second server group on the basis of the amount of traffic transferred to the processing server group and the amount of traffic transferred to the alternate server, and
the server preparation unit prepares processing servers in the second server group in order to increase the size of the second server group to the target size.

### Claim 4 (depends on 1)

4) The information processing system according to claim 1, wherein the load balancer monitors response performance of the processing server group and determines that the processing server group is overloaded on condition that the response performance satisfies a transfer condition.

### Claim 5 (depends on 1)

5) The information processing system according to claim 1, wherein the amounts of transferred traffic are quantified in terms of the number of connections, the number of clients, or the number of sessions.

### Claim 6 (depends on 1)

6) The information processing system according to claim 1, wherein the alternate server is a Sorry server.

### Claim 7 (depends on 1)

7) The information processing system according to claim 1, wherein the target size calculating unit calculates the target size of the processing server group depending on the ratio between the amount of traffic transferred to the processing server group and the amount of traffic transferred to the alternate server.

### Claim 8 (depends on 2)

8) The information processing system according to claim 2, wherein the processing servers each run on a virtual machine, the evaluation index representing the local load is a resource utilization rate of virtual machines on which the processing servers run, the server preparation unit prepares the processing servers by instructing a hypervisor on a physical machine to activate instances of the virtual machines that run the processing servers in the processing server group, and the target size of the processing server group is quantified in terms of the number of instances of the virtual machines that run the processing servers in the processing server group.

### Claim 9 (depends on 3)

9) The information processing system according to claim 3, wherein the processing server group comprises web servers as processing servers, and the second server group comprises application servers or memory cache servers as processing servers.

### Claim 10

10) An information processing apparatus comprising:
a transfer amount acquisition unit acquiring, from a load balancer, the amount of traffic transferred to a processing server group and the amount of traffic transferred to an alternate server, the load balancer distributing traffic among a plurality of processing servers in the processing server group and transferring traffic to the alternate server on condition that the processing server group becomes overloaded;
a target size calculating unit calculating a target size of the processing server group on the basis of the amount of traffic transferred to the processing server group and the amount of traffic transferred to the alternate server; and
a server preparation unit preparing the processing servers in the processing server group in order to increase the size of the processing server group to the target size.

### Claim 11 (depends on 10)

11) The information processing apparatus according to claim 10, wherein the target size calculating unit calculates the target size of the processing server group depending on an evaluation index representing a local load observed for the processing servers in the processing server group.

### Claim 12 (depends on 11)

12) The information processing apparatus according to claim 11, wherein
the target size calculating unit determines a bottleneck from the evaluation index observed for the processing servers in the processing server group and on condition that it is determined that the bottleneck is in a stage following the processing server group, calculates a target size of a second server group provided in the stage following the processing server group on the basis of the amount of traffic transferred to the processing server group and the amount of traffic transferred to the alternate server, and
the server preparation unit prepares processing servers in the second server group in order to increase the size of the second server group to the target size.

### Claim 13

13) A method of scaling performed by an information processing apparatus connected to a load balancer, the load balancer distributing traffic among a plurality of processing servers in a processing server group while monitoring the state of load on the processing server group and transferring traffic to an alternate server on condition that the processing server group becomes overloaded, the method comprising the steps of:
the information processing apparatus detecting satisfaction of a scale-up trigger condition for increasing the size of the processing server group;
the information processing apparatus acquiring, from the load balancer, the amount of traffic transferred to the processing server group and the amount of traffic transferred to the alternate server;
the information processing apparatus calculating a target size of the processing server group on the basis of the amount of traffic transferred to the processing server group and the amount of traffic transferred to the alternate server; and
the information processing apparatus preparing the processing servers in the processing server group in order to increase the size of the processing server group to the target size.

### Claim 14 (depends on 13)

14) The method of scaling according to claim 13, wherein the step of calculating the target size comprises the step of the information processing apparatus calculating the target size of the processing server group depending on an evaluation index representing a local load observed for the processing servers in the processing server group.

### Claim 15 (depends on 14)

15) The method of scaling according to claim 14, further comprising the steps of:
the information processing apparatus determining a bottleneck from the evaluation index observed for the processing servers in the processing server group;
the information processing apparatus calculating on condition that it is determined that the bottleneck is in a stage following the processing server group, a target size of a second server group provided in the stage following the processing server group on the basis of the amount of traffic transferred to the processing server group and the amount of traffic transferred to the alternate server; and
the information processing apparatus preparing processing servers in the second server group in order to increase the size of the second server group to the target size.

### Claim 16

16) A computer-executable program for causing a computer to function as:
a transfer amount acquisition unit acquiring, from a load balancer, the amount of traffic transferred to a processing server group and the amount of traffic transferred to an alternate server, the load balancer distributing traffic among a plurality of processing servers in the processing server group and transferring traffic to the alternate server on condition that the processing server group becomes overloaded;
a target size calculating unit calculating a target size of the processing server group on the basis of the amount of traffic transferred to the processing server group and the amount of traffic transferred to the alternate server; and
a server preparation unit preparing the processing servers in the processing server group in order to increase the size of the processing server group to the target size.

### Claim 17 (depends on 16)

17) A recording medium having the computer-executable program according to claim 16 recorded thereon in computer-readable form.
