# US 2017/0255491 A1 · Resource allocation for computer processing

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2017/0255491 A1
- Document ID: US20170255491A1
- Status: Published application
- Kind: A1
- Application number: 15/395,225
- Filed: 2016-12-30
- Published: 2017-09-07
- Earliest claimed: 2016-03-04
- Assignees: Google Inc.
- Applicants: Google Inc.
- Inventors: Robert Bradshaw; Rafael de Jesús Fernández Moctezuma; Daniel Mills; Samuel Green McVeety; Samuel Carl Whittle; Andrei Maksimenka; Cosmin Ionel Arad; Mark Brian Shields; Harris Samuel Nover; Manuel Alfred Fahndrich; Jeffrey Paul Gardner; Mikhail Shmulyan; Reuven Lax; Ahmet Altay; Craig D. Chambers
- Web page: https://patentgrep.com/patent/US20170255491A1

## CPC

- G06F 9/505: {considering the load}
- G06F 9/5011: {the resources being hardware resources other than CPUs, Servers and Terminals}
- G06F 9/5016: {the resource being the memory}
- G06F 9/5061: {Partitioning or combining of resources}
- G06F 2209/508: Monitor
- H04L 67/10: in which an application is distributed across nodes in the network (software deployment G06F8/60; multiprogramming arrangements G06F9/46)
- H04L 67/1097: for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)

## Abstract

A job that receives as input a data stream is executed. For the job, it is iteratively determined a backlog growth over a first period of time; a backlog volume; and whether to adjust a quantity of processing resources. For each iteration for which the quantity of processing resources allocated to the job are determined to be adjusted, adjusting the quantity of processing resources allocated to the job. For each iteration for which the quantity of processing resources allocated to the job are determined not to be adjusted, maintaining the quantity of processing resources allocated to the job.

## Claims

### Claim 1

A method implemented in a computer system, the method comprising:
executing, in a computer system that comprises multiple processing resources, a job that receives as input a data stream, wherein the amount of data in the data stream is unbounded;
iteratively determining, for the job:
a backlog growth over a first period of time, wherein the backlog growth is a measure of a growth of unprocessed data in the received data stream that is to be input into the job;
a backlog volume that is a measure of unprocessed data in the received data stream that is to be input into the job;
determining, based on the backlog growth and the backlog volume, whether to adjust a quantity of processing resources allocated to the job;
for each iteration for which the quantity of processing resources allocated to the job are determined to be adjusted, adjusting the quantity of processing resources allocated to the job; and
for each iteration for which the quantity of processing resources allocated to the job are determined not to be adjusted, maintaining the quantity of processing resources allocated to the job.

### Claim 2 (depends on 1)

The method of claim 1, wherein, for an iteration of the determination:
the backlog growth is determined to be zero or negative;
the backlog volume is determined to be at a target;
determining that the quantity of processing resources allocated to the job are determined not to be adjusted in response to the backlog growth being determined to be zero or negative and the backlog volume determined to be at a target.

### Claim 3 (depends on 1)

The method of claim 1, wherein, for an iteration of the determination:
the backlog growth is determined to be zero or negative;
the backlog volume is determined to be below a target;
determining that the quantity of processing resources allocated to the job are determined to be adjusted in response to the backlog growth being determined to be zero or negative and the backlog volume determined to be below a target; and
wherein adjusting the quantity of processing resources allocated to the job comprises reducing the quantity of processing resources allocated to the job in response to the backlog growth being determined to be zero or negative and the backlog volume determined to be below a target.

### Claim 4 (depends on 1)

The method of claim 1, wherein, for an iteration of the determination:
the backlog growth is determined to be zero or negative;
the backlog volume is determined to be above a target;
determining that the quantity of processing resources allocated to the job are determined to be adjusted in response to the backlog growth being determined to be zero or negative and the backlog volume determined to be above a target; and
wherein adjusting the quantity of processing resources allocated to the job comprises increasing the quantity of processing resources allocated to the job in response to the backlog growth being determined to be zero or negative and the backlog volume determined to be above a target.

### Claim 5 (depends on 1)

The method of claim 1, wherein, for an iteration of the determination:
the backlog growth is determined to be positive;
the backlog volume is determined to be below a target
determining that the quantity of processing resources allocated to the job are determined not to be adjusted in response to the backlog growth being determined to be positive and the backlog volume determined to be below a target.

### Claim 6 (depends on 1)

The method of claim 1, wherein, for an iteration of the determination:
the backlog growth is determined to be positive;
the backlog volume is determined to be not below a target
determining that the quantity of processing resources allocated to the job are determined to be adjusted in response to the backlog growth being determined to be positive and the backlog volume determined to be below a target; and
wherein adjusting the quantity of processing resources allocated to the job comprises increasing the quantity of processing resources allocated to the job in response to the backlog growth being determined to be positive and the backlog volume determined to be below a target.

### Claim 7 (depends on 1)

The method of claim 1, wherein the backlog growth is a measure of data size.

### Claim 8 (depends on 7)

The method of claim 7, wherein units of the data size is at least one of the group consisting of bits, bytes, megabytes, gigabytes, records, and cardinality.

### Claim 9 (depends on 1)

The method of claim 1, wherein backlog growth is a measure of time to process.

### Claim 10 (depends on 9)

The method of claim 9, wherein units of the time to process is at least one of the group consisting of microseconds, seconds, minutes, hours, and days.

### Claim 11 (depends on 1)

The method of claim 1, wherein the backlog volume is a measure of data size.

### Claim 12 (depends on 11)

The method of claim 11, wherein units of the data size is at least one of the group consisting of bits, bytes, megabytes, gigabytes, records, and cardinality.

### Claim 13 (depends on 1)

The method of claim 1, wherein backlog volume is a measure of time to process.

### Claim 14 (depends on 13)

The method of claim 13, wherein units of the time to process is at least one of the group consisting of microseconds, seconds, minutes, hours, and days.

### Claim 15 (depends on 1)

The method of claim 1, the method further comprising:
iteratively determining, for the job, a processor utilization;
wherein iteratively determining whether to adjust a quantity of processing resources allocated to the job is further based on the processor utilization.

### Claim 16 (depends on 15)

The method of claim 15, wherein:
wherein, for an iteration of the determination:
the processor utilization is below a value;
determining that the quantity of processing resources allocated to the job are determined to be adjusted in response to the processor utilization being determined to be below a value; and
wherein adjusting the quantity of processing resources allocated to the job comprises reducing the quantity of processing resources allocated to the job in response to the processor utilization being determined to be below a value.

### Claim 17 (depends on 16)

The method of claim 16, where in reducing the quantity of processing resources allocated to the job in response to the processor utilization being determined to be below a value comprises reducing a discrete number of resources allocated to the job, the discrete number being based on the processor utilization.

### Claim 18 (depends on 17)

The method of claim 17, wherein the discrete number is a number of computer memory disks.

### Claim 19 (depends on 1)

The method of claim 1, wherein determining, based on the backlog growth and the backlog volume, whether to adjust a quantity of processing resources allocated to the job comprises smoothing the determining that results in oscillation of quantity of processing resources allocated to the job.

### Claim 20 (depends on 19)

The method of claim 19, wherein smoothing the determining comprises waiting for a second period of time.

### Claim 21 (depends on 19)

The method of claim 19, wherein smoothing the determining comprises averaging a plurality of determinations whether to adjust a quantity of processing resources allocated to the job.

### Claim 22

A system comprising:
one or more processors configured to execute computer program instructions; and
computer storage media encoded with computer program instructions that, when executed by one or more processors, cause a computer device to perform operations comprising:
executing, in a computer system that comprises multiple processing resources, a job that receives as input a data stream, wherein the amount of data in the data stream is unbounded;
iteratively determining, for the job:
a backlog growth over a first period of time, wherein the backlog growth is a measure of a growth of unprocessed data in the received data stream that is to be input into the job;
a backlog volume that is a measure of unprocessed data in the received data stream that is to be input into the job;
determining, based on the backlog growth and the backlog volume, whether to adjust a quantity of processing resources allocated to the job;
for each iteration for which the quantity of processing resources allocated to the job are determined to be adjusted, adjusting the quantity of processing resources allocated to the job; and
for each iteration for which the quantity of processing resources allocated to the job are determined not to be adjusted, maintaining the quantity of processing resources allocated to the job.

### Claim 23 (depends on 22)

The system of claim 22, wherein, for an iteration of the determination:
the backlog growth is determined to be zero or negative;
the backlog volume is determined to be at a target;
determining that the quantity of processing resources allocated to the job are determined not to be adjusted in response to the backlog growth being determined to be zero or negative and the backlog volume determined to be at a target.

### Claim 24 (depends on 22)

The system of claim 22, wherein, for an iteration of the determination:
the backlog growth is determined to be zero or negative;
the backlog volume is determined to be below a target;
determining that the quantity of processing resources allocated to the job are determined to be adjusted in response to the backlog growth being determined to be zero or negative and the backlog volume determined to be below a target; and
wherein adjusting the quantity of processing resources allocated to the job comprises reducing the quantity of processing resources allocated to the job in response to the backlog growth being determined to be zero or negative and the backlog volume determined to be below a target.

### Claim 25 (depends on 22)

The system of claim 22, wherein, for an iteration of the determination:
the backlog growth is determined to be zero or negative;
the backlog volume is determined to be above a target;
determining that the quantity of processing resources allocated to the job are determined to be adjusted in response to the backlog growth being determined to be zero or negative and the backlog volume determined to be above a target; and
wherein adjusting the quantity of processing resources allocated to the job comprises increasing the quantity of processing resources allocated to the job in response to the backlog growth being determined to be zero or negative and the backlog volume determined to be above a target.

### Claim 26 (depends on 22)

The system of claim 22, wherein, for an iteration of the determination:
the backlog growth is determined to be positive;
the backlog volume is determined to be below a target
determining that the quantity of processing resources allocated to the job are determined not to be adjusted in response to the backlog growth being determined to be positive and the backlog volume determined to be below a target.

### Claim 27 (depends on 22)

The system of claim 22, wherein, for an iteration of the determination:
the backlog growth is determined to be positive;
the backlog volume is determined to be not below a target
determining that the quantity of processing resources allocated to the job are determined to be adjusted in response to the backlog growth being determined to be positive and the backlog volume determined to be below a target; and
wherein adjusting the quantity of processing resources allocated to the job comprises increasing the quantity of processing resources allocated to the job in response to the backlog growth being determined to be positive and the backlog volume determined to be below a target.

### Claim 28 (depends on 22)

The system of claim 22, wherein the backlog growth is a measure of data size.

### Claim 29 (depends on 28)

The system of claim 28, wherein units of the data size is at least one of the group consisting of bits, bytes, megabytes, gigabytes, records, and cardinality.

### Claim 30 (depends on 22)

The system of claim 22, wherein backlog growth is a measure of time to process.

### Claim 31 (depends on 30)

The system of claim 30, wherein units of the time to process is at least one of the group consisting of microseconds, seconds, minutes, hours, and days.

### Claim 32 (depends on 22)

The system of claim 22, wherein the backlog volume is a measure of data size.

### Claim 33 (depends on 32)

The system of claim 32, wherein units of the data size is at least one of the group consisting of bits, bytes, megabytes, gigabytes, records, and cardinality.

### Claim 34 (depends on 22)

The system of claim 22, wherein backlog volume is a measure of time to process.

### Claim 35 (depends on 34)

The system of claim 34, wherein units of the time to process is at least one of the group consisting of microseconds, seconds, minutes, hours, and days.

### Claim 36 (depends on 22)

The system of claim 22, the operations further comprising:
iteratively determining, for the job, a processor utilization;
wherein iteratively determining whether to adjust a quantity of processing resources allocated to the job is further based on the processor utilization.

### Claim 37 (depends on 36)

The system of claim 36, wherein:
wherein, for an iteration of the determination:
the processor utilization is below a value;
determining that the quantity of processing resources allocated to the job are determined to be adjusted in response to the processor utilization being determined to be below a value; and
wherein adjusting the quantity of processing resources allocated to the job comprises reducing the quantity of processing resources allocated to the job in response to the processor utilization being determined to be below a value.

### Claim 38 (depends on 37)

The system of claim 37, where in reducing the quantity of processing resources allocated to the job in response to the processor utilization being determined to be below a value comprises reducing a discrete number of resources allocated to the job, the discrete number being based on the processor utilization.

### Claim 39 (depends on 38)

The system of claim 38, wherein the discrete number is a number of computer memory disks.

### Claim 40 (depends on 22)

The system of claim 22, wherein determining, based on the backlog growth and the backlog volume, whether to adjust a quantity of processing resources allocated to the job comprises smoothing the determining that results in oscillation of quantity of processing resources allocated to the job.

### Claim 41 (depends on 40)

The system of claim 40, wherein smoothing the determining comprises waiting for a second period of time.

### Claim 42 (depends on 40)

The system of claim 40, wherein smoothing the determining comprises averaging a plurality of determinations whether to adjust a quantity of processing resources allocated to the job.
