# US 8,817,030 B2 · GPGPU systems and services

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 8,817,030 B2
- Document ID: US8817030B2
- Status: Granted
- Kind: B2
- Application number: 12/895,554
- Filed: 2010-09-30
- Published: 2011-03-31
- Granted: 2014-08-26
- Earliest claimed: 2009-09-30
- Assignees: CreativeC LLC
- Applicants: Greg Scantlen; Gary Scantlen
- Inventors: Greg Scantlen; Gary Scantlen
- Web page: https://patentgrep.com/patent/US8817030B2

## CPC

- G06T 1/20: Processor architectures; Processor configuration, e.g. pipelining
- G06F 9/5011: {the resources being hardware resources other than CPUs, Servers and Terminals}
- G06F 2209/504: Resource capping
- G06F 2209/508: Monitor
- Y02D 10/00: Energy efficient computing, e.g. low power processors, power management or thermal management
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- Y02D: CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE

## Abstract

Graphics processing units (GPUs) deployed in general purpose GPU (GPGPU) units are combined into a GPGPU cluster. Access to the GPGPU cluster is then offered as a service to users who can use their own computers to communicate with the GPGPU cluster. The users develop applications to be run on the cluster and a profiling module tracks the applications' resource utilization and can report it to the user and to a subscription server. The user can examine the report to thereby optimize the application or the cluster's configuration. The subscription server can interpret the report to thereby invoice the user or otherwise govern the users' access to the cluster.

## Claims

### Claim 1

A GPGPU cluster computing service comprising:
a subscription server module communicating with a user's computer and controlling a user's access to the GPGPU cluster computing service;
a plurality of GPGPU units each comprising an enclosure, a cooling fan, a CPU, system memory, GPU memory, a GPU, and a communications interface, wherein each GPU on the plurality of GPGPU units is accessible by the user computer subject to permission determined by the subscription server;
a GPGPU application created by a user on the user's computer to include a specification for the GPGPU cluster configuration, the GPGPU application received by the plurality of GPGPU units from the user's computer, the GPGPU application configured to be run by the plurality of GPGPU units to produce application results based on the user created specification wherein the GPGPU units are interconnected in accordance with a first configuration, wherein the GPGPU application comprises GPU instructions that are performed by the GPUs, and wherein the GPGPU application comprises application data that is operated on by the GPU instructions;
a second GPGPU application created by a user on the user's computer to include a second specification for the GPGPU cluster configuration, the second GPGPU application designed to also produce the application results using the second specification but wherein the GPGPU units are interconnected in accordance with a second configuration such that the user receives secondary resource utilization information to thereby guide the user to selecting a preferred configuration, wherein the user can test and profile the first GPGPU application and the second GPGPU application; and
a profiling module that tracks the GPGPU application's resource utilization during run time such that the user receives resource utilization information.

### Claim 2 (depends on 1)

GPGPU cluster computing service of claim 1 further comprising a data storage array in communication with the GPGPU units wherein the user stores the application data in the data storage array for later use by the GPGPU units.

### Claim 3 (depends on 1)

GPGPU cluster computing service of claim 1 wherein the subscription server module receives the resource utilization information from the profiling module and limits the user's consumption of resources.

### Claim 4 (depends on 1)

GPGPU cluster computing service of claim 1 wherein the subscription server module receives the resource utilization information such that the user is invoiced.

### Claim 5 (depends on 1)

GPGPU cluster computing service of claim 1 further comprising a controller comprising an enclosure, a CPU, memory, and a communications interface and wherein the subscription server module is a computer program running on the controller.

### Claim 6 (depends on 5)

GPGPU cluster computing service of claim 5 wherein the profiling module is a computer program running on the controller.

### Claim 7 (depends on 1)

GPGPU cluster computing service of claim 1 further comprising a controller comprising an enclosure, a CPU, memory, and a communications interface and wherein the profiling module is a computer program running on the controller.

### Claim 8

A GPGPU cluster computing service comprising:
a subscription server module communicating with a user's computer and controlling a user's access to the GPGPU cluster computing service;
a plurality of GPGPU units each comprising and enclosure, a cooling fan, a CPU, system memory, GPU memory, a GPU, and a communications interface, wherein each GPU on the plurality of GPGPU units is accessible by the user computer subject to permission determined by the subscription server;
a first GPGPU application created by a user on the user's computer to include a specification for the GPGPU cluster configuration, the first GPGPU application received by the plurality of GPGPU units from the user's computer, the first GPGPU application configured to be run by the GPGPU units to produce application results based on the user created specification wherein the GPGPU units are interconnected in accordance with a first configuration, wherein the first GPGPU application comprises GPU instructions that are performed by the GPUs, and wherein the first GPGPU application comprises application data that is operated on by the GPU instructions;
a profiling module that tracks the first GPGPU application's resource utilization during run time such that the user receives primary resource utilization information;
a second GPGPU application created by a user on the user's computer to include a second specification for the GPGPU cluster configuration, the second GPGPU application received by the plurality of GPGPU units from the user's computer, the second GPGPU application designed to also produce the application results using the second specification but wherein the GPGPU units are interconnected in accordance with a second configuration such that the user receives secondary resource utilization information to thereby guide the user to test and profile the first GPGPU application and the second GPGPU application to select a preferred configuration.

### Claim 9 (depends on 8)

GPGPU cluster computing service of claim 8 further comprising a data storage array in communication with the GPGPU units wherein the user stores the application data in the data storage array for later use by the GPGPU units and wherein both the first GPGPU application and the second GPGPU application use the application data.

### Claim 10 (depends on 9)

GPGPU cluster computing service of claim 9 wherein the subscription server module receives the resource utilization information such that the user is invoiced accordingly.

### Claim 11 (depends on 10)

GPGPU cluster computing service of claim 10 further comprising a controller comprising an enclosure, a CPU, memory, and a communications interface and wherein the subscription server module is a computer program running on the controller.

### Claim 12 (depends on 11)

GPGPU cluster computing service of claim 11 wherein the profiling module is a computer program running on the controller.

### Claim 13 (depends on 11)

GPGPU cluster computing service of claim 11 further comprising a controller comprising an enclosure, a CPU, memory, and a communications interface and wherein the profiling module is a computer program running on the controller.

### Claim 14 (depends on 9)

GPGPU cluster computing service of claim 9 wherein the subscription server module receives the resource utilization information and limits the user's consumption of resources.

### Claim 15 (depends on 10)

GPGPU cluster computing service of claim 10 further comprising a controller comprising an enclosure, a CPU, memory, and a communications interface and wherein the controller processes at least a portion of the application data in accordance with the second configuration.

### Claim 16 (depends on 15)

GPGPU cluster computing service of claim 15 wherein the controller further comprises GPU memory and a GPU that process at least a portion of the application data.
