# US 2017/0256017 A1 · Graphics processing unit resource sharing

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2017/0256017 A1
- Document ID: US20170256017A1
- Status: Published application
- Kind: A1
- Application number: 15/059,580
- Filed: 2016-03-03
- Published: 2017-09-07
- Earliest claimed: 2016-03-03
- Assignees: International Business Machines Corporation
- Applicants: International Business Machines Corporation
- Inventors: Anshul Gandhi; Hui Lei; Jayaram Kallapalayam Radhakrishnan; Charles O. Schulz; Shu Tao
- Web page: https://patentgrep.com/patent/US20170256017A1

## CPC

- G06T 1/20: Processor architectures; Processor configuration, e.g. pipelining
- G06T 1/60: Memory management
- G06F 2009/45579: {I/O management, e.g. providing access to device drivers or storage}
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

Examples of GPU resource sharing among applications are disclosed. In one example, a method includes receiving a first request from a first application of the plurality of applications for first requested GPU resources, and receiving a second request from a second application of the plurality of applications for second GPU resources. The method also includes, responsive to determining that the first requested GPU resources are available, allocating a first slice of the GPU resources with a first requested amount of resources to the first application and, responsive to determining that the second requested GPU resources are available, allocating a second slice of the GPU resources with a second requested amount of resources to the second application. Further, the method includes enabling the first application and the second application to execute concurrently within the first slice of the GPU and the second slice of the GPU respectively.

## Claims

### Claim 1

A computer-implemented method for sharing resources of a graphics processing unit (GPU) among a plurality of applications, the method comprising:
receiving a first request from a first application of the plurality of applications for first requested GPU resources, the GPU resources comprising a processor and a memory;
receiving a second request from a second application of the plurality of applications for second GPU resources;
responsive to determining that the first requested GPU resources are available, allocating a first slice of the GPU resources with a first requested amount of resources to the first application;
responsive to determining that the second requested GPU resources are available, allocating a second slice of the GPU resources with a second requested amount of resources to the second application; and
enabling the first application and the second application to execute concurrently within the first slice of the GPU and the second slice of the GPU respectively,
wherein allocating the first application to the first slice and allocating the second application to the second slice is performed according to a fairness policy, wherein the fairness policy establishes that an allocated percent of the memory is less than or equal to an allocated percent of the processor.

### Claim 2 (depends on 1)

The computer-implemented method of claim 1, wherein the first slice is inaccessible to the second application and wherein the second slice is inaccessible to the first application.

### Claim 3

(canceled)

### Claim 4 (depends on 1)

The computer-implemented method of claim 1, further comprising:
receiving a third request from a third application of the plurality of applications for third requested GPU resources; and
responsive to determining that the third requested GPU resources are available, allocating a third slice of the GPU resources with a third requested amount of resources to the third application.

### Claim 5 (depends on 4)

The computer-implemented method of claim 4, further comprising:
enabling the third application to execute on the third slice concurrently with the first application executing on the first slice and the second application executing on the second slice.

### Claim 6 (depends on 1)

The computer-implemented method of claim 1, wherein receiving the first request, receiving the second request, allocating the first slice to a first container, and allocating the second slice to a second container are performed by a gatekeeper.

### Claim 7 (depends on 1)

The computer-implemented method of claim 1, wherein the processor comprises multiple GPU cores, wherein each GPU core of the multiple GPU cores comprises a plurality of hardware threads.

### Claim 8 (depends on 1)

The computer-implemented method of claim 1, wherein the first request is a request for at least one of a desired minimum and a desired maximum amount of resources, and wherein the second request is a request for at least one of a desired minimum and a desired maximum amount of resources.

### Claim 9

A system for sharing resources of a graphics processing unit (GPU) among a plurality of applications, the system comprising:
a processor in communication with one or more types of memory, the processor configured to:
receive a first request from a first application of the plurality of applications for first requested GPU resources, the GPU resources comprising a processor and a memory;
receive a second request from a second application of the plurality of applications for second GPU resources;
responsive to determining that the first requested GPU resources are available, allocate a first slice of the GPU resources with a first requested amount of resources to the first application;
responsive to determining that the second requested GPU resources are available, allocate a second slice of the GPU resources with a second requested amount of resources to the second application; and
enable the first application and the second application to execute concurrently within the first slice of the GPU and the second slice of the GPU respectively,
wherein allocating the first application to the first slice and allocating the second application to the second slice is performed according to a fairness policy, wherein the fairness policy establishes that an allocated percent of the memory is less than or equal to an allocated percent of the processor.

### Claim 10 (depends on 9)

The system of claim 9, wherein the first slice is inaccessible to the second application and wherein the second slice is inaccessible to the first application.

### Claim 11

(canceled)

### Claim 12 (depends on 9)

The system of claim 9, wherein the processor is further configured to:
receive a third request from a third application of the plurality of applications for third requested GPU resources; and
responsive to determining that the third requested GPU resources are available, allocate a third slice of the GPU resources with a third requested amount of resources to the third application.

### Claim 13 (depends on 12)

The system of claim 12, wherein the processor is further configured to:
enable the third application to execute on the third slice concurrently with the first application executing on the first slice and the second application executing on the second slice.

### Claim 14 (depends on 9)

The system of claim 9, wherein receiving the first request, receiving the second request, allocating the first slice to a first container, and allocating the second slice to a second container are performed by a gatekeeper.

### Claim 15 (depends on 9)

The system of claim 9, wherein the processor comprises multiple GPU cores, wherein each GPU core of the multiple GPU cores comprises a plurality of hardware threads.

### Claim 16 (depends on 9)

The system of claim 9, wherein the first request is a request for at least one of a desired minimum and a desired maximum amount of resources, and wherein the second request is a request for at least one of a desired minimum and a desired maximum amount of resources.

### Claim 17

A computer program product for sharing resources of a graphics processing unit (GPU) among a plurality of applications, the computer program product comprising:
a non-transitory storage medium readable by a processing circuit and storing instructions for execution by the processing circuit for performing a method comprising:
receiving a first request from a first application of the plurality of applications for first requested GPU resources, the GPU resources comprising a processor and a memory;
receiving a second request from a second application of the plurality of applications for second GPU resources;
responsive to determining that the first requested GPU resources are available, allocating a first slice of the GPU resources with a first requested amount of resources to the first application;
responsive to determining that the second requested GPU resources are available, allocating a second slice of the GPU resources with a second requested amount of resources to the second application; and
enabling the first application and the second application to execute concurrently within the first slice of the GPU and the second slice of the GPU respectively,
wherein allocating the first application to the first slice and allocating the second application to the second slice is performed according to a fairness policy, wherein the fairness policy establishes that an allocated percent of the memory is less than or equal to an allocated percent of the processor.

### Claim 18 (depends on 17)

The computer program product of claim 17, wherein the first slice is inaccessible to the second application and wherein the second slice is inaccessible to the first application.

### Claim 19

(canceled)

### Claim 20 (depends on 17)

The computer program product of claim 17, wherein the method further comprises:
receiving a third request from a third application of the plurality of applications for third requested GPU resources; and
responsive to determining that the third requested GPU resources are available, allocating a third slice of the GPU resources with a third requested amount of resources to the third application.
