# US 2012/0254344 A1 · Endpoint-Based Parallel Data Processing In A Parallel Active Messaging Interface Of A Parallel Computer

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2012/0254344 A1
- Document ID: US20120254344A1
- Status: Published application
- Kind: A1
- Application number: 12/963,671
- Filed: 2010-12-09
- Published: 2012-10-04
- Earliest claimed: 2010-12-09
- Assignees: International Business Machines Corporation
- Inventors: Charles J. Archer; Michael A. Blocksome; Joseph D. Ratterman; Brian E. Smith
- Web page: https://patentgrep.com/patent/US20120254344A1

## CPC

- G06F 9/541: {via adapters, e.g. between incompatible applications}
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

Endpoint-based parallel data processing in a parallel active messaging interface (‘PAMI’) of a parallel computer, the PAMI composed of data communications endpoints, each endpoint including a specification of data communications parameters for a thread of execution on a compute node, including specifications of a client, a context, and a task, the compute nodes coupled for data communications through the PAMI, including establishing a data communications geometry, the geometry specifying, for tasks representing processes of execution of the parallel application, a set of endpoints that are used in collective operations of the PAMI including a plurality of endpoints for one of the tasks; receiving in endpoints of the geometry an instruction for a collective operation; and executing the instruction for a collective operation through the endpoints in dependence upon the geometry, including dividing data communications operations among the plurality of endpoints for one of the tasks.

## Claims

### Claim 1

A method of endpoint-based parallel data processing in a parallel active messaging interface (‘PAMI’) of a parallel computer, the parallel computer comprising a plurality of compute nodes that execute a parallel application, the PAMI comprising data communications endpoints, each endpoint comprising a specification of data communications parameters for a thread of execution on a compute node, including specifications of a client, a context, and a task, the endpoints coupled for data communications through the PAMI, the method comprising:
establishing by an application-level entity, for collective operations of the PAMI, a data communications geometry, the geometry specifying, for tasks representing processes of execution of the parallel application, a set of endpoints that are used in collective operations of the PAMI, including a plurality of endpoints for one of the tasks;
receiving in one or more endpoints of the geometry an instruction for a collective operation, the instruction specifying communications of transfer data among the endpoints of the geometry; and
executing the instruction for a collective operation through the endpoints in dependence upon the geometry, including dividing data communications operations among the plurality of endpoints for one of the tasks.

### Claim 2 (depends on 1)

The method of claim 1 wherein establishing a data communications geometry further comprises associating with the geometry a list of collective algorithms valid for use with the endpoints of the geometry.

### Claim 3 (depends on 1)

The method of claim 1 wherein dividing data communications operations further comprises:
assigning to each of the plurality of endpoints for one of the tasks a separate subset of the endpoints in the geometry; and
transferring, in parallel operations by each of the plurality of endpoints for one of the tasks, the transfer data to each of the endpoints in the subset assigned to that endpoint.

### Claim 4 (depends on 1)

The method of claim 1 wherein dividing data communications operations further comprises:
assigning portions of the transfer data to each of the plurality of endpoints for one of the tasks, the number of portions being equal to the number of tasks of endpoints of the geometry, each portion of the transfer data corresponding to a task of the geometry; and
transferring, in parallel operations by the plurality of endpoints for one of the tasks to one endpoint for each task of the geometry, a corresponding portion of the transfer data.

### Claim 5 (depends on 1)

The method of claim 1 wherein dividing data communications operations further comprises:
assigning to each of the plurality of endpoints for one of the tasks a separate subset of the tasks in the geometry;
transferring, by one endpoint of each task in the geometry, a different portion of the transfer data to one of the plurality of endpoints for one of the tasks; and
gathering, in parallel operations by the plurality of endpoints for one task, all of the transfer data into a single receive buffer, the receive buffer divided into segments each of which corresponds to a portion of the transfer data transferred from an endpoint of a task in the geometry.

### Claim 6 (depends on 1)

The method of claim 1 wherein:
each client comprises a collection of data communications resources dedicated to the exclusive use of an application-level data processing entity;
each context comprises a subset of the collection of data processing resources of a client, context functions, and a work queue of data transfer instructions to be performed by use of the subset through the context functions operated by an assigned thread of execution; and
each task represents a process of execution of the parallel application.

### Claim 7 (depends on 1)

The method of claim 1 wherein each context carries out, through post and advance operations, data communications for the application on data communications resources in the exclusive possession of that context.

### Claim 8 (depends on 1)

The method of claim 1 wherein each context carries out data communications operations independently and in parallel with other contexts.

### Claim 9

A parallel computer that implements endpoint-based parallel data processing in a parallel active messaging interface (‘PAMI’) of the parallel computer, the parallel computer comprising a plurality of compute nodes that execute a parallel application, the PAMI comprising data communications endpoints, each endpoint comprising a specification of data communications parameters for a thread of execution on a compute node, including specifications of a client, a context, and a task, the endpoints coupled for data communications through the PAMI, the compute nodes comprising computer processors operatively coupled to computer memory having disposed within it computer program instructions that, when executed by the computer processors, cause the parallel computer to function by:
establishing by an application-level entity, for collective operations of the PAMI, a data communications geometry, the geometry specifying, for tasks representing processes of execution of the parallel application, a set of endpoints that are used in collective operations of the PAMI, including a plurality of endpoints for one of the tasks;
receiving in one or more endpoints of the geometry an instruction for a collective operation, the instruction specifying communications of transfer data among the endpoints of the geometry; and
executing the instruction for a collective operation through the endpoints in dependence upon the geometry, including dividing data communications operations among the plurality of endpoints for one of the tasks.

### Claim 10 (depends on 9)

The parallel computer of claim 9 wherein establishing a data communications geometry further comprises associating with the geometry a list of collective algorithms valid for use with the endpoints of the geometry.

### Claim 11 (depends on 9)

The parallel computer of claim 9 wherein dividing data communications operations further comprises:
assigning to each of the plurality of endpoints for one of the tasks a separate subset of the endpoints in the geometry; and
transferring, in parallel operations by each of the plurality of endpoints for one of the tasks, the transfer data to each of the endpoints in the subset assigned to that endpoint.

### Claim 12 (depends on 9)

The parallel computer of claim 9 wherein dividing data communications operations further comprises:
assigning portions of the transfer data to each of the plurality of endpoints for one of the tasks, the number of portions being equal to the number of tasks of endpoints of the geometry, each portion of the transfer data corresponding to a task of the geometry; and
transferring, in parallel operations by the plurality of endpoints for one of the tasks to one endpoint for each task of the geometry, a corresponding portion of the transfer data.

### Claim 13 (depends on 9)

The parallel computer of claim 9 wherein dividing data communications operations further comprises:
assigning to each of the plurality of endpoints for one of the tasks a separate subset of the tasks in the geometry;
transferring, by one endpoint of each task in the geometry, a different portion of the transfer data to one of the plurality of endpoints for one of the tasks; and
gathering, in parallel operations by the plurality of endpoints for one task, all of the transfer data into a single receive buffer, the receive buffer divided into segments each of which corresponds to a portion of the transfer data transferred from an endpoint of a task in the geometry.

### Claim 14 (depends on 9)

The parallel computer of claim 9 wherein:
each client comprises a collection of data communications resources dedicated to the exclusive use of an application-level data processing entity;
each context comprises a subset of the collection of data processing resources of a client, context functions, and a work queue of data transfer instructions to be performed by use of the subset through the context functions operated by an assigned thread of execution; and
each task represents a process of execution of the parallel application.

### Claim 15

A computer program product for endpoint-based parallel data processing in a parallel active messaging interface (‘PAMI’) of a parallel computer, the parallel computer comprising a plurality of compute nodes that execute a parallel application, the PAMI comprising data communications endpoints, each endpoint comprising a specification of data communications parameters for a thread of execution on a compute node, including specifications of a client, a context, and a task, the endpoints coupled for data communications through the PAMI, the computer program product disposed upon a computer readable storage medium, the computer program product comprising computer program instructions that, when installed and executed, cause the parallel computer to function by:
establishing by an application-level entity, for collective operations of the PAMI, a data communications geometry, the geometry specifying, for tasks representing processes of execution of the parallel application, a set of endpoints that are used in collective operations of the PAMI, including a plurality of endpoints for one of the tasks;
receiving in one or more endpoints of the geometry an instruction for a collective operation, the instruction specifying communications of transfer data among the endpoints of the geometry; and
executing the instruction for a collective operation through the endpoints in dependence upon the geometry, including dividing data communications operations among the plurality of endpoints for one of the tasks.

### Claim 16 (depends on 15)

The computer program product of claim 15 wherein establishing a data communications geometry further comprises associating with the geometry a list of collective algorithms valid for use with the endpoints of the geometry.

### Claim 17 (depends on 15)

The computer program product of claim 15 wherein dividing data communications operations further comprises:
assigning to each of the plurality of endpoints for one of the tasks a separate subset of the endpoints in the geometry; and
transferring, in parallel operations by each of the plurality of endpoints for one of the tasks, the transfer data to each of the endpoints in the subset assigned to that endpoint.

### Claim 18 (depends on 15)

The computer program product of claim 15 wherein dividing data communications operations further comprises:
assigning portions of the transfer data to each of the plurality of endpoints for one of the tasks, the number of portions being equal to the number of tasks of endpoints of the geometry, each portion of the transfer data corresponding to a task of the geometry; and
transferring, in parallel operations by the plurality of endpoints for one of the tasks to one endpoint for each task of the geometry, a corresponding portion of the transfer data.

### Claim 19 (depends on 15)

The computer program product of claim 15 wherein dividing data communications operations further comprises:
assigning to each of the plurality of endpoints for one of the tasks a separate subset of the tasks in the geometry;
transferring, by one endpoint of each task in the geometry, a different portion of the transfer data to one of the plurality of endpoints for one of the tasks; and
gathering, in parallel operations by the plurality of endpoints for one task, all of the transfer data into a single receive buffer, the receive buffer divided into segments each of which corresponds to a portion of the transfer data transferred from an endpoint of a task in the geometry.

### Claim 20 (depends on 15)

The computer program product of claim 15 wherein:
each client comprises a collection of data communications resources dedicated to the exclusive use of an application-level data processing entity;
each context comprises a subset of the collection of data processing resources of a client, context functions, and a work queue of data transfer instructions to be performed by use of the subset through the context functions operated by an assigned thread of execution; and
each task represents a process of execution of the parallel application.
