# US 2019/0319850 A1 · Operator fusion management in a stream computing environment

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0319850 A1
- Document ID: US20190319850A1
- Status: Published application
- Kind: A1
- Application number: 16/454,366
- Filed: 2019-06-27
- Published: 2019-10-17
- Earliest claimed: 2016-09-22
- Assignees: International Business Machines Corporation
- Applicants: International Business Machines Corporation
- Inventors: Bradley W. Fawcett
- Web page: https://patentgrep.com/patent/US20190319850A1

## CPC

- H04L 41/0813: characterised by the conditions triggering a change of settings
- H04L 41/20: {Network management software packages}
- H04L 43/0876: Network utilisation, e.g. volume of load or congestion level
- H04L 69/16: Implementation or adaptation of Internet protocol [IP], of transmission control protocol [TCP] or of user datagram protocol [UDP]
- H04L 43/16: Threshold monitoring
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)

## Abstract

Disclosed aspects relate to operator fusion management in a stream computing environment. A topology model which indicates a set of stream operators, a set of connections between the set of stream operators, and a set of stream operator attributes for the set of stream operators may be established. Based on the topology model, a set of operator fusion management operations to combine the set of stream operators into a set of processing elements may be determined. The set of processing elements may be constructed by performing the set of operator fusion management operations.

## Claims

### Claim 1

A computer-implemented method for operator fusion management in a stream computing environment, the method comprising:
establishing a topology model which indicates:
a set of stream operators,
a set of connections between the set of stream operators, and
a set of stream operator attributes for the set of stream operators;
detecting, using the topology model, a familial subset of the set of stream operators which indicates one or more stream operators that have a fusion-related mandate;
building a single processing element that includes the familial subset of the set of stream operators;
determining, based on the topology model, a set of operator fusion management operations to combine the set of stream operators into a set of processing elements; and
constructing, by performing the set of operator fusion management operations, the set of processing elements.

### Claim 2 (depends on 1)

The method of claim 1, wherein determining, based on the topology model, the set of operator fusion management operations includes:
using a set of deployment cluster characteristics, wherein the set of deployment cluster characteristics includes both a compute host quantity factor and a compute host size factor.

### Claim 3 (depends on 1)

The method of claim 1, wherein determining, based on the topology model, the set of operator fusion management operations includes:
using a fusion tightness factor.

### Claim 4 (depends on 1)

The method of claim 1, wherein determining, based on the topology model, the set of operator fusion management operations includes:
using a set of application characteristics, wherein the set of application characteristics indicates: a stream operator co-location criterion, a stream operator ex-location criterion, a stream operator isolation criterion, a stream operator count, and a constraint complexity factor.

### Claim 5 (depends on 1)

The method of claim 1, wherein determining, based on the topology model, the set of operator fusion management operations includes:
using a set of historical data associated with a set of parameters of the set of operator fusion management operations.

### Claim 6 (depends on 1)

The method of claim 1, wherein determining, based on the topology model, the set of operator fusion management operations includes:
using a deployment cluster load factor related to a separate stream application.

### Claim 7 (depends on 1)

The method of claim 1, wherein determining, based on the topology model, the set of operator fusion management operations includes:
identifying a set of inflexible parameters with respect to the set of operator fusion management operations;
identifying a set of flexible parameters with respect to the set of operator fusion management operations;
configuring a set of inflexible parameter values for the set of inflexible parameters to disallow a first modification which exceeds a first threshold; and
configuring a set of flexible parameter values for the set of flexible parameters to allow a second modification within a second threshold.

### Claim 8 (depends on 1)

The method of claim 1, wherein determining, based on the topology model, the set of operator fusion management operations includes:
formulating an order of operations for the set of operator fusion management operations.

### Claim 9 (depends on 8)

The method of claim 8, wherein formulating the order of operations for the set of operator fusion management operations includes:
identifying, based on a processing element selection factor in response to identifying a first processing element to target for allocation with a first subset of the set of stream operators, a second processing element to target for allocation with a second subset of the set of stream operators.

### Claim 10 (depends on 1)

The method of claim 1, wherein determining, based on the topology model, the set of operator fusion management operations includes:
identifying, based on a stream operator selection factor, a subset of the set of stream operators to allocate to a target processing element.

### Claim 11 (depends on 1)

The method of claim 1, wherein determining, based on the topology model, the set of operator fusion management operations includes:
computing a first expected performance factor for a first fusion cycle;
computing a second expected performance factor for a second fusion cycle;
comparing the first and second expected performance factors; and
identifying, based on the first expected performance factor exceeding the second expected performance factor, the first fusion cycle.

### Claim 12 (depends on 1)

The method of claim 1, wherein determining, based on the topology model, the set of operator fusion management operations includes:
calculating a number of processing elements to target using a feature which is selected from the group consisting of: a user-input, a processor proportion value, and a source-sink count.

### Claim 13 (depends on 1)

The method of claim 1, wherein determining, based on the topology model, the set of operator fusion management operations includes:
resolving, with respect to an operator fusion action, a target processing element using an element which is selected from the group consisting of: a stream operator balancing criterion to balance a number of stream operators per processing element, a source-sink count to fuse stream operators which are nearer to stream limits, and a new processing element.

### Claim 14 (depends on 1)

The method of claim 1, wherein determining, based on the topology model, the set of operator fusion management operations includes:
ascertaining, with respect to a target processing element, a target stream operator using a component which is selected from the group consisting of: a set of chain criteria which indicates to continue a chain of a subset of the set of stream operators, a set of fusion criteria which indicates a set of target processing element parameters for a candidate stream operator, a number of interconnections between the target processing element and the target stream operator, and achievement of a match-absence threshold which indicates a deficiency of the target stream operator.

### Claim 15 (depends on 1)

The method of claim 1, wherein the establishing, the determining, and the constructing each occur in an automated fashion without user intervention.

### Claim 16 (depends on 1)

The method of claim 1, further comprising:
receiving a stream of tuples to be processed by the set of processing elements operating on a pool of compute hosts; and
processing, using the set of processing elements operating on the pool of compute hosts, the stream of tuples.

### Claim 17

A system for operator fusion management in a stream computing environment, the system comprising:
a memory having a set of computer readable computer instructions, and
a processor for executing the set of computer readable instructions, the set of computer readable instructions including:
establishing a topology model which indicates:
a set of stream operators,
a set of connections between the set of stream operators, and
a set of stream operators attributes for the set of stream operators;
detecting, using the topology model, a familial subset of the set of stream operators which indicates one or more stream operators that have a fusion-related mandate;
building a single processing element that includes the familial subset of the set of stream operators;
determining, based on the topology model, a set of operator fusion management operations to combine the set of stream operators into a set of processing elements; and
constructing, by performing the set of operator fusion management operations, the set of processing elements.

### Claim 18

A computer program product for operator fusion management in a stream computing environment, the computer program product comprising a computer readable storage medium having program instructions embodied therewith, wherein the computer readable storage medium is not a transitory signal per se, the program instructions executable by a processor to cause the processor to perform a method comprising:
establishing a topology model which indicates:
a set of stream operators,
a set of connections between the set of stream operators, and
a set of stream operators attributes for the set of stream operators;
detecting, using the topology model, a familial subset of the set of stream operators which indicates one or more stream operators that have a fusion-related mandate;
building a single processing element that includes the familial subset of the set of stream operators;
determining, based on the topology model, a set of operator fusion management operations to combine the set of stream operators into a set of processing elements; and
constructing, by performing the set of operator fusion management operations, the set of processing elements.

### Claim 19 (depends on 18)

The computer program product of claim 18, wherein at least one of:
the program instructions are stored in the computer readable storage medium in a data processing system, and wherein the program instructions were downloaded over a network from a remote data processing system; or
the program instructions are stored in the computer readable storage medium in a server data processing system, and wherein the program instructions are downloaded over a network to the remote data processing system for use in a second computer readable storage medium with the remote data processing system.
