# US 2019/0245828 A1 · Port address translation scalability in stateful network device clustering

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0245828 A1
- Document ID: US20190245828A1
- Status: Published application
- Kind: A1
- Application number: 15/890,922
- Filed: 2018-02-07
- Published: 2019-08-08
- Earliest claimed: 2018-02-07
- Assignees: Cisco Technology, Inc.
- Applicants: Cisco Technology, Inc.
- Inventors: Andrew E. Ossipov; Kent Leung; Zhijun Liu
- Web page: https://patentgrep.com/patent/US20190245828A1

## CPC

- H04L 61/5061: Pools of addresses
- H04L 41/0816: the condition being an adaptation, e.g. in response to network events
- H04L 61/2514: between local and global IP addresses
- H04L 61/2517: using port numbers
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)

## Abstract

A method is performed by a master network device among network devices of a cluster. The master network device receives cluster configuration information including a set of Internet Protocol (IP) addresses and a pool of port blocks associated with the IP addresses. Each port block includes multiple ports, and the pool of the port blocks is to be shared across and used by the network devices for port address translation on network connections with the network devices. The master network device divides the port blocks in the pool into multiple buckets. The master network device first allocates to each network device in the cluster a corresponding one of the buckets, and reserves each bucket that is not allocated for allocation to a potential new network device. When a new network device joins the cluster, the master network device second allocates to the new network device the port blocks from a corresponding one of the reserved buckets.

## Claims

### Claim 1

A method comprising:
at a master network device among network devices of a cluster:
receiving cluster configuration information including a set of Internet Protocol (IP) addresses and a pool of port blocks associated with the IP addresses, each port block including multiple ports, and the pool of the port blocks to be shared across and used by the network devices for port address translation on network connections with the network devices;
dividing the port blocks in the pool into multiple buckets of the port blocks, each bucket including an initial number of the port blocks;
first allocating to each network device in the cluster a corresponding one of the buckets;
reserving each bucket that is not allocated for allocation to a potential new network device; and
when a new network device joins the cluster, second allocating to the new network device the port blocks from a corresponding one of the reserved buckets.

### Claim 2 (depends on 1)

The method of claim 1, wherein:
the cluster includes N network devices prior to when the new network device joins;
the dividing includes dividing the port blocks in the pool into N+1 buckets, such that each bucket includes the initial number of the port blocks;
the first allocating including allocating all but one of the N+1 buckets to corresponding ones of the N network devices;
the reserving includes reserving the one bucket that is not allocated; and
the second allocating includes allocating to the new network device at least a portion of the port blocks from the reserved bucket.

### Claim 3 (depends on 2)

The method of claim 2, further comprising, when the new network device joins the cluster, resulting in N+1 network devices in the cluster:
computing a new number of the port blocks of the pool to be included in each of N+2 buckets of the port blocks, wherein the new number is less than the initial number,
wherein the second allocating includes allocating to the new network device at least the new number of the port blocks from the reserved bucket.

### Claim 4 (depends on 3)

The method of claim 3, further comprising, when the new network device joins the cluster:
recalling from each of the N network devices that were in the cluster prior to when the new network device joins a portion of the respective bucket of the port blocks previously allocated by the first allocating; and
reserving the respective portions recalled from the N network devices for allocation to a potential new network device.

### Claim 5 (depends on 4)

The method of claim 4, wherein the recalling from each of the N network devices includes recalling from each of the N network devices a number of the port blocks that is equal to a difference between the initial number in each of the N+1 buckets and the new number in each of the N+2 buckets.

### Claim 6 (depends on 4)

The method of claim 4, further comprising:
determining when the recall number of the port blocks have been successfully recalled from each of the N network devices; and
when the recall number of the port blocks have been successfully recalled from each of the N network devices, sending to an administrator function associated with the cluster an indication that there are sufficient port blocks to support a new network device.

### Claim 7 (depends on 3)

The method of claim 3, wherein the second allocating includes allocating to the new network device the initial number of the port blocks from the reserved bucket.

### Claim 8 (depends on 7)

The method of claim 7, further comprising:
recalling from each of the N network devices that were in the cluster prior to when the new network device joins a portion of the port blocks of the respective bucket previously allocated by the first allocating;
recalling from the new network device a portion of the port blocks of the bucket previously allocated by the second allocating; and
reserving the respective portions recalled from the N network devices and the respective portion recalled from the new network device for future allocation to a potential new network device.

### Claim 9 (depends on 8)

The method of claim 8, wherein the recalling from each of the N network devices and the recalling from the new network device each include recalling from each network device a number of the port blocks equal to a difference between the initial number in each of the N+1 buckets and the new number in each of the N+2 buckets.

### Claim 10 (depends on 1)

The method of claim 1, wherein the cluster is provisioned for a maximum of C network devices and a total number of T port blocks in the pool of the port blocks, and the cluster includes N network devices prior to when the new network device joins the cluster, and wherein the dividing includes dividing the port blocks in the pool into C buckets.

### Claim 11 (depends on 1)

The method of claim 1, wherein the dividing includes equally dividing the port blocks in the pool into the multiple buckets of the port blocks, such that the initial number of the port blocks in each bucket is equal across the buckets.

### Claim 12 (depends on 1)

The method of claim 1, further comprising, at a network device among the network devices that is not the master network device and to which the port blocks were allocated in the first allocating, upon receiving from the master network device a deallocation request indicating that a recall number of port blocks are to be returned to the master network device:
returning to the master network device as many of the port blocks that are not being utilized for existing connections as are necessary to satisfy the recall number of the port blocks; and
if the returning did not satisfy the recall number of the port blocks, returning to the master network device as many of the port blocks that are being utilized for existing connections, after the existing connection terminate, as are necessary to satisfy the recall number of port blocks.

### Claim 13 (depends on 12)

The method of claim 12, wherein the returning to the master network device the port blocks that are being utilized further comprises:
determining which of the port blocks that are being utilized have a fewest number of port address translations associated with the existing connections; and
for each port block determined to have the fewest number of port address translations:
not assigning new connections to the port block; and
returning the port block to the master network device when the existing connections associated with the port block have terminated.

### Claim 14

An apparatus comprising:
a network interface including multiple input-output ports configured to communicate with one or more networks; and
a processor of a network device among network devices of a cluster, the processor coupled to the network interface and configured to:
receive cluster configuration information including a set of Internet Protocol (IP) addresses and a pool of port blocks associated with the IP addresses, each port block including multiple ports, and the pool of the port blocks to be shared across and used by the network devices for port address translation on network connections with the network devices;
divide the port blocks in the pool into multiple buckets of the port blocks, each bucket including an initial number of the port blocks;
first allocate to each network device in the cluster a corresponding one of the buckets;
reserve each bucket that is not allocated for allocation to a potential new network device; and
when a new network device joins the cluster, second allocate to the new network device the port blocks from a corresponding one of the reserved buckets.

### Claim 15 (depends on 14)

The apparatus of claim 14, wherein the cluster includes N network devices prior to when the new network device joins, and the processor is configured to:
divide by dividing the port blocks in the pool into N+1 buckets, such that each bucket includes the initial number of the port blocks;
first allocate by allocating all but one of the N+1 buckets to corresponding ones of the N network devices;
reserve by reserving the one bucket that is not allocated; and
second allocate by allocating to the new network device at least a portion of the port blocks from the reserved bucket.

### Claim 16 (depends on 15)

The apparatus of claim 15, wherein the processor is further configured to, when the new network device joins the cluster, resulting in N+1 network devices in the cluster:
compute a new number of the port blocks of the pool to be included in each of N+2 buckets of the port blocks, wherein the new number is less than the initial number,
wherein the processor is configured to second allocate by allocating to the new network device at least the new number of the port blocks from the reserved bucket.

### Claim 17 (depends on 16)

The apparatus of claim 16, wherein the processor is further configured to, when the new network device joins the cluster:
recall from each of the N network devices that were in the cluster prior to when the new network device joins a portion of the respective bucket of the port blocks previously allocated by the first allocating; and
reserve the respective portions recalled from the N network devices for allocation to a potential new network device.

### Claim 18

A non-transitory computer readable medium encoded with instructions that, when executed by a processor of a master network device among network devices of a cluster, cause the processor to perform:
receiving cluster configuration information including a set of Internet Protocol (IP) addresses and a pool of port blocks associated with the IP addresses, each port block including multiple ports, and the pool of the port blocks to be shared across and used by the network devices for port address translation on network connections with the network devices;
dividing the port blocks in the pool into multiple buckets of the port blocks, each bucket including an initial number of the port blocks;
first allocating to each network device in the cluster a corresponding one of the buckets;
reserving each bucket that is not allocated for allocation to a potential new network device; and
when a new network device joins the cluster, second allocating to the new network device the port blocks from a corresponding one of the reserved buckets.

### Claim 19 (depends on 18)

The non-transitory computer readable medium of claim 18, wherein the cluster includes N network devices prior to when the new network device joins, and the instructions include instructions to cause the processor to perform:
the dividing by dividing the port blocks in the pool into N+1 buckets, such that each bucket includes the initial number of the port blocks;
the first allocating by allocating all but one of the N+1 buckets to corresponding ones of the N network devices;
the reserving by reserving the one bucket that is not allocated; and
the second allocating by allocating to the new network device at least a portion of the port blocks from the reserved bucket.

### Claim 20 (depends on 19)

The non-transitory computer readable medium of claim 19, further comprising instructions to cause the processor to perform, when the new network device joins the cluster, resulting in N+1 network devices in the cluster:
computing a new number of the port blocks of the pool to be included in each of N+2 buckets of the port blocks, wherein the new number is less than the initial number,
wherein the instructions to cause the processor to perform the second allocating include instructions to cause the processor to perform allocating to the new network device at least the new number of the port blocks from the reserved bucket.
