# US 2023/0042709 A1 · Packet Buffer Spill-Over in Network Devices

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2023/0042709 A1
- Document ID: US20230042709A1
- Status: Published application
- Kind: A1
- Application number: 17/972,000
- Filed: 2022-10-24
- Published: 2023-02-09
- Earliest claimed: 2020-03-18
- Assignees: Marvell Israel (M.I.S.L) Ltd.
- Applicants: Marvell Israel (M.I.S.L) Ltd.
- Inventors: Rami ZEMACH; Itay PELED; Jacob Jul SCHRODER; Zvi SHMILOVICI LEIB; Gideon NAVON
- Web page: https://patentgrep.com/patent/US20230042709A1

## CPC

- H04L 47/122: by diverting traffic away from congested entities
- H04L 47/30: in combination with information about buffer occupancy at either end or at transit nodes
- H04L 47/33: using forward notification
- H04L 47/521: {Static queue service slot or fixed bandwidth allocation}
- H04L 47/722: at the destination endpoint, e.g. reservation of terminal resources or buffer space
- H04L 49/505: Corrective measures
- H04L 49/9078: {using an external memory or storage device}
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)

## Abstract

A packet processor of a network device receives packets ingressing from a plurality of network links via a plurality of network ports of the network device. The packet processor buffers the packets in an internal packet memory in a plurality of queues, including a first queue. In response to the packet processor detecting congestion in the internal packet memory, the packet processor selectively forwards a group of multiple packets in the first queue from the internal packet memory to a first port, among one or more ports coupled to one or more external memories, to transfer the group of multiple packets to a first external memory that is coupled to the first port so that the first queue is stored across the internal packet memory and the first external packet memory.

## Claims

### Claim 1

A network device, comprising:
an internal packet memory;
one or more external packet memories, including a first external packet memory;
one or more ports configured to couple to the one or more external memories, the one or more ports including a first port coupled to the first external packet memory; and
a packet processor coupled to the first port, the packet processor configured to:
buffer packets received by the network device from one or more network links in the internal packet memory in a plurality of queues, including buffering packets in a first queue, among the plurality of queues, and
in response to detecting congestion in the internal packet memory, selectively forward a group of multiple packets in the first queue from the internal packet memory to the first port to transfer the group of multiple packets to the first external memory so that the first queue is stored across the internal packet memory and the first external packet memory.

### Claim 2 (depends on 1)

The network device of claim 1, further comprising:
a plurality of network ports coupled to the packet processor, the plurality of network ports configured to couple to a plurality of network links;
wherein the packet processor is further configured to:
process packets that were received by the network device from the plurality of network links via the plurality of network ports at least to determine one or more network ports via which the packets are to be transmitted from the network device, and
forward packets that were stored in the plurality of queues to network ports, among the plurality of network ports, for transmission of the packets from the network device.

### Claim 3 (depends on 2)

The network device of claim 2, wherein:
the plurality of network ports comprises one or more network port chiplets; and
the first port omits any network port chiplets.

### Claim 4 (depends on 1)

The network device of claim 1, wherein the packet processor is configured to:
buffer the packets in egress queues in the internal packet memory, the egress queues corresponding to network ports via which the packets are to be transmitted by the network device, wherein the first queue is a first egress queue;
detect congestion in the internal packet memory at least by detecting congestion corresponding to the first egress queue; and
forward the group of multiple packets in the first egress queue from the internal packet memory to the first network port in response to detecting congestion corresponding to the first egress queue.

### Claim 5 (depends on 3)

The network device of claim 3, wherein the packet processor is configured to detect congestion corresponding to the first egress queue at least by detecting that a fill level or a length of the first egress queue meets a threshold.

### Claim 6 (depends on 1)

The network device of claim 1, wherein the packet processor is configured to forward the group of multiple packets to the first network port from a middle portion of the first queue while at least a head portion of the first queue remains in the internal packet memory.

### Claim 7 (depends on 6)

The network device of claim 6, wherein the packet processor is further configured to, while the one or more groups of multiple packets from the middle portion of the first queue are stored in the external packet memory, enqueue one or more additional packets in a tail portion of the first queue stored in the internal packet memory.

### Claim 8 (depends on 1)

The network device of claim 1, wherein:
the one or more ports comprises multiple ports;
the external packet memory is a first external packet memory among a plurality of external packet memories coupled to respective ports among the multiple ports; and
the packet processor is further configured to:
select ports from among the second subset of multiple ports to which groups of multiple packets in the plurality of queues in the internal packet memory are to be forwarded to transfer the groups of multiple packets to the plurality of external memories, and
forward the groups of multiple packets to the selected ports among the multiple ports to transfer the groups of multiple packets to the plurality of external memories so that queues among the plurality of queues are stored across the internal packet memory and ones of the external packet memories.

### Claim 9 (depends on 1)

The network device of claim 1, wherein:
the first port is communicatively coupled to the first external memory via a Peripheral Component Interconnect Express (PCIe) interface; and
the first port is configured to transfer the group of multiple packets to the first external memory via the PCIe interface.

### Claim 10 (depends on 1)

The network device of claim 1, wherein the packet processor is further configured to:
receive multiple packets in the first queue from the first external packet memory via the first port; and
store the multiple packets received from the first external packet memory via the first port back in the internal packet memory.

### Claim 11 (depends on 10)

The network device of claim 10, wherein the packet processor is further configured to:
generate a request signal that requests the first external memory to transfer one or more packets in the first queue; and
send the request signal to the first external memory;
wherein the multiple packets received from the first external packet memory via the first network port are transferred by the first external memory in response to the request signal.

### Claim 12 (depends on 11)

The network device of claim 11, wherein the packet processor is configured to:
generate the request signal to indicate a quantity of packets in the first queue that are to be transferred by the first external memory.

### Claim 13

A method for processing packets in a network device, the method comprising:
receiving, at a packet processor of the network device, packets ingressing from a plurality of network links via a plurality of network ports of the network device;
buffering, with the packet processor, the packets in an internal packet memory in a plurality of queues, including buffering packets in a first queue, among the plurality of queues; and
in response to the packet processor detecting congestion in the internal packet memory, selectively forwarding, by the packet processor, a group of multiple packets in the first queue from the internal packet memory to a first port, among one or more ports coupled to one or more external memories, to transfer the group of multiple packets to a first external memory that is coupled to the first port so that the first queue is stored across the internal packet memory and the first external packet memory.

### Claim 14 (depends on 13)

The method for processing packets of claim 13, further comprising:
processing, with the packet processor, the packets at least to determine one or more network ports, among the plurality of network ports, via which the packets are to be transmitted from the network device; and
forwarding, by the packet processor, packets that were stored in the plurality of queues to network ports, among the plurality of network ports, for transmission of the packets from the network device.

### Claim 15 (depends on 13)

The method for processing packets of claim 13, wherein:
buffering the packets in the internal packet memory in the plurality of queues comprises buffering the packets in egress queues in the internal packet memory, the egress queues corresponding to network ports via which the packets are to be transmitted by the network device;
the first queue is a first egress queue;
detecting congestion in the internal packet memory comprises detecting congestion corresponding to the first egress queue; and
forwarding the group of multiple packets in the first egress queue to the first port is in response to detecting congestion corresponding to the first egress queue.

### Claim 16 (depends on 15)

The method for processing packets of claim 15, wherein detecting congestion corresponding to the first egress queue comprises detecting that a fill level or a length of the first egress queue meets a threshold.

### Claim 17 (depends on 13)

The method for processing packets of claim 13, wherein selectively forwarding the group of multiple packets in the first queue from the internal packet memory to the first port comprises forwarding the group of multiple packets to the first port from a middle portion of the first queue while at least a head portion of the first queue remains in the internal packet memory.

### Claim 18 (depends on 17)

The method for processing packets of claim 17, further comprising:
enqueuing, by the packet processor, one or more additional packets in a tail portion of the first queue stored in the internal packet memory while the one or more groups of multiple packets from the middle portion of the first queue are stored in the external packet memory.

### Claim 19 (depends on 13)

The method for processing packets of claim 13, wherein:
the one or more ports comprises multiple ports;
the external packet memory is a first external packet memory among a plurality of external packet memories coupled to respective ports among the multiple ports; and
the method further comprises:
selecting ports from among the multiple ports to which groups of multiple packets in the plurality of queues from the internal packet memory are to be forwarded to transfer the groups of multiple packets to the plurality of external memories, and
forwarding the groups of multiple packets to the selected ports among the multiple ports to transfer the groups of multiple packets to the plurality of external memories so that queues among the plurality of queues are stored across the internal packet memory and ones of the plurality of external packet memories.

### Claim 20 (depends on 13)

The method for processing packets of claim 13, further comprising:
transferring the group of multiple packets to the external memory via a Peripheral Component Interconnect Express (PCIe) interface.

### Claim 21 (depends on 13)

The method for processing packets of claim 13, further comprising:
receiving, at the packet processor, multiple packets in the first queue from the first external packet memory via the first port; and
storing the multiple packets received from the first external packet memory via the first port back in the internal packet memory.

### Claim 22 (depends on 21)

The method for processing packets of claim 21, further comprising:
generating, by the packet processor, a request signal that requests the first external memory to transfer one or more packets in the first queue; and
sending the request signal to the first external memory;
wherein receiving the multiple packets from the first external packet memory via the first network port is in response to the request signal.

### Claim 23 (depends on 22)

The method for processing packets of claim 22, wherein:
generating the request signal comprises generating the request signal to indicate a quantity of packets in the first queue that are to be transferred by the first external memory.
