# US 2023/0018548 A1 · High throughput ingress datapath for a virtual machine

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2023/0018548 A1
- Document ID: US20230018548A1
- Status: Published application
- Kind: A1
- Application number: 17/860,040
- Filed: 2022-07-07
- Published: 2023-01-19
- Earliest claimed: 2021-07-13
- Assignees: VMware, Inc.
- Applicants: VMware, Inc.
- Inventors: Peng Li; Ronak Doshi; Guolin Yang; Boon S. Ang
- Web page: https://patentgrep.com/patent/US20230018548A1

## CPC

- G06F 9/45558: {Hypervisor-specific management and integration aspects}
- H04L 47/11: Identifying congestion
- H04L 49/9031: {Wraparound memory, e.g. overrun or underrun detection}
- G06F 2009/45583: {Memory management, e.g. access or allocation}
- G06F 2009/45595: {Network integration; Enabling network access in virtual machine instances}
- H04L 47/6245: {Modifications to standard FIFO or LIFO}
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)

## Abstract

Some embodiments provide a method of forwarding data messages to a machine that executes on a host computer and has an associated virtual network interface controller (VNIC) also executing on the host computer. The method retrieves data messages from a queue associated with the VNIC and stores these data messages in a first set of buffer data stores associated with the VNIC. When the first buffer set reaches a threshold congestion level, the method stores data messages subsequently retrieved from the VNIC queue in a second set of buffer data stores associated with the VNIC. In some embodiments, a set of one or more processes executing on the machine retrieves the data messages stored in the buffer sets for processing by these processes or other processes.

## Claims

### Claim 1

A method of forwarding data messages to a machine executing on a host computer, the machine having an associated virtual network interface controller (VNIC), the method comprising:
storing, in a first set of buffer data stores associated with the VNIC, a first plurality of data messages retrieved from a queue of the VNIC associated with the machine;
after the first set of buffer data stores reaches a threshold congestion level, storing, in a second set of buffer data stores associated with the VNIC, a second plurality of data messages retrieved from the VNIC queue,
wherein a set of one or more processes executing on the machine retrieves the data messages from the first and second sets of buffer data stores.

### Claim 2 (depends on 1)

The method of claim 1, wherein:
when the first plurality of data messages is stored in the first set of buffer data stores, the buffer data stores of the first set are designated as active buffer data stores and the buffer data stores of the second set are designated as standby buffer data stores, and
when the second plurality of data messages is stored in the second set of buffer data stores, the buffer data stores of the second set are designated as active buffer data stores and the buffer data stores of the first set are designated as standby buffer data stores.

### Claim 3 (depends on 2)

The method of claim 2, wherein each set of buffer data stores is implemented by a ring of storage elements.

### Claim 4 (depends on 3)

The method of claim 3, wherein each set of buffer data stores are receiving (Rx) buffer data stores.

### Claim 5 (depends on 3)

The method of claim 3, wherein each ring in the ring of storage elements comprises a sequence of locations in a memory to which data messages are sequentially stored with a first storage location in the sequence being a next storage location after each data message is stored in the last location.

### Claim 6 (depends on 5)

The method of claim 5, wherein the memory is one of a volatile memory or a non-volatile storage.

### Claim 7 (depends on 2)

The method of claim 2, wherein the threshold congestion level is a first threshold congestion level, the method further comprising:
after the second set of buffer data stores reaches a second threshold congestion level, storing, in the first set of buffer data stores associated with the VNIC, a third plurality of data messages retrieved from the VNIC queue,
wherein the buffer data stores of the second set are now designated as standby buffer data stores and the buffer data stores of the first set are now designated as active buffer data stores.

### Claim 8 (depends on 7)

The method of claim 7, wherein the first threshold congestion level and the second threshold congestion level are the same levels of congestion.

### Claim 9 (depends on 7)

The method of claim 7, wherein the first threshold congestion level and the second threshold congestion level are different levels of congestion.

### Claim 10 (depends on 1)

The method of claim 1, wherein the queue is a first queue and the threshold congestion level is a first threshold congestion level, the method further comprising:
storing, in a third set of buffer data stores associated with the VNIC, a third plurality of data messages retrieved from a second queue of the VNIC associated with the machine;
after the third set of buffer data stores reaches a second threshold congestion level, storing, in a fourth set of buffer data stores associated with the VNIC, a fourth plurality of data messages retrieved from the second VNIC queue,
wherein the set of one or more processes executing on the machine retrieves the data messages from the third and fourth sets of buffer data stores.

### Claim 11 (depends on 1)

The method of claim 1, wherein the queue is a first queue and the third and fourth sets of data buffer data stores are associated with a second VNIC queue.

### Claim 12 (depends on 1)

The method of claim 1, wherein the threshold congestion level is a maximum capacity of storage of the first set of buffer data stores.

### Claim 13 (depends on 1)

The method of claim 1, wherein the first and second pluralities of data messages are retrieved from a port of a software switch external to the machine.

### Claim 14

A non-transitory machine readable medium storing a program for execution by a set of at least one processing units, the program for forwarding data messages to a machine executing on a host computer, the machine having an associated virtual network interface controller (VNIC), the program comprising sets of instructions for:
storing, in a first set of buffer data stores associated with the VNIC, a first plurality of data messages retrieved from a queue of the VNIC associated with the machine;
after the first set of buffer data stores reaches a threshold congestion level, storing, in a second set of buffer data stores associated with the VNIC, a second plurality of data messages retrieved from the VNIC queue,
wherein a set of one or more processes executing on the machine retrieves the data messages from the first and second sets of buffer data stores.

### Claim 15 (depends on 14)

The non-transitory machine readable medium of claim 14, wherein:
when the first plurality of data messages is stored in the first set of buffer data stores, the buffer data stores of the first set are designated as active buffer data stores and the buffer data stores of the second set are designated as standby buffer data stores, and
when the second plurality of data messages is stored in the second set of buffer data stores, the buffer data stores of the second set are designated as active buffer data stores and the buffer data stores of the first set are designated as standby buffer data stores.

### Claim 16 (depends on 14)

The non-transitory machine readable medium of claim 14, wherein the set of one or more processes comprises a set of one or more applications to process the first and second pluralities of data messages.

### Claim 17 (depends on 15)

The non-transitory machine readable medium of claim 15, wherein the sets of buffer data stores are designated as active or standby by a set of instructions for maintaining a data store.

### Claim 18 (depends on 17)

The non-transitory machine readable medium of claim 17, wherein storing the data messages retrieved from the VNIC queue and maintaining the data store are performed by different modules of a single program.

### Claim 19 (depends on 14)

The non-transitory machine readable medium of claim 14, wherein the first and second sets of buffer data stores use First In, First Out (FIFO) logic.

### Claim 20 (depends on 14)

The non-transitory machine readable medium of claim 14, wherein a first maximum capacity of storage of the first set of buffer data stores and a second maximum capacity of storage of the second set of buffer data stores are small.
