Server delay control system, server delay control device, server delay control method, and program

A server delay control system for performing, on a server including a Host OS, packet transfer between an application and a physical NIC connected to the Host OS, the server implemented using a computer comprising one or more hardware processors, the application deployed in a user space that can be used by a user,

• wherein a server delay control device implemented using one or more of the one or more hardware processors and configured to perform polling for packet transfer on behalf of the application is deployed in the user space,
• wherein the server delay control device is further configured to create, between the application and the physical NIC, a communication path for communication via socket communication, the communication path comprising a first queue and a second queue,
• wherein the server delay control device comprises:
• a packet dequeuer configured to perform polling whether a packet has been enqueued into the first queue and to perform dequeuing the enqueued packet from the first queue;
• a converter configured to perform conversion of the packet dequeued from the first queue into a structure for managing a packet, and
• a packet enqueuer configured to perform enqueuing the dequeued packet on which the conversion has been performed by the converter into the second queue,
• wherein the packet dequeuer, the converter, and the packet enqueuer are configured such that the polling and the dequeuing by the packet dequeuer, the conversion by the converter, and the enqueuing by the packet enqueuer are performed in a single context without causing a context switch,
• wherein the Host OS is configured such that a virtual machine and an external process created outside the virtual machine operate on the Host OS,
• wherein the server further comprises a Guest OS configured to operate in the virtual machine,
• wherein the Guest OS comprises:
• a kernel;
• and
• a Socket, which is an interface for the kernel to perform inter-process communication,
• wherein the kernel comprises a TAP device, which is a virtual interface created by the kernel,
• wherein the first queue is a first reception queue configured to hold a reception packet arrived at the server, the reception packet stored in a structure for the server delay control device to manage a packet and enqueued into the first reception queue,
• wherein the second queue is a reception queue of the TAP device,
• wherein the packet dequeuer is configured to perform polling whether the reception packet has been enqueued into the first reception queue and to perform dequeuing the reception packet from the first reception queue,
• wherein the converter is configured to perform conversion of the reception packet dequeued from the first reception queue into a structure for the kernel to manage a packet,
• wherein the packet enqueuer is configured to perform enqueuing the reception packet on which the conversion has been performed by the converter into the reception queue of the tap device,
• wherein the kernel is configured to transfer the converted reception packet enqueued into the reception queue of the TAP device to the application via the Socket, and
• wherein the packet dequeuer, the converter, the packet enqueuer, and the kernel are configured such that the polling and the dequeuing by the packet dequeuer, the conversion by the converter, the enqueuing by the packet enqueuer, and the transfer by the kernel are performed in the single context without causing a context switch.

A server delay control system for performing, on a server including a Host OS, packet transfer between an application and a physical NIC connected to the Host OS, the server implemented using a computer comprising one or more hardware processors, the application deployed in a user space that can be used by a user,

• wherein a server delay control device implemented using one or more of the one or more hardware processors and configured to perform polling for packet transfer on behalf of the application is deployed in the user space,
• wherein the server delay control device is further configured to create, between the application and the physical NIC, a communication path for communication via socket communication, the communication path comprising a first queue and a second queue,
• wherein the server delay control device comprises:
• a packet dequeuer configured to perform polling whether a packet has been enqueued into the first queue and to perform dequeuing the enqueued packet from the first queue;
• a converter configured to perform conversion of the packet dequeued from the first queue into a structure for managing a packet, and
• a packet enqueuer configured to perform enqueuing the dequeued packet on which the conversion has been performed by the converter into the second queue,
• wherein the packet dequeuer, the converter, and the packet enqueuer are configured such that the polling and the dequeuing by the packet dequeuer, the conversion by the converter, and the enqueuing by the packet enqueuer are performed in a single context without causing a context switch,
• wherein the Host OS is configured such that a virtual machine and an external process created outside the virtual machine operate on the Host OS,
• wherein the server further comprises a Guest OS configured to operate in the virtual machine,
• wherein the Guest OS comprises:
• a kernel;
• and
• a Socket, which is an interface for the kernel to perform inter-process communication,
• wherein the kernel comprises a TAP device, which is a virtual interface created by the kernel,
• wherein the first queue is a first transmission queue of the tap device, the first transmission queue configured to hold a transmission packet received by the kernel via the Socket, the transmission packet stored in a structure for the kernel to manage a packet and enqueued into the first transmission queue,
• wherein the second queue is a second transmission queue configured to hold a packet to be transmitted to an outside of the Guest OS,
• wherein the packet dequeuer is configured to perform polling whether the transmission packet has been enqueued into the first transmission queue and to perform dequeuing the transmission packet from the first transmission queue,
• wherein the converter is configured to perform conversion of the transmission packet dequeued from the first transmission queue into a structure for the server delay control device to manage a packet,
• wherein the packet enqueuer is configured to perform enqueuing the transmission packet on which the conversion has been performed by the converter into the second transmission queue, and
• wherein the packet dequeuer, the converter, and the packet enqueuer are configured such that the polling and the dequeuing by the packet dequeuer, the conversion by the converter, and the enqueuing by the packet enqueuer are performed in the single context without causing a context switch.

A server delay control system for performing, on a server including a Host OS, packet transfer between an application and a physical NIC connected to the Host OS, the server implemented using a computer comprising one or more hardware processors, the application deployed in a user space that can be used by a user,

• wherein a server delay control device implemented using one or more of the one or more hardware processors and configured to perform polling for packet transfer on behalf of the application is deployed in the user space,
• wherein the server delay control device is further configured to create, between the application and the physical NIC, a communication path for communication via socket communication, the communication path comprising a first queue and a second queue,
• wherein the server delay control device comprises:
• a packet dequeuer configured to perform polling whether a packet has been enqueued into the first queue and to perform dequeuing the enqueued packet from the first queue;
• a converter configured to perform conversion of the packet dequeued from the first queue into a structure for managing a packet, and
• a packet enqueuer configured to perform enqueuing the dequeued packet on which the conversion has been performed by the converter into the second queue,
• wherein the packet dequeuer, the converter, and the packet enqueuer are configured such that the polling and the dequeuing by the packet dequeuer, the conversion by the converter, and the enqueuing by the packet enqueuer are performed in a single context without causing a context switch,
• wherein the Host OS is configured such that a virtual machine and an external process created outside the virtual machine operate on the Host OS,
• wherein the server further comprises a Guest OS configured to operate in the virtual machine,
• wherein the Guest OS comprises:
• a kernel, and
• a Socket, which is an interface for the kernel to perform inter-process communication,
• wherein the kernel comprises:
• a protocol processor configured to perform protocol processing, and
• a TAP device, which is a virtual interface created by the kernel,
• wherein the first queue comprises:
• a first transmission queue of the TAP device;
• and a first reception queue configured to hold a reception packet arrived at the server, the reception packet enqueued into the first reception queue,
• wherein the second queue comprises:
• a reception queue of the TAP device and a second transmission queue configured to hold a packet to be transmitted to an outside of the Guest OS,
• wherein the packet dequeuer is configured to perform polling whether the reception packet has been enqueued into the first reception queue and to perform dequeuing the reception packet from the first reception queue,
• wherein the converter is configured to perform first conversion of the reception packet dequeued from the first reception queue into a structure for the kernel to manage a packet,
• wherein the packet enqueuer is configured to perform enqueuing the dequeued reception packet on which the first conversion has been performed by the converter into the reception queue of the tap device,
• wherein the protocol processor is configured to perform the protocol processing on the reception packet enqueued into the reception queue of the TAP device without causing a software interrupt,
• wherein the kernel is configured to transfer the reception packet subjected to the protocol processing to the application via the Socket,
• wherein the packet dequeuer, the converter, the packet enqueuer, the protocol processor, and the kernel are configured such that the polling and the dequeuing performed on the reception packet by the packet dequeuer, the first conversion performed by the converter, the enqueuing performed on the reception packet by the packet enqueuer, the protocol processing performed on the reception packet by the protocol processor, and the transfer of the reception packet by the kernel are performed in a first single context without causing a context switch,
• wherein the protocol processor is configured to perform the protocol processing, in a second single context without causing a software interrupt, on a transmission packet received via the Socket from the application,
• wherein the kernel is configured to enqueue the transmission packet subjected to the protocol processing into the first transmission queue of the TAP device,
• wherein the packet dequeuer is configured to perform polling whether the transmission packet has been enqueued into the first transmission queue of the TAP device and to perform dequeuing the transmission packet from the first transmission queue of the TAP device, and
• wherein the converter is configured to perform second conversion of the transmission packet dequeued from the first transmission queue into a structure for the server delay control device to manage a packet,
• wherein the packet enqueuer is configured to enqueue the dequeued transmission packet on which the second conversion has been performed by the converter into the second transmission queue,
• wherein the packet dequeuer, the converter, and the packet enqueuer are configured such that the polling and the dequeuing performed on the transmission packet by the packet dequeuer, the second conversion performed by the converter, and the enqueuing performed on the transmission packet by the packet enqueuer are performed in a third single context without causing a context switch.

A server delay control device deployed on a server including a Host OS, a kernel, and a Socket, which is an interface for the kernel to perform inter-process communication via socket communication, the server implemented using a computer comprising one or more hardware processors, the server delay control device implemented using one or more of the one or more hardware processors and deployed in a user space that can be used by a user,

• wherein the server delay control device is configured to create, between the user space and a physical NIC connected to the Host OS, a communication path for communication via the socket communication, the communication path comprising a first queue and a second queue,
• wherein the server delay control device comprises:
• a packet dequeuer configured to perform polling whether a packet has been enqueued into the first queue and to perform dequeuing the enqueued packet from the first queue;
• a converter configured to perform conversion of the packet dequeued from the first queue into a structure for the kernel to manage a packet to be transferred via the Socket to the user space in a single context without causing a context switch, and
• a packet enqueuer configured to enqueue the dequeued packet on which the conversion has been performed by the converter into the second queue, and
• wherein the packet dequeuer, the converter, and the packet enqueuer are configured such that the polling and the dequeuing by the packet dequeuer, the conversion by the converter, and the enqueuing by the packet enqueuer are performed in the single context without causing a context switch.

A server delay control method for a server delay control device deployed on a server including a Host OS, a kernel, and a Socket, which is an interface for the kernel to perform inter-process communication via socket communication, the server implemented using a computer comprising one or more hardware processors, the server delay control device implemented using one or more of the one or more hardware processors and deployed in a user space that can be used by a user, the server delay control device configured to create, between the user space and a physical NIC connected to the Host OS, a communication path for communication via the socket communication, the communication path comprising a first queue and a second queue,

• the server delay control method comprising steps of:
• performing polling whether a packet has been enqueued into the first queue and performing dequeuing the enqueued packet from the first queue;
• performing conversion of the packet dequeued from the first queue into a structure for the kernel to manage a packet to be transferred via the Socket to the user space in a single context without causing a context switch;
• and
• enqueuing the dequeued packet on which the conversion has been performed into the second queue,
• wherein the polling, the dequeuing, the conversion, and the enqueuing are performed in the single context without causing a context switch.

A non-transitory computer-readable medium storing a computer program for a computer serving as, on a server including a Host OS, a kernel, and a Socket, which is an interface for the kernel to perform inter-process communication via socket communication, a server delay control device deployed in a user space that can be used by a user, the computer comprising one or more hardware processors, the server delay control device implemented using one or more of the one or more hardware processors, the server delay control device configured to create, between the user space and a physical NIC connected to the Host OS, a communication path for communication via the socket communication, the communication path comprising a first queue and a second queue,

• the computer program causing the server delay control device to execute steps of:
• performing polling whether a packet has been enqueued into the first queue and performing dequeuing the enqueued packet from the first queue;
• performing conversion of the packet dequeued from the first queue into a structure for the kernel to manage a packet to be transferred via the Socket to the user space in a single context without causing a context switch;
• and
• enqueuing the dequeued packet on which the conversion has been performed into the second queue,
• wherein the server delay control device is configured such that the polling, the dequeuing, the conversion, and the enqueuing are performed in the single context without causing a context switch.