Method for implementing GPU virtualization and related apparatus, and system

A method for implementing graphics processing unit GPU virtualization, wherein the method is applied to a physical host, wherein the physical host comprises:

• a hardware layer comprising a GPU, a Host running on the hardware layer, and a host operating system, N back-end GPU Domains and M front-end virtual machines VMs that run on the Host, N is a positive integer greater than or equal to 1, M is a positive integer greater than or equal to 1, M is greater than or equal to N, n is a positive integer that is less than or equal to N, m is a positive integer that is less than or equal to M, and the method comprises:
• determining, according to an estimated compression time, an estimated decompression time, an estimated compressed-data transmission time, and an estimated non-compression direct-transmission time that are of the GPU command, to compress to-be-transferred GPU command;
• compressing, by the mth front-end VM, the to-be-transferred GPU command, and transferring the compressed GPU command to the nth back-end GPU Domain;
• determining, by the nth back-end GPU Domain, that the transferred GPU command has been compressed;
• decompressing, by the nth back-end GPU Domain, the compressed GPU command, and processing the decompressed GPU command by using one or more GPUs that are pass-through to the nth back-end GPU Domain, to obtain the corresponding processing result data;
• determining, according to an estimated compression time, an estimated decompression time, an estimated compressed-data transmission time, and an estimated non-compression direct-transmission time that are of the processing result data, to compress the processing result data;
• and
• compressing, by the nth back-end GPU Domain, the processing result data, and transferring the compressed processing result data to the mth front-end VM.

A physical host, wherein the physical host comprises:

• a hardware layer comprising a GPU, a Host running on the hardware layer, and Host OS, N back-end GPU Domains and M front-end virtual machines VMs that run on the Host, wherein there are corresponding front-end and back-end service channels between the N back-end GPU Domains and the M front-end VMs, N is a positive integer greater than or equal to 1, M is a positive integer greater than or equal to 1, M is greater than or equal to N, n is a positive integer that is less than or equal to N, and m is a positive integer that is less than or equal to M, wherein
• the Host OS is configured to, when the mth front-end VM of the M front-end VMs is started, determine, according to the type of the operating system of the started mth front-end VM, the nth back-end GPU Domain having an operating system of a corresponding type, wherein there is an association relationship between the mth front-end VM and the nth back-end GPU Domain:
• and
• based on the association relationship between the mth front-end VM and the nth back-end GPU Domain, transfer communication information of the corresponding nth back-end GPU Domain to the mth front-end VM, and transfer communication information of the corresponding mth front-end VM to the nth back-end GPU Domain, so that the front-end and back-end service channels are established between the mth front-end VM and the nth back-end GPU Domain;
• the mth front-end VM is configured to initiate binding of event channels between the mth front-end VM and the nth back-end GPU Domain based on the shared memory device identifier of the mth front-end VM and the shared memory device identifier of the nth back-end GPU Domain if the communication information is a shared memory device identifier;
• or
• the nth back-end GPU Domain is configured to initiate binding of event channels between the mth front-end VM and the nth back-end GPU Domain based on the shared memory device identifier of the mth front-end VM and the shared memory device identifier of the nth back-end GPU Domain if the communication information is a shared memory device identifier;
• the mth front-end VM is further configured to write the to-be-transferred GPU command to a shared memory between the mth front-end VM and the nth back-end GPU Domain;
• and
• send an mth front-end event notification to the nth back-end GPU Domain through the bound event channels between the mth front-end VM and the nth back-end GPU Domain, wherein the mth front-end event notification is used to represent location information, of the to-be-transferred GPU command, in the shared memory;
• the nth back-end GPU Domain is further configured to read the GPU command from a corresponding address space of the shared memory between the mth front-end VM and the nth back-end GPU Domain according to the received mth front-end event notification;
• and process the read GPU command by using one or more GPUs that are pass-through to the nth back-end GPU Domain, to obtain the corresponding processing result data.

A physical host, wherein the physical host comprises:

• a hardware layer comprising a GPU, a Host running on the hardware layer, and Host OS, N back-end GPU Domains and M front-end virtual machines VMs that run on the Host, wherein there are corresponding front-end and back-end service channels between the N back-end GPU Domains and the M front-end VMs, N is a positive integer greater than or equal to 1, M is a positive integer greater than or equal to 1, M is greater than or equal to N, n is a positive integer that is less than or equal to N, and m is a positive integer that is less than or equal to M, wherein
• the mth front-end VM is further configured to determine, according to an estimated compression time, an estimated decompression time, an estimated compressed-data transmission time, and an estimated non-compression direct-transmission time that are of the GPU command, to compress the GPU command;
• andcompress the to-be-transferred GPU command, and transfer the compressed GPU command to the nth back-end GPU Domain;
• the nth back-end GPU Domain is configured to determine that the transferred GPU command has been compressed;
• and decompress the compressed GPU command, and process the decompressed GPU command by using one or more GPUs that are pass-through to the nth back-end GPU Domain, to obtain the corresponding processing result data.
• the nth back-end GPU Domain is further configured to determine, according to an estimated compression time, an estimated decompression time, an estimated compressed-data transmission time, and an estimated non-compression direct-transmission time that are of the processing result data, to compress the processing result data;
• and
• compress the processing result data, and transfer the compressed processing result data to the mth front-end VM.

A method for implementing graphics processing unit GPU virtualization, wherein the method comprises:

• transferring a GPU command to be transferred by an mth front-end VM, to an nth back-end GPU Domain based on front-end and back-end service channels between the nth back-end GPU Domain of N back-end graphics processing unit domains GPU Domains in a physical host and the mth front-end VM of M front-end virtual machines VMs in the physical host, wherein a type of an operating system of the nth back-end GPU Domain is the same as a type of an operating system of the mth front-end VM, N is a positive integer greater than or equal to 1, M is a positive integer greater than or equal to 1, M is greater than or equal to N, n is a positive integer that is less than or equal to N, and m is a positive integer that is less than or equal to M;
• and
• processing, by using one or more GPUs in the physical host, the GPU command obtained by the nth back-end GPU Domain, to obtain corresponding processing result data;
• wherein the front-end and back-end service channels between the nth back-end GPU Domain of the N back-end GPU Domains and the mth front-end VM of the M front-end VMs are established by using a following method:
• determining, when the mth front-end VM of the M front-end VMs is started, according to the type of the operating system of the started mth front-end VM, the nth back-end GPU Domain having an operating system of a corresponding type, wherein there is an association relationship between the mth front-end VM and the nth back-end GPU Domain;
• and
• based on the association relationship between the mth front-end VM and the nth back-end GPU Domain, transferring communication information of the corresponding nth back-end GPU Domain to the mth front-end VM, and transferring communication information of the corresponding mth front-end VM to the nth back-end GPU Domain, so that the front-end and back-end service channels are established between the mth front-end VM and the nth back-end GPU Domain;
• wherein if the communication information is a shared memory device identifier, the establishing the front-end and back-end service channels between the mth front-end VM and the nth back-end GPU Domain comprises:
• binding event channels between the mth front-end VM and the nth back-end GPU Domain based on the shared memory device identifier of the mth front-end VM and the shared memory device identifier of the nth back-end GPU Domain;
• wherein the transferring a GPU command to be transferred by an mth front-end VM, to an nth back-end GPU Domain based on front-end and back-end service channels between the nth back-end GPU Domain of N back-end GPU Domains and the mth front-end VM of M front-end VMs comprises:
• writing, to a shared memory between the mth front-end VM and the nth back-end GPU Domain, the GPU command to be transferred by the mth front-end VM;
• and
• sending an mth front-end event notification of the mth front-end VM to the nth back-end GPU Domain through the bound event channels between the mth front-end VM and the nth back-end GPU Domain, wherein the mth front-end event notification is used to represent location information, of the to-be-transferred GPU command, in the shared memory;
• and
• the processing, by using one or more GPUs in the physical host, the GPU command obtained by the nth back-end GPU Domain, to obtain corresponding processing result data comprises:
• reading the GPU command from a corresponding address space of the shared memory between the mth front-end VM and the nth back-end GPU Domain according to the mth front-end event notification received by the nth back-end GPU Domain;
• and
• processing the read GPU command by using one or more GPUs in the physical host that are pass-through to the nth back-end GPU Domain, to obtain the corresponding processing result data.

A method for implementing graphics processing unit GPU virtualization, wherein the method comprises:

• transferring a GPU command to be transferred by an mth front-end VM, to an nth back-end GPU Domain based on front-end and back-end service channels between the nth back-end GPU Domain of N back-end graphics processing unit domains GPU Domains in a physical host and the mth front-end VM of M front-end virtual machines VMs in the physical host, wherein a type of an operating system of the nth back-end GPU Domain is the same as a type of an operating system of the mth front-end VM, N is a positive integer greater than or equal to 1, M is a positive integer greater than or equal to 1, M is greater than or equal to N, n is a positive integer that is less than or equal to N, and m is a positive integer that is less than or equal to M;
• and
• processing, by using one or more GPUs in the physical host, the GPU command obtained by the nth back-end GPU Domain, to obtain corresponding processing result data;
• wherein the method further comprises:
• determining, according to an estimated compression time, an estimated decompression time, an estimated compressed-data transmission time, and an estimated non-compression direct-transmission time that are of the GPU command, to compress the GPU command;
• the transferring a GPU command to be transferred by an mth front-end VM, to an nth back-end GPU Domain comprises:
• compressing the GPU command to be transferred by the mth front-end VM, and transferring the compressed GPU command to the nth back-end GPU Domain;
• the method further comprises:
• determining that the GPU command transferred to the nth back-end GPU Domain has been compressed;
• and
• the processing, by using one or more GPUs in the physical host, the GPU command transferred to the nth back-end GPU Domain, to obtain the corresponding processing result data comprises:
• decompressing the compressed GPU command transferred to the nth back-end GPU Domain, and processing the decompressed GPU command by using one or more GPUs in the physical host that are pass-through to the nth back-end GPU Domain, to obtain the corresponding processing result data;
• determining, according to an estimated compression time, an estimated decompression time, an estimated compressed-data transmission time, and an estimated non-compression direct-transmission time that are of the processing result data, to compress the processing result data;
• and
• the transferring the processing result data to be transferred by the nth back-end GPU Domain, to the mth front-end VM comprises:
• compressing the processing result data to be transferred by the nth back-end GPU Domain, and transferring the compressed processing result data to the mth front-end VM.