# US 2018/0024855 A1 · Live migration of virtual machines from/to host computers with graphics processors

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2018/0024855 A1
- Document ID: US20180024855A1
- Status: Published application
- Kind: A1
- Application number: 15/633,497
- Filed: 2017-06-26
- Published: 2018-01-25
- Earliest claimed: 2015-09-15
- Assignees: Intel Corporation
- Applicants: Intel Corporation
- Inventors: Yao Zu DONG; Zhiyuan LV
- Web page: https://patentgrep.com/patent/US20180024855A1

## CPC

- G06F 9/45558: {Hypervisor-specific management and integration aspects}
- G06F 9/445: Program loading or initiating (bootstrapping G06F9/4401; security arrangements for program loading or initiating G06F21/57)
- G06F 9/4856: {resumption being on a different machine, e.g. task migration, virtual machine migration (G06F9/5088 takes precedence)}
- G06F 9/50: Allocation of resources, e.g. of the central processing unit [CPU]
- G06F 9/5077: {Logical partitioning of resources; Management or configuration of virtualized resources (specific details on emulation or internal functioning of virtual machines G06F9/455)}
- G06T 1/20: Processor architectures; Processor configuration, e.g. pipelining
- G06F 2009/4557: {Distribution of virtual machine instances; Migration and load balancing}
- G06F 2009/45583: {Memory management, e.g. access or allocation}
- G06F 2209/501: Performance criteria
- G06T 2200/28: involving image processing hardware
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

Apparatuses, methods and storage medium associated with live migration of VMs from/to host computers with graphics virtualization are disclosed herein. In embodiments, an apparatus may include a VMM having a memory manager to manage accesses of system memory of the apparatus, including tracking of modified memory pages of the system memory. Additionally, the VMM may include a graphics command parser to analyze graphics commands issued to a GPU of the apparatus to detect writes to the system memory caused by the graphics commands, and augment the tracking of modified memory pages. Further, the VMM may include a live migration function to live migrate a VM to another apparatus, including provision of current memory content of the VM, utilizing modified memory pages tracked by the memory manager, as augmented by the graphics command parser. Other embodiments may be described and/or claimed.

## Claims

### Claim 1

An apparatus for computing, comprising:
one or more general purpose processors;
a graphics processing unit;
system memory coupled with the one or more general purpose processors and the graphics processing unit; and
a virtual machine monitor to manage virtual machines hosted by the one or more general purpose processors, wherein the virtual machine monitor includes:
a memory manager to manage accesses of the system memory by instructions of applications of the virtual machines, to be executed by the one or more general purpose processors, wherein management of accesses includes tracking of modified memory pages of the system memory; and
a graphics command parser to analyze graphics commands issued to the graphics processing unit by the applications to detect writes to the system memory caused by the graphics commands, and augment the tracking of modified memory pages by the memory manager.

### Claim 2 (depends on 1)

The apparatus of claim 1, wherein the virtual machine monitor further includes a live migration function to selectively live migrate one or more of the virtual machines to another apparatus for computing, including provision of current memory content of a virtual machine being live migrated to the other apparatus, utilizing modified memory pages tracked by the memory manager, as augmented by the graphics command parser.

### Claim 3 (depends on 1)

The apparatus of claim 1, wherein the graphics command parser is to obtain guest graphics memory address of a write to system memory, on detection of the write to system memory.

### Claim 4 (depends on 3)

The apparatus of claim 3, wherein the graphics command parser is to further calculate host graphics memory address of the write to system memory, based at least in part on the guest graphics memory address obtained for the write to system memory.

### Claim 5 (depends on 4)

The apparatus of claim 4, wherein the graphics command parser is to further obtain system memory address of the write to system memory, based at least in part on the host graphics memory address calculated for the write to system memory.

### Claim 6 (depends on 5)

The apparatus of claim 5, wherein the graphics command parser is to further mark one of the memory pages comprising the system memory address as dirty.

### Claim 7 (depends on 1)

The apparatus of claim 1, wherein the graphics command parser is to further determine whether a first of the graphics commands can be modified to a form supported by the graphics processing unit or replace with a functional equivalent graphics command supported by the graphics processing unit, on determination that the first graphics command is not supported by the graphics processing unit.

### Claim 8 (depends on 7)

The apparatus of claim 7, wherein the graphics command parser is to further modify the first graphics command to a form supported by the graphics processing unit on determination that the first graphics command can be modified to a form supported by the graphics processing unit, or replace the first graphics command with the other functional equivalent graphics command supported by the graphics processing unit, on determination of existence of the other functional equivalent graphics command.

### Claim 9 (depends on 1)

The apparatus of claim 1 further comprising a graphics proxy library to be instantiated in at least a first of the virtual machines, wherein the graphics proxy library is to maintain a context of a graphics application programming interface that abstracts the graphics processing unit for the first virtual machine.

### Claim 10

An apparatus for computing, comprising:
one or more general purpose processors;
a graphics processing unit;
system memory coupled with the one or more general purpose processors and the graphics processing unit; and
a virtual machine monitor to manage virtual machines hosted by the one or more general purpose processors, wherein the virtual machine monitor includes:
a memory manager to manage accesses of the system memory by instructions of applications of the virtual machines, executed by the one or more general purpose processors; and
a graphics command parser to analyze graphics commands issued to the graphics processing unit by the applications to determine whether the graphics commands are supported by the graphics processing unit.

### Claim 11 (depends on 10)

The apparatus of claim 10, wherein the graphics command parser is to further determine whether a first of the graphics commands can be modified to a form supported by the graphics processing unit or replaced with a functional equivalent graphics command supported by the graphics processing unit, on determination that the first graphics command is not supported by the graphics processing unit.

### Claim 12 (depends on 11)

The apparatus of claim 11, wherein the graphics command parser is to further modify the first graphics command to a form supported by the graphics processing unit on determination that the first graphics command can be modified to a form supported by the graphics processing unit, or replace the first graphics command with the other functional equivalent graphics command supported by the graphics processing unit, on determination of existence of the other functional equivalent graphics command.

### Claim 13 (depends on 10)

The apparatus of claim 10 further comprising a graphics proxy library to be instantiated in at least a first of the virtual machines, wherein the graphics proxy library is to maintain a context of a graphics application programming interface that abstracts the graphics processing unit for the first virtual machine.

### Claim 14

An apparatus for computing, comprising:
one or more general purpose processors;
a graphics processing unit;
system memory coupled with the one or more general purpose processors and the graphics processing unit;
a virtual machine monitor to manage virtual machines hosted by the one or more general purpose processors; and
a graphics proxy library to be instantiated in at least a first of the virtual machines, wherein the graphics proxy library is to maintain a context of a graphics application programming interface that abstracts the graphics processing unit for the first virtual machine.

### Claim 15 (depends on 14)

The apparatus of claim 14, wherein the graphics proxy library is to further detect whether the context maintained is for a different graphics processing unit abstracted by the graphics application programming interface.

### Claim 16 (depends on 15)

The apparatus of claim 15, wherein the graphics proxy library is to construct the context of the graphics application programming interface, on detection that the context is maintained for a different graphics processing unit being abstracted by the graphics application programming interface, using a context maintained by the graphics proxy library for the different graphics processing unit abstracted by the graphics application programming interface prior to the first virtual machine having been live migrated from the other apparatus for computing.

### Claim 17

A method for computing, comprising:
analyzing, by a graphics command parser of a computing system, graphics commands issued to a graphics processing unit of the computing system by applications of virtual machines of the computing system;
detecting, by the graphics command parser, writes to system memory of the computing system, caused by the graphics commands; and
on detection of writes to system memory, augmenting, by the graphics command parser, modified memory pages tracking by a memory manager of a virtual machine monitor of the computing system.

### Claim 18 (depends on 17)

The method of claim 17, further comprising live migrating one or more of the virtual machines to another computing system, including provision of current memory content of a virtual machine being live migrated to the other computing system, utilizing modified memory pages tracked by the memory manager, as augmented by the graphics command parser.

### Claim 19 (depends on 17)

The method of claim 17, further comprising determining, by the graphics command parser, whether a first of the graphics commands can be modified to a form supported by the graphics processing unit or replace with a functional equivalent graphics command supported by the graphics processing unit, on determination that the first graphics command is not supported by the graphics processing unit.

### Claim 20 (depends on 19)

The method of claim 19, further comprising modifying, by the graphics command parser, the first graphics command to a form supported by the graphics processing unit on determination that the first graphics command can be modified to a form supported by the graphics processing unit, or replacing the first graphics command with the other functional equivalent graphics command supported by the graphics processing unit, on determination of existence of the other functional equivalent graphics command.
