# US 2016/0253201 A1 · Saving and Restoring State Information for Virtualized Computer Systems

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2016/0253201 A1
- Document ID: US20160253201A1
- Status: Published application
- Kind: A1
- Application number: 15/148,890
- Filed: 2016-05-06
- Published: 2016-09-01
- Earliest claimed: 2008-09-12
- Assignees: VMware, Inc.
- Applicants: VMware, Inc.
- Inventors: Irene Zhang; Kenneth Charles Barr; Ganesh Venkitachalam; Irfan Ahmad; Alex Garthwaite; Jesse Pool
- Web page: https://patentgrep.com/patent/US20160253201A1

## CPC

- G06F 9/45558: {Hypervisor-specific management and integration aspects}
- G06F 9/461: {Saving or restoring of program or task context}
- G06F 9/485: {Task life-cycle, e.g. stopping, restarting, resuming execution (G06F9/4881 takes precedence)}
- G06F 9/5016: {the resource being the memory}
- G06F 11/1438: {Restarting or rejuvenating}
- G06F 12/08: in hierarchically structured memory systems, e.g. virtual memory systems
- G06F 2009/45575: {Starting, stopping, suspending or resuming virtual machine instances}
- G06F 2009/45583: {Memory management, e.g. access or allocation}
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

Methods and apparatus for saving and/or restoring state information for virtualized computing systems are described. An example apparatus includes a physical memory and a virtual machine monitor to: in response to a request to suspend operation of a virtual machine, place a trace on a memory page in the physical memory to detect at least one of a read access or a write access that occurs when state information of the virtual machine is saved in response to the request, the memory page associated with virtual memory hosted by the virtual machine, while the virtual machine continues to operate after the request, initiate storing of the virtual memory of the virtual machine, and in response to a trigger of the trace, store an indication that the memory page is an active memory page.

## Claims

### Claim 1

A apparatus comprising:
a physical memory;
a virtual machine monitor to:
in response to a request to suspend operation of a virtual machine, place a trace on a memory page in the physical memory to detect at least one of a read access or a write access that occurs when state information of the virtual machine is saved in response to the request, the memory page associated with virtual memory hosted by the virtual machine;
while the virtual machine continues to operate after the request, initiate storing of the virtual memory of the virtual machine; and
in response to a trigger of the trace, store an indication that the memory page is an active memory page.

### Claim 2 (depends on 1)

An apparatus as defined in claim 1, wherein the virtual machine monitor is further to, in response to a request to resume operation of the virtual machine, load the memory page that is identified as active into the physical memory prior to loading memory pages not identified as active.

### Claim 3 (depends on 2)

An apparatus as defined in claim 2, wherein the virtual machine monitor is further to, after loading the memory page that is identified as active and prior to loading the memory pages not identified as active, resume operation of the virtual machine.

### Claim 4 (depends on 2)

An apparatus as defined in claim 2, wherein the virtual machine monitor is further to, in response to the request to resume operation:
restore access to a virtual disk for the virtual machine;
restore a device state for the virtual machine; and
after the memory page identified as active is loaded, load the memory pages not identified as active into the physical memory.

### Claim 5 (depends on 1)

An apparatus as defined in claim 1, wherein the trace is an access bit in a page table for virtual memory of the virtual machine.

### Claim 6 (depends on 1)

An apparatus as defined in claim 1, wherein the virtual machine monitor is further to, in response to the request to suspend operation of the virtual machine, suspend operation of the virtual machine after the virtual memory is stored.

### Claim 7

A computer readable storage disk or storage device comprising instructions that, when executed, cause a machine to:
in response to a request to suspend operation of a virtual machine, place a trace on a memory page in a physical memory to detect at least one of a read access or a write access that occurs when state information of the virtual machine is saved in response to the request, the memory page associated with virtual memory hosted by the virtual machine;
while the virtual machine continues to operate, initiate storing of the virtual memory of the virtual machine; and
in response to a trigger of the trace, store an indication that the memory page is an active memory page.

### Claim 8 (depends on 7)

A computer readable storage disk or storage device as defined in claim 7, wherein the instructions, when executed, cause the machine to, in response to a request to resume operation of the virtual machine, load the memory page that is identified as active into the physical memory prior to loading memory pages not identified as active.

### Claim 9 (depends on 8)

A computer readable storage disk or storage device as defined in claim 8, wherein the instructions, when executed, cause the machine to, after loading the memory page that is identified as active and prior to loading the memory pages not identified as active, resume operation of the virtual machine.

### Claim 10 (depends on 8)

A computer readable storage disk or storage device as defined in claim 8, wherein the instructions, when executed, cause the machine to, in response to the request to resume operation:
restore access to a virtual disk for the virtual machine;
restore a device state for the virtual machine; and
after the memory page identified as active is loaded, load the memory pages not identified as active into the physical memory.

### Claim 11 (depends on 7)

A computer readable storage disk or storage device as defined in claim 7, wherein the trace is an access bit in a page table for virtual memory of the virtual machine.

### Claim 12 (depends on 11)

A computer readable storage disk or storage device as defined in claim 11, wherein the instructions, when executed, cause the machine to:
in response to the request to suspend operation of the virtual machine, clear the access bit; and
detect a trigger of the trace when the virtual machine accesses the memory page causing a change to the access bit.

### Claim 13 (depends on 7)

A computer readable storage disk or storage device as defined in claim 7, wherein the instructions, when executed, cause the machine to, in response to the request to suspend operation of the virtual machine, suspend operation of the virtual machine after the virtual memory is stored.

### Claim 14

A method comprising:
in response to a request to suspend operation of a virtual machine, placing, by executing instructions with a processor, a trace on a memory page in a physical memory to detect at least one of a read access or a write access that occurs when state information of the virtual machine is saved in response to the request, the memory page associated with virtual memory hosted by the virtual machine;
while the virtual machine continues to operate, initiating storing of the virtual memory of the virtual machine; and
in response to a trigger of the trace, storing an indication that the memory page is an active memory page.

### Claim 15 (depends on 14)

A method as defined in claim 14, further including, in response to a request to resume operation of the virtual machine, loading the memory page that is identified as active into the physical memory prior to loading memory pages not identified as active.

### Claim 16 (depends on 15)

A method as defined in claim 15, further including, after loading the memory page that is identified as active and prior to loading the memory pages not identified as active, resuming operation of the virtual machine.

### Claim 17 (depends on 15)

A method as defined in claim 15, further including, in response to the request to resume operation:
restoring access to a virtual disk for the virtual machine;
restoring a device state for the virtual machine; and
after the memory page identified as active is loaded, loading the memory pages not identified as active into the physical memory.

### Claim 18 (depends on 14)

A method as defined in claim 14, wherein the trace is an access bit in a page table for virtual memory of the virtual machine.

### Claim 19 (depends on 18)

A method as defined in claim 18, further including:
in response to the request to suspend operation of the virtual machine, clearing the access bit; and
detecting a trigger of the trace when the virtual machine accesses the memory page causing a change to the access bit.

### Claim 20 (depends on 14)

A method as defined in claim 14, further including, in response to the request to suspend operation of the virtual machine, suspending operation of the virtual machine after the virtual memory is stored.
