US 12,009,990 B1Granted

Hardware-based fault injection service

AssigneeAmazon Technologies, Inc.

InventorsJuan-Pierre Longmore, Peng Gu, Noel O'Flaherty

Life of this patent

Estimating the term…

Loading patent…

Abstract

Disclosed are various embodiments for simulating hardware-based faults in a cloud provider network. A first computing device can send a command to an offload card installed on a second computing device to introduce a simulated hardware fault into the second computing device. Then the first computing device can determine whether the second computing device has successfully recovered from the simulated hardware fault. Alternatively, an entry in an access control list (ACL) of a network switch can be modified to block network traffic to a first network interface of a host machine that is connected to the network switch. Then, a command can be sent to a second network interface of the host machine to instruct the host machine to perform a hard reset. Then it can be determined whether the host machine has successfully booted subsequent to the hard reset.

Claims12

Dependent claims

A system, comprising:

a first computing device comprising a processor and a memory;
and
machine-readable instructions stored in the memory that, when executed by the processor, cause the first computing device to at least:
send a command to an offload card installed on a second computing device to cause the second computing device to power cycle, wherein the second computing device comprises a hypervisor that hosts at least one virtual compute instance;
in response to the second computing device power cycling, send an Internet Control Message Protocol (ICMP) message to the second computing device to determine that the second computing device has begun booting after the power cycle;
in response to a determination that the second computing device has begun booting, establish a first Transmission Control Protocol (TCP) session with the second computing device to determine that the second computing device has completed booting after the power cycle;
and
in response to a determination that the second computing device has completed booting, establish a second TCP session with the at least one virtual compute instance to determine that the at least one virtual compute instance has recovered from the power cycle of the second computing device.

5 more elements

A method performed by a first computing device, comprising

sending a command to an offload card installed on a second computing device to cause the second computing device to power cycle, wherein the second computing device comprises a hypervisor that hosts at least one virtual compute instance;
in response to the second computing device power cycling, sending an Internet Control Message Protocol (ICMP) message to the second computing device to determine that the second computing device has begun booting after the power cycle;
in response to a determination that the second computing device has begun booting, establishing a first Transmission Control Protocol (TCP) session with the second computing device to determine that the second computing device has completed booting after the power cycle;
and
in response to a determination that the second computing device has completed booting, establishing a second TCP session with the at least one virtual compute instance to determine that the at least one virtual compute instance has recovered from the power cycle of the second computing device.

2 more elements

A non-transitory, computer-readable medium comprising machine-readable instructions that, when executed by a processor of a first computing device, cause the first computing device to at least:

send a command to an offload card installed on a second computing device to cause the second computing device to power cycle, wherein the second computing device comprises a hypervisor that hosts at least one virtual compute instance;
in response to the second computing device power cycling, send an Internet Control Message Protocol (ICMP) message to the second computing device to determine that the second computing device has begun booting after the power cycle;
in response to a determination that the second computing device has begun booting, establish a first Transmission Control Protocol (TCP) session with the second computing device to determine that the second computing device has completed booting after the power cycle;
and
in response to a determination that the second computing device has completed booting, establish a second TCP session with the at least one virtual compute instance to determine that the at least one virtual compute instance has recovered from the power cycle of the second computing device.

2 more elements

Dependencies are inferred from the claim text.