Cluster instance management system
AssigneeDatabricks, Inc.
InventorsAli Ghodsi, Ion Stoica, Matei Zaharia
Life of this patent
Estimating the term…
Abstract
A system for cluster management comprises a status monitor and an instance replacement manager. The status monitor is for monitoring status of an instance of a set of instances on a cluster provider. The instance replacement manager is for determining a replacement strategy for the instance in the event the instance does not respond. The replacement strategy for the instance is based at least in part on a management criteria for on-demand instances and spot instances on the cluster provider.
Claims21
A system for cluster management, comprising:
- a processor;
- and
- a memory coupled with the processor, wherein the memory is configured to provide the processor with instructions which when executed cause the processor to:
- monitor status of an instance of a set of instances on a cluster provider;
- and
- determine a replacement strategy for the instance in the event the instance does not respond, wherein the replacement strategy for the instance is based at least in part on a management criteria for on-demand instances and spot instances on the cluster provider, wherein the determining of the replacement strategy comprises to:
- determine whether it is acceptable to not replace the instance immediately based on the management criteria;
- and
- in response to a determination that it is acceptable to not replace the instance immediately based on the management criteria:
- monitor availability of a new spot instance;
- and
- in response to a determination that the new spot instance is available, replace the instance that does not respond with the new spot instance.
A method for cluster management, comprising:
- monitoring status of an instance of a set of instances on a cluster provider;
- and
- determining, using a processor, a replacement strategy for the instance in the event the instance does not respond, wherein the replacement strategy for the instance is based at least in part on a management criteria for on-demand instances and spot instances on the cluster provider, wherein the determining of the replacement strategy comprises:
- determining whether it is acceptable to not replace the instance immediately based on the management criteria;
- and
- in response to a determination that it is acceptable to not replace the instance immediately based on the management criteria:
- monitoring availability of a new spot instance;
- and
- in response to a determination that the new spot instance is available, replacing the instance that does not respond with the new spot instance.
A computer program product for cluster management, the computer program product being embodied in a non-transitory computer readable storage medium and comprising computer instructions for:
- monitoring status of an instance of a set of instances on a cluster provider;
- and
- determining a replacement strategy for the instance in the event the instance does not respond, wherein the replacement strategy for the instance is based at least in part on a management criteria for on-demand instances and spot instances on the cluster provider, wherein the determining of the replacement strategy comprises:
- determining whether it is acceptable to not replace the instance immediately based on the management criteria;
- and
- in response to a determination that it is acceptable to not replace the instance immediately based on the management criteria:
- monitoring availability of a new spot instance;
- and
- in response to a determination that the new spot instance is available, replacing the instance that does not respond with the new spot instance.
Dependencies are inferred from the claim text.