Autoscaling using file access or cache usage for cluster machines
AssigneeDatabricks, Inc.
InventorsSrinath Shankar, Eric Keng-Hao Liang
Life of this patent
Estimating the term…
Loading patent…
AssigneeDatabricks, Inc.
InventorsSrinath Shankar, Eric Keng-Hao Liang
Estimating the term…
The allocation system comprises an interface and a processor. The interface is configured to receive an indication to deactivate idle cluster machines of a set of cluster machines. The processor is configured to determine a list of cluster machines storing one or more intermediate data files of a set of intermediate data files; determine a set of idle cluster machines of the set of cluster machines that are neither running one or more tasks of a set of tasks executing or pending on the set of cluster machines nor storing the one or more intermediate data files of the set of intermediate data files, where the set of intermediate data files is associated with the set of tasks executing or pending on the cluster machines; and deactivate each cluster machine of the set of idle cluster machines.
A system, comprising:
A method, comprising:
A computer program product, the computer program product being embodied in a non-transitory computer-readable storage medium and comprising computer instructions for:
Dependencies are inferred from the claim text.