US 11,030,062 B2Granted

Chunk allocation

AssigneeRubrik, Inc.

InventorsGarvit Juniwal, Gaurav Jain, Adam Gee

Life of this patent

Estimating the term…

Loading patent…

Abstract

Methods and systems for identifying a set of disks within a cluster and then storing a plurality of data chunks into the set of disks such that the placement of the plurality of data chunks within the cluster optimizes failure tolerance and storage system performance for the cluster are described. The plurality of data chunks may be generated using replication of data (e.g., n-way mirroring) or application of erasure coding to the data (e.g., using a Reed-Solomon code or a Low-Density Parity-Check code). The topology of the cluster including the physical arrangement of the nodes and disks within the cluster and status information for the nodes and disks within the cluster (e.g., information regarding disk fullness, disk performance, and disk age) may be used to identify the set of disks in which to store the plurality of data chunks.

Claims21

Dependent claims

A method for operating a data management system, comprising:

acquiring a first snapshot of a real or virtual machine;
generating a first plurality of data sets using the first snapshot of the real or virtual machine;
acquiring disk ages for a plurality of disks at a first point in time;
determining a plurality of estimated times to failure for the plurality of disks at the first point in time using the disk ages for the plurality of disks at the first point in time;
identifying a first subset of the plurality of disks less than all of the disks of the plurality of disks using the plurality of estimated times to failure for the plurality of disks at the first point in time;
identifying a second subset of the plurality of disks different from the first subset of the plurality of disks using the plurality of estimated times to failure for the plurality of disks at the first point in time;
storing a first data set of the first plurality of data sets using the first subset of the plurality of disks;
storing a second data set of the first plurality of data sets using the second subset of the plurality of disks;
acquiring a second snapshot of the real or virtual machine subsequent to acquiring the first snapshot of the real or virtual machine;
generating a second plurality of data sets using the second snapshot of the real or virtual machine;
acquiring disk ages for the plurality of disks at a second point in time subsequent to the first point in time;
determining a plurality of estimated times to failure for the plurality of disks at the second point in time using the disk ages for the plurality of disks at the second point in time;
identifying a third subset of the plurality of disks less than all of the disks of the plurality of disks using the plurality of estimated times to failure for the plurality of disks at the second point in time, wherein the first subset of the plurality of disks is different from the third subset of the plurality of disks;
and
storing a third data set of the second plurality of data sets using the third subset of the plurality of disks.

12 more elements

A data management system, comprising:

a memory configured to store a first snapshot of a real or virtual machine and store a second snapshot of the real or virtual machine different from the first snapshot of the virtual machine;
and
one or more processors configured to perform operations comprising, at least:
generating a first plurality of data sets using the first snapshot of the real or virtual machine;
acquiring disk ages for a plurality of disks at a first point in time;
determining a plurality of estimated times to failure for the plurality of disks at the first point in time using the disk ages for the plurality of disks at the first point in time;
identifying a first subset of the plurality of disks less than all of the disks of the plurality of disks using the plurality of estimated times to failure for the plurality of disks at the first point in time;
identifying a second subset of the plurality of disks different from the first subset of the plurality of disks using the plurality of estimated times to failure for the plurality of disks at the first point in time;
storing a first data set of the first plurality of data sets using the first subset of the plurality of disks;
storing a second data set of the first plurality of data sets using the second subset of the plurality of disks;
acquiring a second snapshot of the real or virtual machine subsequent to acquiring the first snapshot of the real or virtual machine;
generating a second plurality of data sets using the second snapshot of the real or virtual machine;
acquiring disk ages for the plurality of disks at a second point in time subsequent to the first point in time;
determining a plurality of estimated times to failure for the plurality of disks at the second point in time using the disk ages for the plurality of disks at the second point in time;
identifying a third subset of the plurality of disks less than all of the disks of the plurality of disks using the plurality of estimated times to failure for the plurality of disks at the second point in time, wherein the first subset of the plurality of disks is different from the third subset of the plurality of disks;
and
storing a third data set of the second plurality of data sets using the third subset of the plurality of disks.

14 more elements

A non-transitory machine-readable medium comprising instructions which, when read by a machine, cause the machine to perform operations at a data management system comprising a memory configured to store a first snapshot of a real or virtual machine and store a second snapshot of the real or virtual machine different from the first snapshot of the virtual machine, the operations comprising, at least:

generating a first plurality of data sets using the first snapshot of the real or virtual machine;
acquiring disk ages for a plurality of disks at a first point in time;
determining a plurality of estimated times to failure for the plurality of disks at the first point in time using the disk ages for the plurality of disks at the first point in time;
identifying a first subset of the plurality of disks less than all of the disks of the plurality of disks using the plurality of estimated times to failure for the plurality of disks at the first point in time;
identifying a second subset of the plurality of disks different from the first subset of the plurality of disks using the plurality of estimated times to failure for the plurality of disks at the first point in time;
storing a first data set of the first plurality of data sets using the first subset of the plurality of disks;
storing a second data set of the first plurality of data sets using the second subset of the plurality of disks;
acquiring a second snapshot of the real or virtual machine subsequent to acquiring the first snapshot of the real or virtual machine;
generating a second plurality of data sets using the second snapshot of the real or virtual machine;
acquiring disk ages for the plurality of disks at a second point in time subsequent to the first point in time;
determining a plurality of estimated times to failure for the plurality of disks at the second point in time using the disk ages for the plurality of disks at the second point in time;
identifying a third subset of the plurality of disks less than all of the disks of the plurality of disks using the plurality of estimated times to failure for the plurality of disks at the second point in time, wherein the first subset of the plurality of disks is different from the third subset of the plurality of disks;
and
storing a third data set of the second plurality of data sets using the third subset of the plurality of disks.

11 more elements

Dependencies are inferred from the claim text.

Facts

Application: 16/569,008Filed 12 Sep 2019 · continuation
Priority: 10 Aug 2017
Published: US 2020/0057699 A120 Feb 2020
Granted: 8 Jun 2021
Term ends: Not estimatedThe source records don’t support an estimate.

Classification20 codes

G06F 11/1438
At system level: restarting or rejuvenating
G06F 11/1666
Error detection or correction of the data by redundancy in hardware: where the redundant component is memory or memory area
G06F 3/0604
Specifically adapted to achieve a particular effect: improving or facilitating administration, e.g. storage management
G06F 3/0616
Improving the reliability of storage systems: in relation to life time, e.g. increasing Mean Time Between Failures [MTBF]

Family

Application15/674,362Parent of this continuation · filed 10 Aug 2017
Application15/802,792Parent of this continuation · filed 3 Nov 2017
US 2020/0057699 A1Pre-grant publication · published 20 Feb 2020
US 10,423,503 B2Parent of this continuation
US 10,339,016 B2Parent of this continuation
US 2019/0050301 A1Published application
US 2019/0050302 A1Published application
US 11,030,062 B2This patent

From the US filing history. Foreign family members aren’t listed.

Timeline

Citations

Open elsewhere

Building an agent or pulling many patents? Use the API or MCP server instead of scraping pages. Get an API key