Restarting a storage operation utilizing an instance metafile
AssigneeNetApp, Inc.
InventorsSanhita Praveen Dhavale, Tijin George, Allan Jessie Sur
Life of this patent
Estimating the term…
Abstract
Techniques are provided for a data format for efficient management of checkpoint support. The data format corresponds to a base metafile and a set of instance metafiles used to track storage operations such as a directory restore operation. The base metafile and the set of instance metafiles can be used to resume the storage operation from where the storage operation left off in the event of a failure. The base metafile and the set of instance metafiles can be used to track progress of the storage operation processing objects stored within an object store of a cloud storage environment.
Claims20
A method, comprising:
- executing a storage operation that processes data items stored in objects within an object store hosted by a cloud storage environment, wherein the storage operation includes a set of sub operations for processing the data items;
- determining that the storage operation failed;
- evaluating a stack within an instance metafile to identify a last processed data item last processed by a successfully completed sub operation of the storage operation, wherein the stack is populated with file block numbers and file identifiers of data items encountered, but not fully processed, by the storage operation;
- and
- issuing a restored storage operation using the file block numbers and file identifiers within the stack to resume the storage operation from an unprocessed data item.
A computing device comprising:
- a memory storing instructions;
- and
- a processor coupled to the memory, the processor configured to execute the instructions to perform operations comprising:
- executing a storage operation that processes data items stored in objects within an object store hosted by a cloud storage environment, wherein the storage operation includes a set of sub operations for processing the data items;
- determining that the storage operation failed;
- evaluating a stack within an instance metafile to identify a last processed data item last processed by a successfully completed sub operation of the storage operation, wherein the stack is populated with file block numbers and file identifiers of data items encountered, but not fully processed, by the storage operation;
- and
- issuing a restored storage operation using the file block numbers and file identifiers within the stack to resume the storage operation from an unprocessed data item.
A non-transitory machine readable medium comprising instructions for performing a method, which when executed by a machine, causes the machine to perform operations comprising:
- executing a storage operation that processes data items stored in objects within an object store hosted by a cloud storage environment, wherein the storage operation includes a set of sub operations for processing the data items;
- determining that the storage operation failed;
- evaluating a stack within an instance metafile to identify a last processed data item last processed by a successfully completed sub operation of the storage operation, wherein the stack is populated with file block numbers and file identifiers of data items encountered, but not fully processed, by the storage operation;
- and
- issuing a restored storage operation using the file block numbers and file identifiers within the stack to resume the storage operation from an unprocessed data item.
Dependencies are inferred from the claim text.