Method, computer-readable medium and file system for deduplication utilzing calculation range and re-chunking
AssigneeQnap Systems, Inc.
InventorsTsung-Han Chiang, Jing-Wei Su, Chin-Tsung Cheng
Life of this patent
Estimating the term…
Abstract
A method for deduplication applicable to a file chunked into a plurality of deduplicated chunks is provided and includes: defining a calculation range in the file according to types of the chunks in the file, where the calculation range includes a plurality of consecutive chunks in the file; generating an evaluation value according to the types of the chunks in the calculation range to determine whether to mark the chunks in the calculation range; and re-chunking and deduplicating the marked chunks in the file. A computer-readable medium and a file system corresponding to the method for deduplication are also provided.
Claims18
A computer-implemented method for deduplication, applicable to a deduplication system comprising an electronic computing device and a remote electronic storage device connected to the electronic computing device via a network, wherein a file is chunked into a plurality of deduplicated chunks stored in the remote electronic storage device, the method comprising:
- providing a temporary storage area, by the electronic computing device, for storing the chunks required by the electronic computing device or modified by the electronic computing device;
- defining a calculation range in the file, by the electronic computing device having the temporary storage area, according to types of the chunks in the file, wherein the calculation range includes a plurality of consecutive chunks in the file;
- generating an evaluation value, by the electronic computing device having the temporary storage area, according to the types of the chunks in the calculation range to determine whether to mark the chunks in the calculation range;
- if there is a marked chunk that has not been stored in the temporary storage area, obtaining a latest version of the marked chunk from the remote electronic storage device and storing the latest version in the temporary storage area;
- re-chunking and deduplicating the marked chunks in the temporary storage area;
- and
- updating a file descriptor of the file and the deduplicated chunks of the file stored in the remote electronic storage device according to a result of the re-chunking and the deduplicating of the marked chunks in the temporary storage area.
A non-transitory computer-readable storage medium having computer readable program code embodied therein that performs a method for deduplication applicable to a deduplication system comprising an electronic computing device and a remote electronic storage device connected to the electronic computing device via a network, wherein a file is chunked into a plurality of deduplicated chunks stored in the remote electronic storage device, the method comprising:
- providing a temporary storage area, by the electronic computing device, for storing the chunks required by the electronic computing device or modified by the electronic computing device;
- defining a calculation range in the file, by the electronic computing device having the temporary storage area, according to types of the chunks in the file, wherein the calculation range includes a plurality of consecutive chunks in the file;
- generating an evaluation value, by the electronic computing device having the temporary storage area, according to the types of the chunks in the calculation range to determine whether to mark the chunks in the calculation range;
- if there is a marked chunk that has not been stored in the temporary storage area, obtaining a latest version of the marked chunk from the remote electronic storage device and storing the latest version in the temporary storage area;
- re-chunking and deduplicating the marked chunks in the temporary storage area;
- and
- updating a file descriptor of the file and/or the deduplicated chunks of the file stored in the remote electronic storage device according to a result of the re-chunking and the deduplicating of the marked chunks in the temporary storage area.
A deduplication system comprising:
- an electronic computing device;
- and
- a remote electronic storage device connected to the electronic computing device via a network, wherein a file is chunked into a plurality of deduplicated chunks stored in the remote electronic storage device, and
- wherein the electronic computing device reads the file to perform a method, the method comprising:
- providing a temporary storage area, by the electronic computing device, for storing the chunks required by the electronic computing device or modified by the electronic computing device;
- defining a calculation range in the file, by the electronic computing device having the temporary storage area, according to types of the chunks in the file, wherein the calculation range includes a plurality of consecutive chunks in the file;
- generating an evaluation value, by the electronic computing device having the temporary storage area, according to the types of the chunks in the calculation range to determine whether to mark the chunks in the calculation range;
- if there is a marked chunk that has not been stored in the temporary storage area, obtaining a latest version of the marked chunk from the remote electronic storage device and storing the latest version in the temporary storage area:
- re-chunking and deduplicating the marked chunks in the temporary storage area;
- and
- updating a file descriptor of the file and the deduplicated chunks of the file stored in the remote electronic storage device according to a result of the re-chunking and the deduplicating of the marked chunks in the temporary storage area.
Dependencies are inferred from the claim text.