Back to results
US 9,436,697 B1Granted
Techniques for managing deduplication of data
AssigneeVeritas Technologies LLC
InventorsPradip Madhukar Kulkarni, Vishal Bajpai
Life of this patent
Estimating the term…
Abstract
Techniques for detecting advanced security threats may be realized as a method for detecting a security threat including generating a resource at a client, implementing the resource on the client, monitoring system behavior of the client having the resource implemented thereon, determining whether a security event involving the implemented resource has occurred based on the monitored system behavior, and generating a report when it has been determined that the security event has occurred.
Claims17
A method for managing deduplication of data comprising:
- receiving, via a network, first data to be backed up;
- separating the first data to be backed up into segments;
- generating, using at least one computer processor, a fingerprint for each of the segments;
- sampling n-bits of the fingerprints;
- writing the sampled fingerprints to a plurality of hook tables arranged in a plurality of computing nodes, wherein the plurality of computing nodes respectively contain at least one of the plurality of hook tables, and wherein sizes of the n-bits of each of the sampled fingerprints are based on sizes of the hook tables to which the sampled fingerprints are written;
- receiving a lookup set of fingerprints corresponding to second data to be backed up;
- extracting a portion of the fingerprints corresponding to the second data;
- comparing the extracted portion of the fingerprints corresponding to the second data to entries of the plurality of hook tables to determine which of the plurality of hook tables has a highest number of matches;
- determining whether any of the fingerprints corresponding to the second data do not exist in memory based on the comparison using the respective extracted portions;
- filtering the fingerprints corresponding to the second data that are determined not to exist and transmitting remaining fingerprints corresponding to the second data to the computing node having the hook table with the highest number of matches so that a second comparison is made using the remaining fingerprints to determine which of the remaining fingerprints exist in the fingerprints generated from the first data;
- and
- backing up segments associated with the second data that do not exist in the first data.
9 more elements
An article of manufacture for managing deduplication of data, the article of manufacture comprising:
- at least one non-transitory processor readable storage medium;
- and instructions stored on the at least one medium;
- wherein the instructions are configured to be readable from the at least one medium by at least one processor and thereby cause the at least one processor to operate so as to:
- receive first data to be backed up;
- separate the first data to be backed up into segments;
- generate a fingerprint for each of the segments;
- sample n-bits of the fingerprints;
- write the sampled fingerprints to a plurality of hook tables arranged in a plurality of computing nodes, wherein the plurality of computing nodes respectively contain at least one of the plurality of hook tables, and wherein sizes of the n-bits of each of the sampled fingerprints are based on sizes of the hook tables to which the sampled fingerprints are written:
- receive a lookup set of fingerprints corresponding to second data to be backed up;
- extract a portion of the fingerprints corresponding to the second data;
- compare the extracted portion of the fingerprints corresponding to the second data to entries of the plurality of hook tables to determine which of the plurality of hook tables has a highest number of matches;
- determine whether any of the fingerprints corresponding to the second data do not exist in memory based on the comparison using the respective extracted portions;
- filter the fingerprints corresponding to the second data that are determined not to exist and transmit remaining fingerprints corresponding to the second data to the computing node having the hook table with the highest number of matches so that a second comparison is made using the remaining fingerprints to determine which of the remaining fingerprints exist in the fingerprints generated from the first data;
- and
- back up the segments associated with the second data that do not exist in the first data.
12 more elements
A system for managing deduplication of data comprising:
- one or more processors communicatively coupled to a network;
- wherein the one or more processors are configured to:
- receive first data to be backed up;
- separate the first data to be backed up into segments;
- generate a fingerprint for each of the segments;
- sample n-bits of the fingerprints;
- write the sampled fingerprints to a plurality of hook tables arranged in a plurality of computing nodes, wherein the plurality of computing nodes respectively contain at least one of the plurality of hook tables, and wherein sizes of the n-bits of each of the sampled fingerprints are based on sizes of the hook tables to which the sampled fingerprints are written;
- receive a lookup set of fingerprints corresponding to second data to be backed up;
- extract a portion of the fingerprints corresponding to the second data;
- compare the extracted portion of the fingerprints corresponding to the second data to entries of the plurality of hook tables to determine which of the plurality of hook tables has a highest number of matches;
- determine whether any of the fingerprints corresponding to the second data do not exist in memory based on the comparison using the respective extracted portions;
- filter the fingerprints corresponding to the second data that are determined not to exist and transmit remaining fingerprints corresponding to the second data to the computing node having the hook table with the highest number of matches so that a second comparison is made using the remaining fingerprints to determine which of the remaining fingerprints exist in the fingerprints generated from the first data;
- and
- back up segments associated with the second data that do not exist in the first data.
11 more elements
A system for managing deduplication of data, the system comprising:
- at least one processor configured to:
- receive first data to be backed up;
- separate the first data to be backed up into segments;
- generate a fingerprint for each of the segments;
- sample n-bits of the fingerprints;
- write the sampled fingerprints to a plurality of hook tables arranged in a plurality of computing nodes, wherein the plurality of computing nodes respectively contain at least one of the plurality of hook tables, and wherein sizes of the n-bits of each of the sampled fingerprints are based on sizes of the hook tables to which the sampled fingerprints are written;
- receive a lookup set of fingerprints corresponding to second data to be backed up;
- extract a portion of the fingerprints corresponding to the second data;
- compare the extracted portion of the fingerprints corresponding to the second data to entries of the plurality of hook tables to determine which of the plurality of hook tables has a highest number of matches;
- determine whether any of the fingerprints corresponding to the second data do not exist in memory based on the comparison using the respective extracted portions;
- filter the fingerprints corresponding to the second data that are determined not to exist and transmit remaining fingerprints corresponding to the second data to the computing node having the hook table with the highest number of matches so that a second comparison is made using the remaining fingerprints to determine which of the remaining fingerprints exist in the fingerprints generated from the first data;
- and
- back up segments associated with the second data that do not exist in the first data;
- and
- at least one memory, coupled to the at least one processor, configured to provide the at least one processor with instructions.
12 more elements
Dependencies are inferred from the claim text.