Efficient retrieval of data that has been losslessly reduced using a prime data sieve
AssigneeAscava, Inc.
InventorHarshvardhan Sharangpani
Life of this patent
Estimating the term…
Loading patent…
AssigneeAscava, Inc.
InventorHarshvardhan Sharangpani
Estimating the term…
Techniques and systems for reconstituting a sequence of losslessly reduced data chunks are described. Some embodiments can collect metadata while losslessly reducing a sequence of data chunks by using prime data elements to obtain the sequence of losslessly reduced data chunks, wherein the metadata includes an indicator corresponding to each prime data element that indicates whether or not the prime data element is referenced in multiple losslessly reduced data chunks, and optionally includes a memory size of each prime data element. Some embodiments can retrieve the metadata and reconstitute the sequence of losslessly reduced data chunks, wherein during reconstitution, the metadata can be used to retain only those prime data elements in memory that are referenced in multiple losslessly reduced data chunks. Some embodiments can, prior to performing reconstitution, use the metadata to optionally allocate sufficient memory to store the prime data elements that are referenced in multiple losslessly reduced data chunks.
A method for reconstituting a sequence of losslessly-reduced data chunks created by losslessly reducing a sequence of data chunks using prime data elements, wherein each prime data element comprises a sequence of bytes, wherein metadata is collected while said losslessly reducing the sequence of data chunks, wherein said losslessly reducing the sequence of data chunks comprises using contents of a data chunk to identify a set of prime data elements by performing a content-associative lookup on a data structure that organizes the prime data elements, and using the set of prime data elements to losslessly reduce the data chunk to obtain a losslessly-reduced data chunk, wherein the losslessly-reduced data chunk includes (1) if the data chunk is identical to a prime data element in the set of prime data elements, a reference to the prime data element, or (2) if the data chunk is not identical to any of the prime data elements in the set of prime data elements, a reference to one or more prime data elements in the set of prime data elements and a sequence of transformations that derives the data chunk from the one or more prime data elements, the method comprising:
5-12. (canceled)
A method for determining metadata for prime data elements while losslessly reducing a sequence of data chunks to obtain a sequence of losslessly-reduced data chunks, wherein the metadata reduces an amount of memory required during subsequent reconstitution of the sequence of losslessly-reduced data chunks, wherein each prime data element comprises a sequence of bytes, wherein said losslessly reducing the sequence of data chunks comprises using contents of a data chunk to identify a set of prime data elements by performing a content-associative lookup on a data structure that organizes the prime data elements, and using the set of prime data elements to losslessly reduce the data chunk to obtain a losslessly-reduced data chunk, wherein the losslessly-reduced data chunk includes (1) if the data chunk is identical to a prime data element in the set of prime data elements, a reference to the prime data element, or (2) if the data chunk is not identical to any of the prime data elements in the set of prime data elements, a reference to one or more prime data elements in the set of prime data elements and a sequence of transformations that derives the data chunk from the one or more prime data elements, the method comprising:
A non-transitory computer-readable storage medium storing instructions that, when executed by a computer, cause the computer to perform a method for determining metadata for prime data elements while losslessly reducing a sequence of data chunks to obtain a sequence of losslessly-reduced data chunks, wherein the metadata reduces an amount of memory required during subsequent reconstitution of the sequence of losslessly-reduced data chunks, wherein each prime data element comprises a sequence of bytes, wherein said losslessly reducing the sequence of data chunks comprises using contents of a data chunk to identify a set of prime data elements by performing a content-associative lookup on a data structure that organizes the prime data elements, and using the set of prime data elements to losslessly reduce the data chunk to obtain a losslessly-reduced data chunk, wherein the losslessly-reduced data chunk includes (1) if the data chunk is identical to a prime data element in the set of prime data elements, a reference to the prime data element, or (2) if the data chunk is not identical to any of the prime data elements in the set of prime data elements, a reference to one or more prime data elements in the set of prime data elements and a sequence of transformations that derives the data chunk from the one or more prime data elements, the method comprising:
23-27. (canceled)
Dependencies are inferred from the claim text.