Back to results
US 10,708,392 B2Granted
System and method for compression and decompression of data containing redundancies
AssigneeAppEx NETWORKS HOLDING LIMITED
InventorsHao Zhuang, Yongdong Wang
Life of this patent
Estimating the term…
Abstract
An apparatus and a computer-implemented method for processing data are disclosed. The apparatus comprises a memory device that stores first history data, and at least one processor configured to receive input data, determine a relationship between the first history data and one or more portions of the input data, generate one or more reference tokens reflecting the relationship, and transmit the one or more reference tokens to a recipient device.
Claims12
An apparatus, comprising:
- a memory device that stores first history data, wherein the first history data comprises one or more first data chunks, each first data chunk being associated with one or more first signatures, wherein the one or more first data chunks include a working data chunk which is most recently compressed in the first history data;
- a data storage device storing one or more second data chunks, each second data chunk being associated with one or more third signatures;
- and
- at least one processor configured to:
- receive input data;
- determine a relationship between the first history data and one or more portions of the input data;
- generate, based on the relationship, a token stream comprising one or more tokens reflecting the relationship, wherein the one or more tokens comprise at least one of a reference token or a raw token, and wherein the reference token includes a location and length of chunk data within the first history data that matches at least a portion of the input data, and the raw token includes one or more portions of input data not matching any portion of the first history data;
- and
- compress the token stream to form a compressed token stream;
- transmit the compressed token stream to a recipient device,
- wherein the at least one processor is configured to determine the relationship between the first history data and the one or more portions of the input data by:
- associating one or more second signatures with the input data;
- determining whether at least one of the first signatures associated with the working data chunk matches with at least one of the second signatures;
- responsive to a determination that none of the first signatures matches with any of the second signatures, determining whether at least one of the third signatures matches with at least one of the second signatures;
- responsive to a determination that at least one of the third signatures matches with at least one of the second signatures, determining a loading time of the second data chunk associated with the third signature that matches with the second signatures;
- responsive to the loading time being less than a threshold time, acquiring the second data chunk associated with the third signature that matches with the second signature from the data storage device to become the working data chunk;
- and
- responsive to the loading time being larger than or equal to the threshold time, generating one or more raw tokens for the second data chunk associated with the third signature that matches with the second signatures.
15 more elements
A computer-implemented method for processing data, the method comprising:
- receiving input data;
- receiving first history data, wherein the first history data comprises one or more first data chunks, each first data chunk being associated with one or more first signatures, wherein the one or more first data chunks include a working data chunk which is most recently compressed in the first history data;
- receiving one or more second data chunks from a data storage device, each second data chunk being associated with one or more third signatures;
- determining a relationship between the first history data and one or more portions of the input data;
- generating, based on the relationship, a token stream comprising one or more tokens reflecting the relationship, wherein the one or more tokens comprise at least one of a reference token or a raw token, and wherein the reference token includes a location and length of chunk data within the first history data that matches at least a portion of the input data, and the raw token includes one or more portions of input data not matching any portion of the first history data;
- and
- compressing the token stream to form a compressed token stream;
- transmitting the compressed token stream to a recipient device,
- wherein determining the relationship between the first history data and the one or more portions of the input data comprises:
- associating one or more second signatures with the input data;
- determining whether at least one of the first signatures matches with at least one of the second signatures;
- responsive to a determination that none of the first signatures matches with any of the second signatures, determining whether at least one of the third signatures matches with at least one of the second signatures;
- responsive to a determination that at least one of the third signatures matches with at least one of the second signatures, determining a loading time of the second data chunk associated with the third signature that matches with the second signatures;
- responsive to the loading time being less than a threshold time, acquiring the second data chunk associated with the third signature that matches with the second signature from the data storage device to become the working data chunk;
- and
- responsive to the loading time being larger than or equal to the threshold time, generating one or more raw tokens for the second data chunk associated with the third signature that matches with the second signatures.
13 more elements
Dependencies are inferred from the claim text.