System and method for network data compression
AssigneeNarus, Inc.
InventorsAntonio Nucci, Supranamaya Ranjan, Su Chen
Life of this patent
Estimating the term…
Abstract
The present invention relates to a method of compressing data in a network, the data comprising a plurality of packets each having a header and a payload, the header comprising a plurality of header fields, the method comprising generating a classification tree based on at least a portion of the plurality of header fields, determining a inter-packet compression plan based on the classification tree, and performing inter-packet compression in real time for each payload of at least a first portion of the plurality of packets, the inter-packet compression being performed according to at least a portion of the inter-packet compression plan.
Claims16
A method of compressing data in a network, the data comprising a plurality of packets corresponding to a plurality of headers and a plurality of payloads, a packet of the plurality of packets having a header of the plurality of headers and a payload of the plurality of payloads, each of the plurality of headers comprising a plurality of header fields, the method comprising:
- generating, using a computer, a matrix based on the plurality of packets, the matrix comprising a plurality of rows each corresponding to one of the plurality of packets and a plurality of structured columns each corresponding to one of the plurality of header fields, the matrix further comprising an unstructured column having a plurality of row elements each comprising one of the plurality of payloads;
- determining, using the computer, an intra-packet compression plan based on historical network data, the intra-packet compression plan configured to reorder and divide the plurality of structured columns in the matrix into a plurality of groups;
- determining, using the computer, an inter-packet compression plan based on historical network data, the inter-packet compression plan configured to reorder and classify the plurality of rows in the matrix based on a plurality of hierarchical categories in a classification tree determined using the historical network data, wherein the classification tree is determined by:
- composing a full classification tree having a plurality of nodes based on the plurality of header fields, each of the plurality of nodes representing payload classification based on a specific value combination of the plurality of header fields;
- identifying a hierarchical category of the plurality of hierarchical categories from the full classification tree, the hierarchical category comprising one or more nodes in the plurality of nodes identified based on minimizing a first cost function while applying the inter-packet compression plan to the historical network data;
- and
- including the hierarchical category in the classification tree;
- and
- performing, using the computer, inter-packet compression of the plurality of payloads based on the inter-packet compression plan;
- and
- performing, using the computer, intra-packet compression of the plurality of headers based on the intra-packet compression plan.
A non-transitory computer readable medium, embodying instructions executable by the computer to perform method steps for compressing data in a network, the data comprising a plurality of packets corresponding to a plurality of headers and a plurality of payloads, a packet of the plurality of packets having a header of the plurality of headers and a payload of the plurality of payloads, each of the plurality of headers comprising a plurality of header fields, the instructions comprising functionality for:
- generating, a matrix based on the plurality of packets, the matrix comprising a plurality of rows each corresponding to one of the plurality of packets and a plurality of structured columns each corresponding to one of the plurality of header fields;
- determining an intra-packet compression plan based on historical network data, the intra-packet compression plan configured to reorder and divide the plurality of structured columns in the matrix into a plurality of groups,
- determining an inter-packet compression plan based on historical network data, the inter-packet compression plan configured to reorder and classify the plurality of rows in the matrix based on a plurality of hierarchical categories in a classification tree determined using the historical network data, wherein the classification tree is determined by:
- composing a full classification tree having a plurality of nodes based on the plurality of header fields, each of the plurality of nodes representing payload classification based on a specific value combination of the plurality of header fields;
- identifying a hierarchical category of the plurality of hierarchical categories from the full classification tree, the hierarchical category comprising one or more nodes in the plurality of nodes identified based on minimizing a first cost function while applying the inter-packet compression plan to the historical network data;
- and
- including the hierarchical category in the classification tree;
- and
- performing inter-packet compression of the plurality of payloads based on the inter-packet compression plan;
- and
- performing, intra-packet compression of the plurality of headers based on the intra-packet compression plan.
Dependencies are inferred from the claim text.