Storage of row-column data
AssigneeSensage, Inc.
InventorsAdam Sah, Eric Karlson, Cimarron Taylor, Nathan Watson
Life of this patent
Estimating the term…
Abstract
Table data is stored by parsing the table data into columns of values, formatting each column into a data stream, and transferring each data stream to a storage device for storage as a continuous strip of data. The strip of data is stored as a file that is not structured as a series of pages. The formatting of the data stream may include compressing the column values to minimize the length of the data strip. A particular compression procedure may be used that derives a code for each value in the column from a number of occurrences of the value in the column and replaces the value in the data stream with the corresponding code.
Claims43
A computerized method of storing table data comprising:
- parsing the table data into columns of values, each column represented as a continuous strip of data in a temporary storage;
- formatting each column into a data stream for permanent storage by linearly concatenating multiple columns into a single data stream;
- and
- directing a storage device to store each data stream as a continuous strip of compressed data without regard to a page size for the storage device.
A computer-readable medium having executable instructions to cause a computer to execute a method comprising:
- parsing table data into columns of values, each column represented as a continuous strip of data in a temporary storage;
- formatting each column into a data stream for permanent storage by linearly concatenating multiple columns into a single data stream;
- and
- transferring each data stream to a storage device for storage as a continuous strip of compressed data without regard to a page size for the storage device.
A computer system comprising:
- a processing unit;
- a memory coupled to the processing unit through a bus;
- a storage device coupled to the processing unit through a bus;
- and
- a data storing process executed from the memory by the processing unit to cause the processing unit to parse table data into columns of values with each column represented as a continuous strip of data in the memory, to format each column into a data stream for permanent storage by linearly concatenating multiple columns into a single data stream, and to direct the storage device to store the data stream as a continuous strip of compressed data without regard to a page size for the storage device.
A data storing system comprising:
- a plurality of compute nodes coupled to a data source to receive table data from the data source and to parse the table data into columns of values, each column represented as a continuous strip of data in a temporary storage;
- and
- a plurality of storage nodes, each storage node comprising a storage device and coupled to the plurality of compute nodes to receive the columns of values from the compute nodes, to format each column into a data stream for permanent storage by linearly concatenating multiple columns into a single data stream, and to direct the storage device to store the data stream as a continuous strip of compressed data without regard to a page size for the storage device.
Dependencies are inferred from the claim text.