Efficient and scalable time-series data storage and retrieval over a network
AssigneeHydrolix Inc.
InventorHasan Alayli
Life of this patent
Estimating the term…
Loading patent…
AssigneeHydrolix Inc.
InventorHasan Alayli
Estimating the term…
Time-series columnar-based information is received and indexed in a compute infrastructure for cost-effective cloud-based object storage. The approach leverages a file format that enables highly-performant search and retrieval of the data stored in the cloud. In operation, an indexer receives the time-series information, indexes that information according to the file format, and forwards the indexed information for storage to the object store, where it is stored as a set of time-based partitions. A partition comprises a set of files, namely, a manifest file, a data file, and an index file. These files are structured as a compact instance of a set of raw unstructured data that comprises the given partition. Highly-performant information retrieval is enabled in response to a time-bounded query, because operations at a query peer (with respect to one or more partitions) are carried out in real-time during query processing and without requiring retrieval of the data file as a whole.
A method of retrieving time-series columnar-based information, wherein the information comprises a set of time-based partitions that are stored across a cloud-based object store in directories each of which include a set of files, the set of files comprising a first file, a second file, and a third file, wherein the first, second and third files for a given time-based partition together comprise a compact instance of a set of raw unstructured data that comprises the given time-based partition, wherein the column data is stored in the second file in contiguous byte-ranges, comprising:
Dependencies are inferred from the claim text.