US 2026/0140924 A1 · Data Format And Compression For Storage System Monitoring Data Signals

Abstract

Various embodiments of the present disclosure relate to compression techniques that can be used for data storage, indexing, and retrieval. In an example embodiment, a controller of or in communication with a data storage system can obtain a request to store a file in the data storage system. The controller identifies time-series data associated with input/output of the file and metrics of the file, generates a feature vector for the file, and compresses the feature vector using a compression technique, resulting in a compressed feature vector having a compression ratio. The controller performs a hash algorithm using the compression ratio to determine a storage device at which to store the compressed feature vector, the compression ratio associated with the file, and an indication of the compression technique. Upon receiving a query for a file, the controller compares compression ratios to identify a storage device storing the requested file.

Claims20

Dependent claims

A method comprising:

obtaining a request to store a file in a data storage environment, wherein the data storage environment includes a storage aggregate having multiple storage devices;
identifying time-series data associated with input/output of the file and metrics of the file;
generating a feature vector using the time-series data and the metrics;
compressing the feature vector using a compression technique and determining a compression ratio associated with the file based on the feature vector and the compressed feature vector;
and
performing a hash algorithm using the compression ratio to determine a storage device of the multiple storage devices at which to store the compressed feature vector, the compression ratio associated with the file, and an indication of the compression technique.

3 more elements

A computing apparatus comprising:

one or more processors;
and
a memory coupled to the one or more processors and having stored thereon program instructions that, when executed by the one or more processors, direct the computing apparatus to:
obtain a request to store a file in a data storage environment, wherein the data storage environment includes a storage aggregate having multiple storage devices;
identify time-series data associated with input/output of the file and metrics of the file;
generate a feature vector using the time-series data and the metrics;
compress the feature vector using a compression technique and determining a compression ratio associated with the file based on the feature vector and the compressed feature vector;
and
perform a hash algorithm using the compression ratio to determine a storage device of the multiple storage devices at which to store the compressed feature vector, the compression ratio associated with the file, and an indication of the compression technique.

6 more elements

One or more non-transitory computer-readable media comprising program instructions that, when executed by a processing device of a data storage system, direct the data storage system to:

obtain a request to store a file in a data storage environment, wherein the data storage environment includes a storage aggregate having multiple storage devices;
identify time-series data associated with input/output of the file and metrics of the file;
generate a feature vector using the time-series data and the metrics;
compress the feature vector using a compression technique and determining a compression ratio associated with the file based on the feature vector and the compressed feature vector;
and
perform a hash algorithm using the compression ratio to determine a storage device of the multiple storage devices at which to store the compressed feature vector, the compression ratio associated with the file, and an indication of the compression technique.

3 more elements

Dependencies are inferred from the claim text.

Data Format And Compression For Storage System Monitoring Data Signals

Life of this patent

Data Format And Compression For Storage System Monitoring Data Signals

Life of this patent

Abstract

Claims20