Methods and systems for filtering collected QOS data for predicting an expected range for future QOS data

A non-transitory, machine readable storage medium having stored thereon instructions for performing a method, comprising machine executable code which when executed by at least one machine, causes the machine to:

• collect quality of service (QOS) data for a storage volume from among a plurality of storage volumes used for storing data for a storage operating system of a storage system having a plurality of storage devices, wherein a processor executable performance manager interfacing with the storage system collects the QOS data from the storage operating system of the storage system using a network connection, and wherein the QOS data includes a response time in which the storage volume responds to input/output (I/O) requests for storing and retrieving data at the plurality of storage devices and an average number of I/O requests that are processed by the storage operating system using the storage volume within a certain duration;
• identify by the performance manager, a portion of the collected QOS data that is noisy by comparing the average number of I/O requests processed within the certain duration for the storage volume with a first threshold value;
• wherein the first threshold value is set to detect unreliability in the collected QOS data due to a measurement error by the storage system;
• select reliable QOS data to replace the portion of the collected QOS data by the performance manager;
• wherein the reliable data is based on QOS data for one or more other storage volumes of the storage system that have a QOS policy similar to a QOS policy for the storage volume and share a resource of the storage system with the storage volume associated with the portion of the collected QOS data;
• replace the portion of the collected QOS data with the reliable QOS data by the performance manager for generating an expected range for evaluating future QOS collected data for the storage volume;
• use the expected range and the future collected QOS data by the performance manager to identify resource contention associated with one or more resources of the storage system used by the storage volume and identify a bully workload contributing to the resource contention;
• and
• execute a remediation task for reducing the resource contention, the remediation task depending on a computing resource type of the one or more resources in contention.

A system, comprising:

• a processor of a storage system executing a storage operating system using a plurality of storage volumes for storing information at a plurality of storage devices;
• and
• a processor for a performance manager that interfaces with the storage system, executing instructions out of a memory device to:
• collect quality of service (QOS) data maintained by the storage system for a storage volume from among the plurality of storage volumes wherein the QOS data is maintained by the storage system and includes a response time in which the storage volume responds to input/output (I/O) requests for storing and retrieving data at the plurality of storage devices and an average number of I/O requests that are processed by the storage operating system using the storage volume within a certain duration;
• identify a portion of the collected QOS data that is noisy by comparing the average number of I/O requests processed within the certain duration for the storage volume with a first threshold value;
• wherein the first threshold value is set to detect unreliability in the collected QOS data due to a measurement error by the storage system;
• select reliable QOS data to replace the portion of the collected QOS data;
• wherein the reliable data is based on QOS data for one or more other storage volumes of the storage system that have a QOS policy similar to a QOS policy for the storage volume and share a resource of the storage system with the storage volume associated with the portion of the collected QOS data;
• replace the portion of the collected QOS data with the reliable QOS data for generating an expected range for evaluating future QOS collected data for the storage volume;
• use the expected range and the future collected QOS data to identify resource contention associated with one or more resources of the storage system used by the storage volume and identify a bully workload contributing to the resource contention;
• and
• execute a remediation task for reducing the resource contention, the remediation task depending on a computing resource type of the one or more resources in contention.