System for optimizing resources for cloud-based scalable distributed search data analytics service

A method comprising:

• receiving, at network interface circuitry, resource utilization tracking data and resource configuration data of a service resource unit for a cloud-based data analytics service;
• executing a resource configuration optimization (RCO) stack at optimization circuitry, the optimization circuitry in data communication with the network interface circuitry, wherein executing the RCO stack comprises:
• obtaining computing utilization metrics of computing capacity provisioned to the service resource unit based on the resource utilization tracking data;
• generating a computing capacity rightsizing recommendation on the computing capacity based on the computing utilization metrics;
• obtaining memory utilization metrics of memory capacity provisioned the service resource unit based on the resource utilization tracking data;
• generating a memory capacity rightsizing recommendation on the memory capacity based on the memory utilization metrics;
• determining a recommended instance type for the service resource unit based on the computing capacity rightsizing recommendation and the memory capacity rightsizing recommendation;
• obtaining a storage volume type of the service resource unit from the resource configuration data, the storage volume type indicating input/output (I/O) capacity provisioned to the service resource unit;
• obtaining I/O utilization metrics of the I/O capacity provisioned to the service resource unit based on the resource utilization tracking data;
• generating a volume type recommendation for the service resource unit based on the storage volume type and the I/O utilization metrics;
• calculating an actual used storage volume size of a storage capacity provisioned to the service resource unit based on the resource configuration data with respect to the storage capacity, the actual used storage volume size representing a volume size of storage storing data in the storage capacity;
• performing a storage volume check on the service resource unit based on the computing capacity rightsizing recommendation, the memory capacity rightsizing recommendation, and the actual used storage volume size, to obtain a storage volume check result;
• determining whether to accept the recommended instance type as a final optimization recommendation based on the storage volume check result, the computing capacity rightsizing recommendation, and the memory capacity rightsizing recommendation;
• in response to the acceptance, generating a RCO token to include instructions executable by a host interface to optimize the resource configuration of the service resource unit according to the final optimization recommendation;
• and
• sending the RCO token, via the network interface circuitry, to the host interface.

A product including:

• machine-readable media other than a transitory signal;
• and
• instructions stored on the machine-readable media, the instructions configured to, when executed, cause a machine to:
• receive, at network interface circuitry, resource utilization tracking data and resource configuration data of a service resource unit for a cloud-based data analytics service;
• execute, at optimization circuitry in data communication with the network interface circuitry, a resource configuration optimization (RCO) stack, the RCO stack being executable to:
• obtain computing utilization metrics of computing capacity provisioned to the service resource unit based on the resource utilization tracking data;
• generate a computing capacity rightsizing recommendation on the computing capacity based on the computing utilization metrics;
• obtain memory utilization metrics of memory capacity provisioned the service resource unit based on the resource utilization tracking data;
• generate a memory capacity rightsizing recommendation on the memory capacity based on the memory utilization metrics;
• determine a recommended instance type for the service resource unit based on the computing capacity rightsizing recommendation and the memory capacity rightsizing recommendation;
• obtain a storage volume type of the service resource unit from the resource configuration data, the storage volume type indicating input/output (I/O) capacity provisioned to the service resource unit;
• obtain I/O utilization metrics of the I/O capacity provisioned to the service resource unit based on the resource utilization tracking data;
• generate a volume type recommendation for the service resource unit based on the storage volume type and the I/O utilization metrics;
• calculate an actual used storage volume size of a storage capacity provisioned to the service resource unit based on the resource configuration data with respect to the storage capacity, the actual used storage volume size representing a volume size of storage storing data in the storage capacity;
• perform a storage volume check on the service resource unit based on the computing capacity rightsizing recommendation, the memory capacity rightsizing recommendation, and the actual used storage volume size, to obtain a storage volume check result;
• determine whether to accept the recommended instance type as a final optimization recommendation based on the storage volume check result, the computing capacity rightsizing recommendation, and the memory capacity rightsizing recommendation;
• in response to the acceptance, generate a RCO token to include instructions executable by a host interface to optimize the resource configuration of the service resource unit according to the final optimization recommendation;
• and
• send the RCO token, via the network interface circuitry, to the host interface.