Automated query language performance metrics

An apparatus to generate test suites, the apparatus comprising:

• network interface circuitry to, in response to a notification that a first microservice of a plurality of microservices is updated, retrieve an application programming interface (API) specification of the plurality of microservices;
• introspection circuitry to determine attributes that are present in the API specification;
• combinatorial generation circuitry to generate a plurality of test cases based on the determined attributes;
• and
• test suite packaging circuitry to package the plurality of test cases as a first test suite.

A non-transitory storage medium comprising instructions to cause programmable circuitry to at least:

• generate a first test suite based on a plurality of combinations of a plurality of attributes corresponding to an API specification;
• test suite execution circuitry to transmit the first test suite to be executed on a query endpoint, the first test suite to include instructions to cause the query endpoint to access data stored in a database accessible to a plurality of secondary endpoints;
• obtain a response time corresponding to the access of the data;
• compare the response time corresponding to the access of the data with a service level agreement required response time;
• and
• in response to the response time corresponding to the access of the data being longer than the service level agreement required response time, notify a developer of the plurality of secondary endpoints.