Semantic-aware and user-aware admission control for performance management in data analytics and data storage systems

A system, comprising:

• one or more hardware processors;
• a computer-readable storage medium having software modules embodied therewith that are executable by the one or more hardware processors, the software modules comprising:
• a job request analyzer module configured to analyze a first job request to determine:
• an estimated complexity of the first job request based on one or more attributes of the first job request;
• and
• a user skill level of a user that submitted the first job request;
• a plurality of queues, each queue being configured to store job requests having different estimated complexities and user skill levels with respect to job requests stored in other queues;
• a classification module configured to temporarily store the first job request into one of the plurality of queues based on the estimated complexity of the first job request and the user skill level of the user that submitted the job request;
• and
• a job dispatcher module configured to admit the first job request to a data analytics system and/or a data storage system in a specified order with respect to other received job requests based on a queue in which the first job request is stored.

A computer-implemented method, comprising:

• receiving a first job request;
• analyzing semantics of the first job request to determine a size of the first job request and identifying a user that submitted the first job request, wherein the semantics are selected from the group comprising:
• keywords in the first job request, a combination of keywords in the first job request, and data set sizes of data sets referenced in the first job request;
• temporarily storing, by a processor, the first job request in a first queue of a plurality of queues based on an estimated complexity of the first job request and a user skill level of the user that submitted the first job request;
• and
• admitting, by the processor, the first job request from the first queue to a data analytics system and/or a data storage system to be processed, the first job request being selected in a specified order with respect to other received job requests stored in other queues based on the estimated complexity of the first job request, and the user skill level of the user that submitted the first job request,
• wherein the estimated complexity is based on one or more attributes of the first job request, and wherein the user skill level is based on factors selected from the group comprising:
• user experience level, user job request submission history, and corresponding data analytics system and/or data storage system response history to the user job request submission history.