Host system and method for managing data consumption rate in a virtual data processing environment

An apparatus comprising:

• one or more computer readable storage media;
• program instructions stored on the one or more computer readable media that, when executed by a processing system, direct the processing system to perform a method for managing data consumption rate in a virtual data processing environment, the method comprising:
• identifying read completions for one or more virtual machines instantiated in a host system, with the one or more virtual machines processing one or more processing jobs;
• allocating the read completions to individual processing jobs of the one or more processing jobs;
• and
• accumulating the read completions on a per-job basis, with the cache node determining a data consumption rate for each processing job of the one or more processing jobs.

A method for managing data consumption rate of a virtual processing cluster in a virtual data processing environment, comprising:

• in each cache node of each host system in the virtual processing cluster, receiving read completions for one or more virtual machines instantiated in each host system, with the one or more virtual machines processing the one or more processing jobs;
• in each cache node of each host system in the virtual processing cluster, allocating the read completions to individual processing jobs of the one or more processing jobs;
• in each cache node of each host system in the virtual processing cluster, accumulating the read completions on a per-job basis;
• and
• in a master cache node, receiving and accumulating the read completions for all host systems and for all processing jobs of the one or more processing jobs, with the master cache node determining a data consumption rate for each processing job of the one or more processing jobs.