Systems and methods for integrating compute resources in a storage area network

An object store, comprising:

• a storage module for executing storage operations comprising storing guest data for a virtual machine and operating based on a clock, each of the storage operations comprising a timestamp, context data about the virtual machine being collected, wherein the context data comprises an internal application identifier and an internal application code path for the virtual machine;
• a compute module coupled to the storage module for performing compute operations on the guest data for the virtual machine and operating based on the clock each of the storage operations comprising a timestamp respectively;
• and
• a context memory for storing context data generated by the virtual machine, the context memory being coupled to device drivers of the storage module, the context data being used to dynamically modify the device drivers, the context data comprising a correlation of the storage operations and the compute operations using the timestamps of the storage operations and the timestamps of the compute operations, wherein the timestamps associated with the storage operations are correlated with the timestamps associated with the compute operations, in the context memory.

A method comprising:

• collecting context data on each of the virtual machines of the plurality of tenants, the context data comprising a process identifier and a username, a compute module that executes compute operations comprising instantiating each of the virtual machines directly on the object store without moving guest data from the object store, the context data comprising a correlation of storage operations and the compute operations using timestamps of the storage operations and timestamps of the compute operations, wherein the timestamps associated with the storage operations are correlated with the timestamps associated with the compute operations, in the context memory;
• controlling storage operations for the object store relating to the guest data based on the context data, each of the compute operations and the storage operations comprising timestamps respectively;
• generating correlated data that comprises correlating the compute operations of the compute module and the storage operations of the storage module using timestamps;
• and
• outputting the correlated data to an administrator terminal.

A system for processing and storing data, comprising:

• a compute module running at least one virtual machine that is used to process guest data in an object store using at least one compute function that is executed directly on the object store in such a way that data is not moved from the object store, the compute module accessing a clock for managing compute operations, context data on the at least one virtual machine being collected;
• a storage module communicating with the compute module and storing the guest data, the storage module accessing the context data that is used to dynamically modify control software of the storage module and to manage input/output throttling of the guest data with respect to the storage module, the storage module storing a read-only copy of a virtual machine operating system for instantiating new instances of virtual machines in the compute module, the storage module accessing the clock for managing storage operations;
• a context module for correlating the compute operations of the compute module and the storage operations of the storage module using timestamps, each of the compute operations and the storage operations comprising timestamps respectively;
• and
• a system administrator module accessing the context data for determining resource usage related to the guest data and outputting the correlated data to an administrator terminal.