Optimizing a File System for Different Types of Applications in a Compute Cluster Using Dynamic Block Size Granularity

A system for optimizing a file system for different types of applications in a compute cluster using dynamic block size granularity, comprising:

• a compute cluster, the compute cluster comprising:
• a plurality of nodes, wherein each of the plurality of node comprises locally attached storage,
• a shared storage subsystem coupled to each of the plurality of nodes, and
• a file system manager coupled to the shared storage subsystem and each of the plurality of nodes, wherein the file system manager:
• reserves a predetermined number of storage allocation regions for each of the plurality of nodes in the compute cluster, wherein each storage allocation region comprises a set of contiguous data blocks on a single storage disk of locally attached storage,
• uses a contiguous set of data blocks on a single storage disk of locally attached storage as a file system's block allocation granularity for striping data to be stored in the file system for a compute operation in the compute cluster, and
• uses a single data block of a shared storage subsystem as the file system's block allocation granularity for striping data to be stored in the file system for a data access operation in the compute cluster.

A computer program product for optimizing a file system for different types of applications in a compute cluster using dynamic block size granularity, comprising:

• a computer readable storage medium having computer readable program code embodied therewith, the computer readable program code comprising:
• computer readable program code configured to reserve a predetermined number of storage allocation regions for each node in a cluster, wherein each storage allocation region comprises a set of contiguous data blocks on a single storage disk of locally attached storage,
• computer readable program code configured to use a contiguous set of data blocks on a single storage disk of locally attached storage as a file system's block allocation granularity for striping data to be stored in the file system for a compute operation in the cluster, and
• computer readable program code configured to use a single data block of a shared storage subsystem as the file system's block allocation granularity for striping data to be stored in the file system for a data access operation in the cluster.