System and method for multi-tiered meta-data caching and distribution in a clustered computer environment

A computer-implemented system for distributing meta-data of a data container, comprising:

• a hardware processor operatively connected to a computer configured to execute a storage operating system to stripe the data container across a plurality of logical volumes to form a striped volume set, wherein each logical volume is a logical arrangement of a plurality of storage devices coupled to the computer;
• a meta-data volume of the plurality of logical volumes configured to store a copy of meta-data of the data container;
• one or more data volumes of the plurality of logical volumes configured as a container attribute volume for the data container, wherein the container attribute volume is configured to serve as a first tier caching and distribution point within the striped volume set for the meta-data in the meta-data volume in response to receiving a data access request, and wherein the data container and container attribute volume are stored on different data volumes;
• and
• a module of the storage operating system serving the meta-data volume configured to invalidate a cached copy of the meta-data stored on the container attribute volume, a data structure of the data container comprising a meta-data invalidation flag to identify that the cached copy of the meta-data is invalid, the module of the storage operating system serving the meta-data volume configured to update the copy of the meta-data stored on the container attribute volume.

A non-transitory computer readable storage medium containing executable program instructions executed by a processor, comprising:

• program instructions that stripe a data container across a plurality of logical volumes configured to form a striped volume set, wherein each logical volume is a logical arrangement of a plurality of storage devices coupled to a computer;
• program instructions that store a copy of meta-data of the data container in a meta-data volume of the plurality of logical volumes, wherein the meta-data is organized into a plurality of categories based on a frequency that meta-data changes in response to receiving a data access request directed to the data container, wherein a first category of the plurality of categories includes an access control list;
• program instructions that designate a container attribute volume for the data container, wherein the container attribute volume is formed from the stripe volume set, wherein the container attribute volume serves as a first tier caching and distribution point within the striped volume set for the meta-data in the meta-data volume in response to receiving the data access request directed to the data container, and wherein the data container and container attribute volume are stored on different logical volumes;
• and
• program instructions that invalidate a cached copy of the meta-data stored on the container attribute volume in response to receiving the data access request.

A computer-implemented method, comprising:

• striping a data container across a plurality of logical volumes, wherein each logical volume is a logical arrangement of a plurality of storage devices;
• organizing meta-data of the data container into a plurality of categories based on a frequency that meta-data changes in response to receiving a data access request directed to the data container, wherein a first category of the plurality of categories includes an access control list;
• storing a copy of meta-data in the first category of the plurality of categories at a meta-data volume, a data volume, and a container attribute volume, wherein the container attribute volume is striped across the plurality of logical volumes, wherein the container attribute volume serves as a first tier caching and distribution point for the meta-data in the meta-data volume in response to receiving the data access request directed to the data container, wherein the data container and container attribute volume are stored on different logical volumes;
• determining that a first local copy of the meta-data stored at the container attribute volume is invalid;
• querying the meta-data volume for a valid copy of the meta-data in response to determining the first local copy is invalid;
• and
• storing the valid copy of the meta-data at the container attribute volume.