System and method for consistent metadata access based on local locks semantics in a multi-node cluster

A computer program product residing on a non-transitory computer readable storage medium having a plurality of instructions stored thereon which, when executed across one or more processors, causes at least a portion of the one or more processors to perform operations comprising:

• acquiring, by a first node, local locks of the first node associated with a metadata log transaction, wherein the first node acquires the local locks of the first node prior to sending a commit message to a second node;
• acquiring, by the second node, local locks of the second node associated with the metadata log transaction, wherein the second node acquires the local locks of the second node based upon, at least in part, receiving the commit message from the first node;
• acquiring a shared lock for all metadata pages involved with the metadata log transaction at the first node independently of whether all the metadata pages involved with the metadata log transaction at the first node is a cache hit or cache miss to avoid concurrent loading a same metadata page;
• and
• executing an atomic operation on a loading page associated with all the metadata pages involved with the metadata log transaction at the first node,
• wherein during a first time interval between when a metadata commit began on the first node and when the commit message is received by the second node, the first node has no access to locked data, and the second node sees old data,
• wherein during a second time interval when the second node is processing the metadata commit based upon, at least in part, the received commit message, both the first node and the second node have no access to the locked data, and
• wherein during a third time interval between when the metadata commit being done on the second node and when the metadata commit is completed on the first node, the first node has no access to the locked data, and the second node sees new data.

A computing system including one or more processors and one or more memories configured to perform operations comprising:

• acquiring, by a first node, local locks of the first node associated with a metadata log transaction, wherein the first node acquires the local locks of the first node prior to sending a commit message to a second node;
• acquiring, by the second node, local locks of the second node associated with the metadata log transaction, wherein the second node acquires the local locks of the second node based upon, at least in part, receiving the commit message from the first node;
• acquiring a shared lock for all metadata pages involved with the metadata log transaction at the first node independently of whether all the metadata pages involved with the metadata log transaction at the first node is a cache hit or cache miss to avoid concurrent loading a same metadata page;
• and
• executing an atomic operation on a loading page associated with all the metadata pages involved with the metadata log transaction at the first node,
• wherein during a first time interval between when a metadata commit began on the first node and when the commit message is received by the second node, the first node has no access to locked data, and the second node sees old data,
• wherein during a second time interval when the second node is processing the metadata commit based upon, at least in part, the received commit message, both the first node and the second node have no access to the locked data, and
• wherein during a third time interval between when the metadata commit being done on the second node and when the metadata commit is completed on the first node, the first node has no access to the locked data, and the second node sees new data.