Scalable file management for a shared file system
AssigneeInternational Business Machines Corporation
InventorsMarc A. Kaplan, Wayne A. Sawdon
Life of this patent
Estimating the term…
Abstract
Managing a shared file system comprising a directory and files stored on a multiple storage devices shared by plural processing nodes, is provided. A plurality of parallel directory traversal records are partitioned into a plurality of ranges to allow for the records in each range to be written independently in parallel by plural processing nodes during parallel directory traversal. Parallel operations are performed comprising parallel directory traversal of all directory paths and files in the shared file system.
Claims20
A method for managing a shared file system, comprising:
- performing traversal by multiple processing nodes in parallel of all directory paths and files in shared directories in the shared file system;
- partitioning identified directory traversal records into ranges for the records in each range to be written independently in parallel by the multiple processing nodes;
- scanning file inodes in parallel, each inode comprising file attributes of files stored in said shared directories and is assigned an inode number, and each range is assigned a range number;
- mapping each inode number to a range number using a mapping function;
- and
- performing parallel execution threads in one or more processing node.
A computer program product for managing a shared file system, the computer program product comprising a computer readable storage medium having computer usable program code embodied therewith, the program code readable/executable by one or more processing nodes to:
- perform directory traversal, by multiple processing nodes, in parallel of all directory paths and files in shared directories in the shared file system;
- partition, by the multiple processing nodes, identified directory traversal records into ranges for the records in each range to be written independently in parallel by the multiple processing nodes;
- scan, by the multiple processing nodes, file inodes in parallel, each inode comprising file attributes of files stored in said shared directories and is assigned an inode number, and each range is assigned a range number;
- map, by the multiple processing indoes, each inode number to a range number using a mapping function;
- and
- perform, by the multiple processing nodes, parallel execution threads.
A system for managing a shared file system, comprising:
- a plurality of storage nodes;
- and
- a plurality of processing nodes coupled to the information storage nodes, each processing node performs traversal in parallel of all directory paths and files in shared directories of the file system, partitions identified directory traversal records into ranges for the records in each range to be written independently in parallel by the plurality of processing nodes, scan file inodes in parallel by the plurality of processing nodes, each inode comprising file attributes stored in said shared directories, each inode is assigned an inode number, and each range is assigned a range number, and map each inode number to a range number using a mapping function.
Dependencies are inferred from the claim text.