File list generation method, system, and program, and file list generation device

A file list generation method, comprising the steps of:

• storing index information created about search target files into first storage means;
• copying a current directory tree of the search target files, and storing the copied current directory tree as a backup directory into second storage means;
• determining a dividing policy to divide a scan target directory scanning operation to be performed with a distributed server cluster, by acquiring directory URLs of the search target files from the index information stored in the first storage means, and counting the number of directories in each layer through analysis of the directory URLs, the scan target directory scanning operation being divided based on the result of the counting;
• dividing the backup directory of the search target files in accordance with the determined dividing policy;
• scanning, in a distributed manner, the search target files in respective directories in the backup directory of the current directory tree and a backup directory tree of search target files acquired prior to the determination of the divided policy and stored in third storage means, the scanning being performed with the distributed server cluster on the basis of division units determined in the determining the dividing policy;
• and
• comparing the results of the distributed scans, and creating and outputting a list of files that are added, deleted, or changed after the creation of the index information.

A file list generation system comprising:

• first storage means that stores index information created about search target files;
• dividing policy determination means that acquires directory URLs of the search target files from the index information stored in the first storage means, counts the number of directories in each layer through analysis of the directory URLs, and, based on the result of the counting, determines a dividing policy to divide a scan target directory scanning operation to be performed with a distributed server cluster;
• means that divides directories of the search target files in accordance with the determined dividing policy, acquires a snapshot of a current directory tree of scan target files, and stores the snapshot into second storage means;
• file scan means that scans, in a distributed manner, the search target files in respective directories in the snapshot of the current directory tree and a snapshot of a directory tree of search target files acquired prior to the determination of the divided policy and stored in third storage means, the scan being performed with the distributed server cluster on the basis of division units determined by the dividing policy determination means;
• and
• comparison means that compares the results of the distributed scans performed by the file scan means, and creates and outputs a list of files that are added, deleted, or changed after the creation of the index information.

A file list generation system comprising:

• first storage means that stores index information created about search target files;
• second storage means that copies a current directory tree of the search target files, and stores the copied current directory tree as a backup directory;
• dividing policy determination means that acquires directory URLs of the search target files from the index information stored in the first storage means, counts the number of directories in each layer through analysis of the directory URLs, and, based on the result of the counting, determines a dividing policy to divide a scan target directory scanning operation to be performed with a distributed server cluster;
• means that divides the backup directory of the search target files in accordance with the determined dividing policy;
• file scan means that scans, in a distributed manner, the search target files in respective directories in the backup directory of the current directory tree stored in the second storage means and a backup directory tree of search target files acquired prior to the determination of the divided policy and stored in third storage means, the scan being performed with the distributed server cluster on the basis of division units determined in the dividing policy determination means;
• and
• comparison means that compares the results of the distributed scans performed by the file scan means, and creates and outputs a list of files that are added, deleted, or changed after the creation of the index information.

A file list generation device comprising:

• dividing policy determination means that acquires directory URLs of search target files from index information created about the search target files and stored in first storage means, counts the number of directories in each layer through analysis of the directory URLs, and, based on the result of the counting, determines a dividing policy to divide a scan target directory scanning operation to be performed with a distributed server cluster;
• means that divides directories of the search target files in accordance with the determined dividing policy, acquires a snapshot of a current directory tree of scan target files, and stores the snapshot into second storage means;
• file scan means that scans, in a distributed manner, the search target files in respective directories in the snapshot of the current directory tree and a snapshot of a directory tree of search target files acquired prior to the determination of the divided policy and stored in third storage means, the scan being performed with the distributed server cluster on the basis of division units determined by the dividing policy determination means;
• and
• comparison means that compares the results of the distributed scans performed by the file scan means, and creates and outputs a list of files that are added, deleted, or changed after the creation of the index information.

A file list generation device comprising:

• first storage means that stores index information created about search target files;
• second storage means that copies a current directory tree of the search target files, and stores the copied current directory tree as a backup directory;
• dividing policy determination means that acquires directory URLs of the search target files from the index information stored in the first storage means, counts the number of directories in each layer through analysis of the directory URLs, and, based on the result of the counting, determines a dividing policy to divide a scan target directory scanning operation to be performed with a distributed server cluster;
• means that divides the backup directory of the search target files in accordance with the determined dividing policy;
• file scan means that scans, in a distributed manner, the search target files in respective directories in the backup directory of the current directory tree stored in the second storage means and a backup directory tree of search target files acquired prior to the determination of the divided policy and stored in third storage means, the scan being performed with the distributed server cluster on the basis of division units determined by the dividing policy determination means;
• and
• comparison means that compares the results of the distributed scans performed by the file scan means, and creates and outputs a list of files that are added, deleted, or changed after the creation of the index information.

A file list generation program used in a file list creation server that creates and outputs a list of files that are added, deleted, or changed after creation of index information,

• the program causing the file list creation server to function as:
• dividing policy determination means that acquires directory URLs of search target files from the index information created about the search target files and stored in first storage means, counts the number of directories in each layer through analysis of the directory URLs, and, based on the result of the counting, determines a dividing policy to divide a scan target directory scanning operation to be performed with a distributed server cluster;
• means that divides directories of the search target files in accordance with the determined dividing policy, acquires a snapshot of a current directory tree, and stores the snapshot into second storage means;
• file scan means that scans, in a distributed manner, the search target files in respective directories in the snapshot of the current directory tree and a snapshot of a directory tree of search target files acquired prior to the determination of the divided policy and stored in third storage means, the scan being performed with the distributed server cluster on the basis of division units determined by the dividing policy determination means;
• and
• comparison means that compares the results of the distributed scans performed by the file scan means, and creates and outputs a list of files that are added, deleted, or changed after the creation of the index information.

A file list generation program used in a file list creation server that creates and outputs a list of files that are added, deleted, or changed after creation of index information,

• the program causing the file list creation server to function as:
• means that stores a copy of a current directory tree of search target files as a backup directory into second storage means;
• dividing policy determination means that acquires directory URLs of the search target files from the index information created about the search target files and stored in first storage means, counts the number of directories in each layer through analysis of the directory URLs, and, based on the result of the counting, determines a dividing policy to divide a scan target directory scanning operation to be performed with a distributed server cluster;
• means that divides the backup directory of the search target files in accordance with the determined dividing policy;
• file scan means that scans, in a distributed manner, the search target files in respective directories in the backup directory of the current directory tree stored in the second storage means and a backup directory tree of search target files acquired prior to the determination of the divided policy and stored in third storage means, the scan being performed with the distributed server cluster on the basis of division units determined by the dividing policy determination means;
• and
• comparison means that compares the results of the distributed scans performed by the file scan means, and creates and outputs a list of files that are added, deleted, or changed after the creation of the index information.