File I/O control method
AssigneeHitachi, Ltd.
InventorsKouji Sonoda, Naoki Utsunomiya, Hiroyuki Kumazaki, Toshiya Kurakake
Life of this patent
Estimating the term…
Loading patent…
AssigneeHitachi, Ltd.
InventorsKouji Sonoda, Naoki Utsunomiya, Hiroyuki Kumazaki, Toshiya Kurakake
Estimating the term…
In collective I/O processing in which a plurality of processes access the same file in a shared manner, when each user process issues an I/O request, the user process notifies the system of information on a file region accessed by all the processes; information for specifying whether or not a prefetch is performed, and information for specifying whether or not a disk preallocate is performed, together with the I/O requests issued by all associated processes, as hint information. The system provides a buffer for storing data in a file region accessed by all the processes based on the hint information, such that the I/O processing for all the processes is performed using this buffer.
A file I/O control method for use by a plurality of processes to access the same file in a shared manner, comprising the steps of:
A file management server for enabling a plurality of processes to access the same file in a shared manner, comprising:
A file I/O control method in a parallel computing system having a plurality of computing nodes and at least one I/O node, said method comprising the steps of:
A file I/O control method in a parallel computing system having a plurality of computing nodes and at least one I/O node, said method comprising the steps of:
A file I/O control method in a parallel computing system having a plurality of computing nodes and at least one I/O node, said method comprising the steps of:
Dependencies are inferred from the claim text.
Drawings are temporarily unavailable. Open the PDF at USPTO
From the US filing history. Foreign family members aren’t listed.
Organizing or formatting or addressing of data: management of files
Specifically adapted to achieve a particular effect: improving I/O performance
Vertical data movement, i.e. input-output transfer; data movement between one or more hosts and one or more storage devices: data buffering…
Plurality of storage devices: disk arrays, e.g. RAID, JBOD
Term ended 22 May 2022 (estimated)
The present invention relates to a file I/O control method, a file management server, and a parallel computing system, and more particularly, to a file I/O control method, a file management server, and a parallel computing system for use in a parallel computer which operates a plurality of processes in concert for performing computations.
Parallel computing which initiates a plurality of processes on a parallel computer and operates the plurality of processes in concert for performing computations often employs an SPMD (Single Program Multiple Data stream) model in which all processes execute the same program codes to operate different data from one another. Since all the processes execute the same program codes in this model, I/O requests are often issued from all the processes substantially at the same timing. Particularly, the processing in a parallel program for scientific computations involves array data stored in files for use in the processing, so that the same array data is often divided into sub-regions among a plurality of processes. In this event, a certain process will have an access to data in a particular row or column. Such data in a particular row or column is typically arranged on a file in a noncontiguous manner. For this reason, a file access pattern of each process in a parallel program as mentioned above includes an access to a noncontiguous region.
“Dynamic file-access characteristics of a production parallel scientific workload”, David Kots, Song Bac Tho, and Sriram Radhakrishanan, Proceedings of Supercomputing '94, pp. 640-649, November 1994 (hereinafter, Kots-94) points out the following two problems which are experienced by a program that has a file access pattern as mentioned above, when it issues an I/O request using a conventional UNIX interface.
FIG. 1 is a block diagram illustrating the configuration of a parallel computing system to which the present invention is applied;
FIGS. 2A, 2B and 2C are diagrams for explaining the relationship between array data serviced by each user process, a parallel file which stores the array data, and a stripe file on each disk which stores each block of the parallel file;
FIG. 3 is a diagram for explaining a collective I/O interface employed by each user process which is used in a first embodiment of the present invention;
In the following, embodiments of a file I/O control method, a file management server, and a parallel computing system according to the present invention will be described in detail in connection with the accompanying drawings.
FIG. 1 is a block diagram illustrating the configuration of a parallel computing system to which the present invention is applied.
The illustrated parallel computing system comprises a plurality of computing nodes 1100, 1200, 1300, 1400; and a plurality of I/O nodes 1500, 1600, 1700, 1800 which are interconnected through a network 1900. Each of the computing nodes and I/O nodes comprises a processor 1130, 1230, 1330, 1430, 1530, 1630, 1730, 1830 and a memory 1140, 1240, 1340, 1440, 1540, 1640, 1740, 1840.