Adaptive fragment assignment for processing file data in a database
AssigneeInternational Business Machines Corporation
InventorsAndrey Balmin, Romulo Antonio Pereira Goncalves, Fatma Ozcan, Jonas Traub
Life of this patent
Estimating the term…
Abstract
Scheduling mechanisms for assigning data in a distributed file system to database workers are provided. In one embodiment, a method of and computer program product for assignment of data blocks to database workers are provided. A request for table data is received. Metadata for a plurality of blocks in a file system is retrieved from a metadata store. Each of the plurality of blocks contains a subset of the table data. A request for work is received from a requestor. An assignment of one or more of the plurality of blocks is provided to the requestor.
Claims20
A method comprising:
- storing, in a metadata store, metadata of a plurality of blocks of a file system;
- executing a process requiring data from at least one of the blocks of the file system;
- acquiring exclusive access to the at least one of the blocks;
- providing data from the at least one of the blocks to the process based on the metadata of the plurality of blocks.
A method comprising:
- receiving a request for table data;
- retrieving metadata for a plurality of blocks in a file system from a metadata store, each of the plurality of blocks containing a subset of the table data;
- receiving a request for work from a requestor;
- providing an assignment of one or more of the plurality of blocks to the requestor.
A computer program product for assigning data in a distributed file system to database workers, the computer program product comprising a computer readable storage medium having program instructions embodied therewith, the program instructions executable by a processor to cause the processor to perform a method comprising:
- receiving a request for table data;
- retrieving metadata for a plurality of blocks in a file system from a metadata store, each of the plurality of blocks containing a subset of the table data;
- receiving a request for work from a requestor;
- providing an assignment of one or more of the plurality of blocks to the requestor.
Dependencies are inferred from the claim text.