Distributed database system and resource management method for distributed database system
AssigneeHitachi, Ltd.
InventorsToshiyuki Aritsuka, Kazushi Nakagawa, Kazuhisa Fujimoto
Life of this patent
Estimating the term…
Abstract
The data processing times of data processing nodes are heterogeneous, and hence the execution time of a whole system is not optimized. A task is executed using a plurality of optimal computing devices by distributing a data amount of data to be processed with a processing command of the task for the plurality of optimal computing devices depending on a difference in computing power between the plurality of optimal computing devices, to thereby execute the task in a distributed manner using the plurality of optimal computing devices.
Claims14
A distributed database system including one or more data processing nodes each including one or more computing devices configured to process data, the distributed database system comprising:
- a control unit operating within a processor and associated with a memory to:
- measure a computing power of each of the one or more computing devices of each of the one or more data processing nodes;
- determine for each of the one or more data processing nodes, one of the one or more computing devices with a highest computing power based on the computing power measured, and
- each of the one of the one or more computing devices with the highest computing power being an optimal computing device;
- determine, when a task is executed using the optimal computing devices, a processing data amount of the data to be processed with a processing command of the task for the optimal computing devices, such that each of the one or more data processing nodes executes the task in a timeframe, to thereby allow the task to be executed in a distributed manner using the plurality of optimal computing devices;
- generate partitions based on the processing data amount determined,
- determine a data amount, for distribution to each of the one or more data processing nodes;
- distribute data blocks to the partitions, based on the data amount determined;
- and
- execute, via the optimal computing devices, the task and process the data blocks distributed to the partitions.
A resource management method for a distributed database system including one or more data processing nodes each including one or more computing devices configured to process data and a control unit, the resource management method comprising:
- measuring, by the control unit, a computing power of each of the one or more computing devices of each of the one or more data processing nodes;
- determining, by the control unit, for each of the one or more data processing nodes, one of the one or more computing devices with a highest computing power based on the computing power measured, and each of the one of the one or more computing devices with the highest computing power being an optimal computing device;
- determining, by the control unit, when a task is executed using the optimal computing devices, a processing data amount of the data to be processed with a processing command of the task for the optimal processing devices, such that each of the one or more data processing nodes executes the task in a predetermined timeframe, to thereby allow the task to be executed in a distributed manner using the optimal computing devices;
- generating, by the control unit, partitions based on the processing data amount determined;
- determining, by the control unit, a data amount for distribution to each of the one or more data processing nodes;
- distributing, by the control unit, data blocks to the partitions based on the data amount determined;
- and
- executing, by the optimal computing devices, the task and processing the data blocks distributed to the partitions.
Dependencies are inferred from the claim text.