Data verification method and apparatus, and storage medium
AssigneeAlibaba Group Holding Limited
InventorsPingfan Song, Yuesheng Gu
Life of this patent
Estimating the term…
Abstract
A method including determining a to-be-verified data block among a plurality of data blocks corresponding to a predetermined file in a distributed storage system, wherein a storage node where the to-be-verified data block is located comprises a storage node that meets a load balancing strategy in the distributed storage system; and verifying the to-be-verified data block. The present disclosure solves the technical problem in the conventional technologies in which the read/write performance at a user front end is affected during a data verification process.
Claims20
A method comprising:
- determining a to-be-verified data block among a plurality of data blocks corresponding to a predetermined file in a distributed storage system, the to-be-verified data block being stored in a storage node that meets a load balancing strategy in the distributed storage system, the determining the to-be-verified data block among the plurality of data blocks corresponding to the predetermined file in the distributed storage system including selecting a first data block from the plurality of data blocks as the to-be-verified data block, the first data block being a data block stored in storage nodes, where replicas of the data block are located, among which a number of first storage nodes reaches a predetermined number;
- and
- verifying the to-be-verified data block.
An apparatus comprising:
- one or more processors;
- and
- one or more memories storing thereon computer-readable instructions that, when executed by the one or more processors, cause the one or more processors to perform acts comprising:
- determining a to-be-verified data block among a plurality of data blocks corresponding to a predetermined file in a distributed storage system, the to-be-verified data block being stored in a storage node that meets a load balancing strategy in the distributed storage system, the determining the to-be-verified data block among the plurality of data blocks corresponding to the predetermined file in the distributed storage system including selecting a first data block from the plurality of data blocks as the to-be-verified data block, the first data block being a data block stored in storage nodes, where replicas of the data block are located, among which a number of first storage nodes reaches a predetermined number, the first storage nodes being storage nodes on which a number of verification tasks has not reached an upper limit of verification tasks;
- and
- verifying the to-be-verified data block.
One or more memories storing thereon computer-readable instructions that, when executed by one or more processors, cause the one or more processors to perform acts comprising:
- determining a to-be-verified data block among a plurality of data blocks corresponding to a predetermined file in a distributed storage system, the to-be-verified data block being stored in a storage node that meets a load balancing strategy in the distributed storage system;
- and
- verifying the to-be-verified data block, the verifying the to-be-verified data block including:
- performing a secondary slicing on the to-be-verified data block to obtain a data block slice;
- determining that a number of verification requests on the storage node where the data block slice is located has not reached an upper limit of verification requests according to a second mapping table, the second mapping table storing a corresponding relationship between an address of the storage node and the number of verification requests that access the storage node;
- and
- verifying the data block slice.
Dependencies are inferred from the claim text.