US 2026/0230526 A1 · DATA PROCESSING METHOD AND APPARATUS

Abstract

A data processing method and apparatus are provided. A computing cluster includes a plurality of computing nodes. The computing cluster is connected to a storage cluster. The storage cluster is configured to store data generated by the computing cluster. A plurality of processes of an application run on the plurality of computing nodes. Each process executes a part of data of the application. The method includes: obtaining N pieces of first to-be-written data of the plurality of processes; adjusting the N pieces of first to-be-written data to M pieces of second to-be-written data based on a first granularity of accessing data of the storage cluster, where a size of each piece of second to-be-written data is the first granularity, and the first granularity is determined based on an attribute of the storage cluster; and writing the M pieces of second to-be-written data into the storage cluster.

Claims12

Dependent claims

A data processing method applied to a computing cluster comprising a plurality of computing nodes, wherein the computing cluster is connected to a storage cluster configured to store data generated by the computing cluster, wherein a plurality of processes of an application run on the plurality of computing nodes, wherein each process executes a part of data of the application, and wherein the method comprises:

obtaining N pieces of first to-be-written data of the plurality of processes;
adjusting the N pieces of first to-be-written data to M pieces of second to-be-written data based on a first granularity of accessing data of the storage cluster, wherein a size of each piece of second to-be-written data is the first granularity, and the first granularity is determined based on an attribute of the storage cluster;
and
writing the M pieces of second to-be-written data into the storage cluster.

1 more element

A device comprising:

at least one processor;
and
a memory coupled to the at least one processor and configured to store instructions that, when executed by the at least one processor, cause the device to:
obtain N pieces of first to-be-written data of a plurality of processes;
adjust the N pieces of first to-be-written data to M pieces of second to-be-written data based on a first granularity of accessing data of the storage cluster,
wherein a size of each piece of second to-be-written data is the first granularity, and
wherein the first granularity is determined based on an attribute of a storage cluster;
and
write the M pieces of second to-be-written data into the storage cluster.

6 more elements

A computer-readable storage medium that stores a computer program or instructions and, when the computer program or the instructions are executed by a device, cause the device to:

obtain N pieces of first to-be-written data of a plurality of processes;
adjust the N pieces of first to-be-written data to M pieces of second to-be-written data based on a first granularity of accessing data of the storage cluster,
wherein a size of each piece of second to-be-written data is the first granularity, and
wherein the first granularity is determined based on an attribute of a storage cluster;
and
write the M pieces of second to-be-written data into the storage cluster.

3 more elements

Dependencies are inferred from the claim text.

Data processing method and apparatus

Life of this patent

Data processing method and apparatus

Life of this patent

Abstract

Claims12