Storage media deployment mode based big data distributed processing method, device, and system

A control device for controlling a computing device to perform big data distributed processing, wherein the computing device is equipped with storage media in a plurality of deployment modes, and the control device comprises:

• a memory, configured to store a set of computer instructions;
• and
• at least one processor, configured to execute the set of computer instructions to:
• obtain a service request for a big data service, wherein the service request comprises service data;
• determine at least one deployment mode from the plurality of deployment modes for the storage media, wherein the plurality of deployment modes include a local deployment mode, a converged deployment mode, and a separated deployment mode, wherein the storage media in the plurality of deployment modes comprise at least two of a local storage medium in the computing device, a global storage medium formed based on the local storage medium, an extended global storage medium, or an extended local storage medium, wherein the global storage medium is accessible to all computing devices controlled by the control device, and wherein in the local deployment mode the storage media include the local storage medium, in the converged deployment mode the storage media include the global storage medium, and in the separated deployment mode the storage media include the extended global storage medium and the extended local storage medium;
• and
• send a control indication to the computing device, wherein the control indication indicates the computing device to execute a map task in the big data distributed processing on the service data, and indicates the computing device to store obtained intermediate data in the storage media in the at least one deployment mode.

A system, comprising:

• a control device;
• and
• a computing device,
• wherein the control device is configured to:
• obtain a service request for a big data service, wherein the service request comprises service data;
• determine at least one deployment mode from a plurality of deployment modes for the storage media, wherein the plurality of deployment modes include a local deployment mode, a converged deployment mode, and a separated deployment mode, wherein the storage media in the plurality of deployment modes comprise at least two of a local storage medium in the computing device, a global storage medium formed based on the local storage medium, an extended global storage medium, or an extended local storage medium, wherein the global storage medium is accessible to all computing devices controlled by the control device, and wherein in the local deployment mode the storage media include the local storage medium, in the converged deployment mode the storage media include the global storage medium, and in the separated deployment mode the storage media include the extended global storage medium and the extended local storage medium;
• and
• send a control indication to the computing device, wherein the control indication indicates the computing device to execute a map task in the big data distributed processing on the service data, and indicates the computing device to store obtained intermediate data in the storage media in the at least one deployment mode;
• and wherein the computing device is configured to:
• execute the map task sent by the control device to obtain the intermediate data;
• and
• store the intermediate data in the storage media indicated by identifiers of the storage media in the at least one deployment mode.