Method, device, and computer program product for job processing

An electronic device, comprising:

• at least one processor;
• and
• a memory coupled to the at least one processor, the memory having instructions stored thereon, the instructions, when executed by the at least one processor, causing the electronic device to perform acts for processing a job using a plurality of processing devices in a distributed processing system, each processing device having a processing resource comprising at least one of a computing resource and a storage resource, the acts including:
• obtaining a first group of tasks in a first portion of the job, the job having a time limitation for indicating a time when a job result is desired to be completed, the first group of tasks being executable in parallel;
• setting a respective priority to each processing device of the plurality of processing devices based on a state of a processing resource of the processing device wherein the priority of each processing device is set based on a time duration for which the processing devices can process one or more tasks associated with the job within the time limitation;
• selecting a first group of processing devices from the plurality of processing devices based on the respective priorities, the first group of processing devices including one or more processing devices in each of at least first and second distinct processing systems, the first processing system comprising a cloud-based processing system and the second processing system comprising a blockchain-based processing system;
• and
• allocating the first group of tasks to the first group of processing devices, respectively, so that the first group of processing devices utilize their respective processing resources to process the first group of tasks for generating a first group of task results;
• wherein allocating the first group of tasks to the first group of processing devices, respectively comprises:
• generating a first group of data partitions associated with the first group of tasks, respectively, based on raw data associated with the job;
• storing the first group of data partitions to storage resources in the first group of processing devices;
• and
• instructing the first group of processing devices to obtain the first group of data partitions from the storage resources in the first group of processing devices;
• wherein setting a respective priority to each processing device of the plurality of processing devices based on a state of a processing resource of the processing device comprises:
• setting a long-term priority to at least one of the processing devices in accordance with determining that a processing resource of the processing device is usable to process a plurality of tasks associated with the job, the long-term priority being based on the processing device not refusing to execute any task associated with the job;
• wherein the first group of task results comprises one or more task results generated by one or more processing devices of the blockchain-based processing system;
• and
• wherein the one or more task results generated by the one or more processing devices of the blockchain-based processing system are subject to a multi-level verification process comprising at least a first level in which a verification determination is made as to whether or not the one or more task results are trusted and a second level in which, responsive to the verification determination indicating that the one or more task results are not trusted, voting of multiple processing devices of the blockchain-based processing system is utilized to determine if at least a threshold number of the processing devices vote in a particular manner.

A computer program product, tangibly stored on a non-transitory computer-readable medium and comprising machine-executable instructions, which when executed by a processor of an electronic device, cause the electronic device to perform steps of a method for processing a job using a plurality of processing devices in a distributed processing system, each processing device having a processing resource comprising at least one of a computing resource and a storage resource, the method comprising:

• obtaining a first group of tasks in a first portion of the job, the job having a time limitation for indicating a time when a job result is desired to be completed, the first group of tasks being executable in parallel;
• setting a respective priority to each processing device of the plurality of processing devices based on a state of a processing resource of the processing device, wherein the priority of each processing device is set based on a time duration for which the processing devices can process one or more tasks associated with the job within the time limitation;
• selecting a first group of processing devices from the plurality of processing devices based on the respective priorities, the first group of processing devices including one or more processing devices in each of at least first and second distinct processing systems, the first processing system comprising a cloud-based processing system and the second processing system comprising a blockchain-based processing system;
• and
• allocating the first group of tasks to the first group of processing devices, respectively, so that the first group of processing devices utilize their respective processing resources to process the first group of tasks for generating a first group of task results;
• wherein allocating the first group of tasks to the first group of processing devices, respectively comprises:
• generating a first group of data partitions associated with the first group of tasks, respectively, based on raw data associated with the job;
• storing the first group of data partitions to storage resources in the first group of processing devices;
• and
• instructing the first group of processing devices to obtain the first group of data partitions from the storage resources in the first group of processing devices;
• wherein setting a respective priority to each processing device of the plurality of processing devices based on a state of a processing resource of the processing device comprises:
• setting a long-term priority to at least one of the processing devices in accordance with determining that a processing resource of the processing device is usable to process a plurality of tasks associated with the job, the long-term priority being based on the processing device not refusing to execute any task associated with the job;
• wherein the first group of task results comprises one or more task results generated by one or more processing devices of the blockchain-based processing system;
• and
• wherein the one or more task results generated by the one or more processing devices of the blockchain-based processing system are subject to a multi-level verification process comprising at least a first level in which a verification determination is made as to whether or not the one or more task results are trusted and a second level in which, responsive to the verification determination indicating that the one or more task results are not trusted, voting of multiple processing devices of the blockchain-based processing system is utilized to determine if at least a threshold number of the processing devices vote in a particular manner.