US 10,897,514 B2Granted

Methods, devices, and computer program products for processing target data

AssigneeEMC IP Holding Company LLC

InventorsJunping Zhao, Kun Wang

Life of this patent

Estimating the term…

Loading patent…

Abstract

A target data processing method comprises: in response to receiving, from a client, a request for processing target data, obtaining, at a server and from a storage device, the target data, the target data being predetermined to be obtained by the client from the storage device and a first set of operations being predetermined to be performed on the target data; and processing, at the server, the target data by performing the first set of operations on the target data such that at least one dedicated processing resource of the server performs, on the processed target data, a second set of operations associated with the first set of operations. As such, the data moving path may be shortened significantly, the network traffic pressure may be reduced significantly, the efficiency of the target data processing system may be improved, and moreover, the number of dedicated processing resources in the server may be easily scaled.

Claims18

Dependent claims

A method of processing target data by a server comprising a first processing device and a plurality of dedicated processing devices that are different than the first processing device, the method comprising:

obtaining, from a client device, a request for processing target data for use in a machine learning operation, the request comprising an indication of at least one pre-processing process to be performed on the target data;
based at least in part on the obtained request for processing the target data, obtaining the target data from a storage device, the storage device comprising a repository of data for use in machine learning operations;
performing the at least one pre-processing process on the target data using the first processing device of the server to generate pre-processed data;
storing the pre-processed target data into a first dedicated processing device of the plurality of dedicated processing devices;
determining that a given dedicated processing device of the plurality of dedicated processing devices is specified to perform the at least one machine learning operation on the pre-processed data;
moving the pre-processed target data from the first dedicated processing device to the given dedicated processing device based at least in part on the determination that the given dedicated processing device of the plurality of dedicated processing devices is specified to perform the at least one machine learning operation on the pre-processed data;
performing at least one machine learning operation on the pre-processed data using the given dedicated processing device of the server to generate machine learning output data;
and
providing the generated machine learning output data to the client device.

6 more elements

A device for processing target data, comprising:

a first processing device;
a plurality of dedicated processing devices that are different than the first processing device;
at least one memory coupled to the first processing device and the dedicated processing devices and storing instructions to be executed by at least one of the first processing device and the dedicated processing devices, the instructions, when being executed by the at least one of the first processing device and the dedicated processing devices, causing the device to perform acts comprising:
obtaining, from a client device, a request for processing target data for use in a machine learning operation, the request comprising an indication of at least one pre-processing process to be performed on the target data;
based at least in part on the obtained request for processing the target data, obtaining the target data from a storage device, storage device comprising a repository of data for use in machine learning operations;
performing the at least one pre-processing process on the target data using the first processing device of the server to generate pre-processed data;
storing the pre-processed target data into a first dedicated processing device of the plurality of dedicated processing devices;
determining that a given dedicated processing device of the plurality of dedicated processing devices is specified to perform the at least one machine learning operation on the pre-processed data;
moving the pre-processed target data from the first dedicated processing device to the given dedicated processing device based at least in part on the determination that the given dedicated processing device of the plurality of dedicated processing devices is specified to perform the at least one machine learning operation on the pre-processed data;
and
performing at least one machine learning operation on the pre-processed data using the given dedicated processing device of the server to generate machine learning output data.

8 more elements

A method of processing target data, comprising:

determining, at a client device, whether target data is to be processed by the client device, the target data being predetermined to be obtained by the client device from a storage device comprising a repository of data for use in machine learning operations;
and
in response to determining that the target data is not to be processed by the client device, sending, from the client device to a server, a request for processing the target data, the request comprising an indication of at least one pre-processing process to be performed on the target data by the server, wherein the server is configurable, based at least in part on the request:
to obtain the target data from the storage device;
to perform the at least one pre-processing process on the target data using a first processing device of the server to generate pre-processed data;
to store the pre-processed target data into a first dedicated processing device of a plurality of dedicated processing devices of the server that are different than the first processing device;
to determine that a given dedicated processing device of the plurality of dedicated processing devices is specified to perform the at least one machine learning operation on the pre-processed data;
to move the pre-processed target data from the first dedicated processing device to the given dedicated processing device based at least in part on the determination that the given dedicated processing device of the plurality of dedicated processing devices is specified to perform the at least one machine learning operation on the pre-processed data;
and
to perform at least one machine learning operation on the pre-processed data using the given dedicated processing device of the server to generate machine learning output data;
and
obtaining, from the server, the generated machine learning output data;
wherein the method is performed by at least one processing device of the client device comprising at least one processor coupled to memory.

10 more elements

Dependencies are inferred from the claim text.

Facts

Application: 16/422,535Filed 24 May 2019
Priority: CN 2018 1 129095531 Oct 2018
Published: US 2020/0137184 A130 Apr 2020
Granted: 19 Jan 2021
Term ends: Not estimatedThe source records don’t support an estimate.

Classification10 codes

G06F 9/5027
To service a request: the resource being a machine, e.g. CPUs, Servers, Terminals
G06F 9/4843
Task transfer initiation or dispatching: by program, e.g. task dispatcher, supervisor, operating system
G06F 9/542
Interprogram communication: event management; Broadcasting; Multicasting; Notifications
G06F 18/2115
Selection of the most significant subset of features: by evaluating different subsets according to an optimisation criterion, e.g. class…