Adaptive batch processing method and system

A method performed by a system including a server which saves a model trained by machine learning and a client which transmits input data by connecting to the server while requesting an analysis result based on the model for the corresponding input data, respectively, the method comprising:

• measuring, by the server, an amount of available resources of the server and transmitting the measured amount of available resources to the client;
• calculating a batch size;
• generating batch data of a size reflecting the batch size by generating a queue of a plurality of input data in the client and transmitting the generated batch data to the server;
• and
• performing analysis based on the model on the batch data received from the server,
• wherein the batch size is calculated by multiplying a preset coefficient with a sum of (i) an amount of available resources multiplied by a first weight and (ii) an average size of input data multiplied by a second weight, the input data having been previously transmitted from the client to the server.

A system including a server which saves a model trained by machine learning and a client which transmits input data by connecting to the server while requesting an analysis result based on the model for the corresponding input data, the system comprising:

• a resource amount measurement processor configured to measure an amount of available resources of the server;
• a batch size calculation processor configured to calculate a batch size;
• a queue generation processor included in the client and configured to generate a queue of a plurality of input data in the client;
• a batch generation processor included in the client and configured to generate batch data reflecting the batch size in the generated queue;
• and
• a model analysis processor included in the server and configured to perform analysis on the batch data received from the client based on the model,
• wherein the batch size is configured to be calculated by multiplying a preset coefficient with a sum of (i) an amount of available resources multiplied by a first weight and (ii) an average size of input data multiplied by a second weight, the input data having been previously transmitted from the client to the server.