Apparatus and method for performing performance estimation of artificial intelligence based model considering device characteristics

A computer program stored in a non-transitory computer readable storage medium, wherein the computer program allows a computing device to perform following operations to provide estimated performance of an artificial intelligence (AI)-based model considering characteristic of a device, and wherein the operations comprise:

• receiving at least one of an AI-based target model or target model information corresponding to the target model, and receiving target device information corresponding to a target device;
• determining a target workload set including a plurality of workloads constituting the target model, based on at least one of the target model or the target model information;
• extracting a target performance predictor corresponding to the target device, wherein the target performance predictor includes characteristic of the target device related to a workload;
• and
• determining estimated performance when the target model is executed on the target device based on the target workload set and the target performance predictor;
• and
• wherein the extracting the target performance predictor corresponding to the target device comprises:
• determining whether the characteristic of the target device is dependent on pre-stored characteristics of other devices;
• and
• when it is determined that the characteristic of the target device is dependent on the pre-stored characteristics of the other devices, generating the target performance predictor by using a combination of performance predictors corresponding to the other devices.

A computing device for providing estimated performance of an artificial intelligence (AI)-based model considering characteristic of a device, comprising:

• at least one processor;
• and
• a memory,
• wherein the at least one processor:
• receives at least one of an AI-based target model or target model information corresponding to the target model, and receives target device information corresponding to a target device;
• determines a target workload set including a plurality of workloads constituting the target model, based on at least one of the target model or the target model information;
• extracts a target performance predictor corresponding to the target device, wherein the target performance predictor includes characteristic of the target device related to a workload;
• and
• determines estimated performance when the target model is executed on the target device based on the target workload set and the target performance predictor;
• and
• wherein the extracting the target performance predictor corresponding to the target device comprises:
• determining whether the characteristic of the target device is dependent on pre-stored characteristics of other devices;
• and
• when it is determined that the characteristic of the target device is dependent on the pre-stored characteristics of the other devices, generating the target performance predictor by using a combination of performance predictors corresponding to the other devices.