Calculation scheme decision system, calculation scheme decision device, calculation scheme decision method, and storage medium

A method performed by a mobile terminal or a camera, the method comprising:

• processing input data with a calculation scheme prepared in advance, wherein the input data is an image and the calculation scheme uses a neural network;
• generating a results list in which a layer, a calculation scheme, and an arithmetic operation are associated with each other based on a time required for calculation and a memory resource required for calculation;
• specifying, based on the results list, a calculation scheme, for each layer, of which a calculation cost is the smallest;
• performing the calculation for each of the respective layers of the network structure on the input data in the execution environment using the calculation scheme;
• and
• outputting a recognition result, wherein the recognition result includes an estimate of a content of the image.

A non-transitory computer readable storage medium for storing a calculation scheme decision program causing a computer to operate,

• the program causing the computer to function as:
• a pre-calculation unit configured to perform, in an execution environment in which calculation for processing input data is performed using a network structure and weight data, calculation for each of respective layers of the network structure on predetermined data using at least one of calculation schemes prepared in advance for the respective layers of the network structure;
• a cost acquisition unit configured to acquire a calculation cost of the at least one calculation scheme for each of the respective layers of the network structure based on a result of the calculation by the pre-calculation unit;
• a decision unit configured to select one calculation scheme for each of the respective layers of the network structure based on the calculation cost from among the at least one of the calculation schemes prepared in advance for the respective layers to associate the layer of the network structure with the selected one calculation scheme;
• and
• a calculation unit configured to perform the calculation for each of the respective layers of the network structure on the input data in the execution environment using the calculation scheme associated with each layer of the network structure by the decision unit.

A non-transitory computer readable storage medium for storing a calculation scheme decision program causing a computer to operate,

• the program causing the computer to function as:
• a data acquisition unit configured to acquire, from a processing device in which calculation for processing input data is performed using a network structure and weight data, a calculation cost in a case of calculating, for each of respective layers of the network structure, in at least one of calculation schemes prepared in advance for the respective layers of the network structure;
• and
• a decision unit configured to select one calculation scheme for each of the respective layers of the network structure based on the calculation cost from among the at least one of the calculation schemes prepared in advance for the respective layers to associate the layer of the network structure with the selected one calculation scheme.