Method and a system for applying machine learning to an application

A system for applying machine learning to an application, comprising:

• a learner configured to generate learning policies, wherein the candidate policy describes a mapping of states to a set of candidate parameters;
• at least one real application;
• at least one simulated application;
• a manager, configured to assign the set of candidate parameters to the at least one simulated application based on the candidate policy and the states;
• a program configured to be executed, by a processor, in the at least one simulated application based on a set of candidate parameters provided based on the candidate policy and a state of the at least one simulated application,
• the program being configured to provide interim results of tested sets of candidate parameters based on a measured performance information of the execution of the program,
• wherein the set of candidate parameters are requested by the at least one simulated application together with providing the state of the at least one simulated application, wherein the program is configured to be executed simultaneously in the at least one simulated application and in the at least one real application based on the set of candidate parameters, wherein the at least one real application comprising a real robot application;
• a trainer configured to collect a predetermined number of interim results, the trainer being configured to provide an end result based on a combination of the candidate parameters and the states with the measured performance information, wherein the learner is configured to generate a new candidate policy based on the end result using machine learning algorithms;
• and
• a sensor configured to acquire reality data while the program is executed in the at least one real application, wherein the sensor is placed in a real-world environment, and wherein the at least one simulated application is configured to be modified based on the reality data.

A tangible, non-transitory computer readable medium for applying machine learning to an application, the computer readable medium having instructions thereon, which, upon being executed by the one or more processors, provides for execution of the following steps:

• a) generating a candidate policy, by a learner, wherein the candidate policy describes a mapping of states to a set of candidate parameters;
• b) assigning the set of candidate parameters to at least one simulated application based on the candidate policy and the states by at least one manager;
• c) executing a program in the at least one simulated application based on a set of candidate parameters provided based on the candidate policy and a state of the at least one simulated application,
• the execution of the program providing interim results of tested sets of candidate parameters based on a measured performance information of the execution of the program,
• wherein the set of candidate parameters are requested by the at least one simulated application together with providing the state of the at least one simulated application,
• wherein the program is executed simultaneously in the at least one simulated application and in at least one real robot application,
• wherein reality data of the machine is acquired while executing the program in the at least one real application, and
• wherein the at least one simulated application is modified based on the reality data, wherein the reality data is acquired using a sensor placed in a real-world environment;
• d) collecting a predetermined number of interim results and providing an end result based on a combination of the candidate parameters and the states with the measured performances information by a trainer;
• and
• e) generating a new candidate policy by the learner based on the end result using machine learning algorithms.