A reinforcement learning method implemented with a first-type environment parameter obtaining unit, a control parameter value calculation unit, a control parameter value output unit, a second-type environment parameter obtaining unit, a virtual external force calculation unit, and a virtual external force output unit, with a reward function for outputting a reward and a virtual external force function for outputting a virtual external force stored in a storage medium, the method comprising:
- a first-type environment parameter obtaining step of obtaining, with the first-type environment parameter obtaining unit, a value of one or more first-type environment parameters relating to an environment of a moving control object;
- a control parameter value calculation step of calculating, with the control parameter value calculation unit, a value of one or more control parameters maximizing a reward that is output by the reward function by substituting the value of the one or more first-type environment parameters and the virtual external force into the reward function;
- a control parameter value output step of outputting, with the control parameter value output unit, the value of the one or more control parameters to the control object;
- a second-type environment parameter obtaining step of obtaining, with the second-type environment parameter obtaining unit, a value of one or more second-type environment parameters relating to the virtual external force;
- a virtual external force calculation step of calculating, with the virtual external force calculation unit, the virtual external force by substituting the value of the one or more second-type environment parameters into the virtual external force function;
- and
- a virtual external force output step of outputting, with the virtual external force output unit, the virtual external force to the control object.