Machine learning device, control system, and machine learning method
AssigneeFanuc Corporation
InventorsRyoutarou Tsuneki, Satoshi Ikai, Takaki Shimoda
Life of this patent
Estimating the term…
Abstract
Setting of parameters that determine filter characteristics is facilitated. Machine learning of optimizing the coefficients of a filter provided in a motor control device that controls rotation of a motor for a machine tool, a robot, or an industrial machine is performed on the basis of measurement information of an external measuring instrument provided outside the motor control device and a control command input to the motor control device.
Claims8
A machine learning device that performs machine learning of optimizing coefficients of a filter provided outside a servo control unit and provided in a motor control device that controls the rotation of a motor on the basis of measurement information of an external measuring instrument provided outside the motor control device and a control command input to the motor control device, the machine learning device comprising:
- a state information acquisition unit that acquires state information including the measurement information, the control command, and the coefficients of the filter;
- an action information output unit that outputs action information including adjustment information of the coefficients included in the state information to the filter;
- a reward output unit that outputs a reward value for reinforcement learning using a value function based on a difference between the measurement information and the control command;
- and
- a value function updating unit that updates an action value function on the basis of the reward value output by the reward output unit, the state information, and the action information.
A machine learning method of a machine learning device that performs machine learning of optimizing coefficients of a filter provided outside a servo control unit and provided in a motor control device that controls the rotation of a motor on the basis of measurement information of an external measuring instrument provided outside the motor control device and a control command input to the motor control device, the machine learning method comprising:
- acquiring state information including the measurement information, the control command, and the coefficients of the filter;
- outputting action information including adjustment information of the coefficients included in the state information to the filter;
- outputting a reward value for reinforcement learning using a value function based on a difference between the measurement information and the control command;
- and
- updating an action value function on the basis of the reward value, the state information, and the action information.
Dependencies are inferred from the claim text.