Machine learning device, industrial machine cell, manufacturing system, and machine learning method for learning task sharing among plurality of industrial machines

A machine learning device for performing a task using a plurality of industrial machines and learning task sharing for the plurality of industrial machines, the device comprising:

• a processor configured to
• observe state variables of the plurality of industrial machines, and
• learn task sharing for the plurality of industrial machines, on the basis of the observed state variables,
• wherein when one of the plurality of industrial machines stops and the task is shared by other industrial machines of the plurality of industrial machines, the processor is configured to observe a change in a volume of production by the plurality of industrial machines and observe a task load on the stopped one of the plurality of industrial machines as zero, and
• the plurality of industrial machines perform the task based on the learned task sharing,
• wherein
• the processor is configured to observe the state variables including
• a task time from start to end of a series of tasks repeatedly performed by the plurality of industrial machines, and
• a task load on each of the plurality of industrial machines in an interval from the start to the end of the series of task, the task load being a power consumption of said each of the plurality of industrial machines, and
• the processor is configured to
• set a negative reward when the observed task load exceeds a predetermined allowable range,
• set a positive reward when the observed task time is shortened,
• set no reward when the observed task time is not shortened, and
• update a value function for determining a value of task sharing for the plurality of industrial machines on the basis of the observed state variables and the reward.

A machine learning method for performing a task using a plurality of industrial machines and learning task sharing for the plurality of industrial machines, the method comprising:

• observing state variables of the plurality of industrial machines;
• learning task sharing for the plurality of industrial machines, on the basis of the observed state variables;
• and
• when one of the plurality of industrial machines stops and the task is shared by other industrial machines of the plurality of industrial machines,
• observing a change in a volume of production by the plurality of industrial machines and observing a task load on the stopped one of the plurality of industrial machines as zero,
• wherein
• the plurality of industrial machines perform the task based on the learned task sharing,
• said observing comprises observing the state variables including
• a task time from start to end of a series of tasks repeatedly performed by the plurality of industrial machines, and
• a task load on each of the plurality of industrial machines in an interval from the start to the end of the series of task, the task load being a power consumption of said each of the plurality of industrial machines, and
• the method further comprises
• setting a negative reward when the observed task load exceeds a predetermined allowable range,
• setting a positive reward when the observed task time is shortened,
• setting no reward when the observed task time is not shortened, and
• updating an action value table that determines a value of work sharing for the plurality of industrial machines based on the reward.