Back to results
US 10,317,854 B2Granted
Machine learning device that performs learning using simulation result, machine system, manufacturing system, and machine learning method
AssigneeFanuc Corporation
InventorsHiroshi Nakagawa, Takafumi Kajiyama
Life of this patent
Estimating the term…
Abstract
A machine learning device that learns a control command for a machine by machine learning, including a machine learning unit that performs the machine learning to output the control command; a simulator that performs a simulation of a work operation of the machine based on the control command; and a first determination unit that determines the control command based on an execution result of the simulation by the simulator.
Claims12
A machine learning device that learns a control command for a machine by machine learning, comprising:
- a machine learning unit that performs the machine learning to output the control command;
- a simulator that performs a simulation of a work operation of the machine based on the control command;
- and
- a first determination unit that determines the control command based on an execution result of the simulation by the simulator,
- wherein the first determination unit
- determines that the control command is good and performs inputting of the control command to the machine when there is no problem in the execution result of the simulation, and
- determines that the control command is bad and stops the inputting of the control command to the machine when there is a problem in the execution result of the simulation, and
- wherein when a determination result by the first determination unit is bad,
- the inputting of the control command to the machine is stopped, and
- learning is performed by providing a first result label obtained from the first determination unit to the machine learning unit as training data.
7 more elements
A machine learning device that learns a control command for a machine by machine learning, comprising:
- a machine learning unit that performs the machine learning to output the control command;
- a simulator that performs a simulation of a work operation of the machine based on the control command;
- and
- a first determination unit that determines the control command based on an execution result of the simulation by the simulator,
- wherein the first determination unit
- determines that the control command is good and performs inputting of the control command to the machine when there is no problem in the execution result of the simulation, and
- determines that the control command is bad and stops the inputting of the control command to the machine when there is a problem in the execution result of the simulation,
- wherein the machine learning device further comprises a second determination unit that determines a work result of the machine by the control command, and
- wherein when a determination result by the first determination unit is good,
- inputting of the control command to the machine is performed, and
- learning is performed by providing a second result label obtained from the second determination unit to the machine learning unit as training data.
8 more elements
A machine learning device that learns a control command for a machine by machine learning, comprising:
- a machine learning unit that performs the machine learning to output the control command;
- a simulator that performs a simulation of a work operation of the machine based on the control command;
- and
- a first determination unit that determines the control command based on an execution result of the simulation by the simulator,
- wherein the first determination unit
- determines that the control command is good and performs inputting of the control command to the machine when there is no problem in the execution result of the simulation, and
- determines that the control command is bad and stops the inputting of the control command to the machine when there is a problem in the execution result of the simulation, and
- wherein
- a state of the machine learning unit is preserved as a first state regularly or when a pre-specified condition is satisfied, and
- the state of the machine learning unit is returned to the first state when a frequency that the determination result by the first determination unit becomes good decreases.
7 more elements
A machine learning device that learns a control command for a machine by machine learning, comprising:
- a machine learning unit that performs the machine learning to output the control command;
- a simulator that performs a simulation of a work operation of the machine based on the control command;
- and
- a first determination unit that determines the control command based on an execution result of the simulation by the simulator,
- wherein the first determination unit
- determines that the control command is good and performs inputting of the control command to the machine when there is no problem in the execution result of the simulation, and
- determines that the control command is bad and stops the inputting of the control command to the machine when there is a problem in the execution result of the simulation, and
- wherein when the determination result by the first determination unit takes three or more states including good and bad, a command speed of the machine included in the control command is changed based on the state.
5 more elements
A machine learning device that learns a control command for a machine by machine learning, comprising:
- a machine learning unit that performs the machine learning to output the control command;
- a simulator that performs a simulation of a work operation of the machine based on the control command;
- and
- a first determination unit that determines the control command based on an execution result of the simulation by the simulator,
- wherein the first determination unit
- determines that the control command is good and performs inputting of the control command to the machine when there is no problem in the execution result of the simulation, and
- determines that the control command is bad and stops the inputting of the control command to the machine when there is a problem in the execution result of the simulation, and
- wherein the machine learning unit comprises:
- a reward calculation unit that calculates a reward based on a work state of the machine;
- and
- a value function updating unit having a value function that determines a value for the control command and updating the value function based on the reward.
8 more elements
Dependencies are inferred from the claim text.