Back to results
US 10,596,698 B2Granted
Machine learning device, robot control system, and machine learning method
AssigneeFanuc Corporation
InventorsYuusuke Oota, Fumikazu Warashina, Hiromitsu Takahashi
Life of this patent
Estimating the term…
Abstract
A machine learning device that acquires state information from a robot control inspection system. The system has a robot hand to hold a workpiece or camera. The state information includes a flaw detection position of the workpiece, a movement route of the robot hand, an imaging point of the workpiece, and the number of imaging by the camera. A reward calculator calculates a reward value in reinforcement learning based on flaw detection information including the flaw detection position. A value function updater updates an action value function by performing the reinforcement learning based on the reward value, the state information, and the action.
Claims10
A machine learning device for use with, and configured to perform reinforcement learning with respect to a robot control system,
- the robot control system comprising:
- an illumination means that irradiates a surface to be inspected of an object to be inspected with illumination light;
- an imaging means that images the surface to be inspected;
- a robot that includes a robot hand;
- a control unit that, while moving the robot hand gripping the object to be inspected or the imaging means, along a movement route including a plurality of imaging points set on the surface to be inspected so that the surface to be inspected is entirely covered by a plurality of images imaged by the imaging means, causes the imaging means to image the imaging points set on the surface to be inspected;
- and
- a flaw inspection unit that detects a flaw on the surface to be inspected on the basis of the image obtained by imaging the surface to be inspected by the imaging means,
- the machine learning device comprising:
- an action information output unit that outputs action information including adjustment information of the imaging region including the imaging points, to the control unit;
- a state information acquisition unit that acquires state information from the control unit and the flaw inspection unit resulting from a number N of images, obtained by imaging the surface to be inspected by the imaging means by moving the robot hand gripping the object to be inspected or the imaging means by the control unit, based on the action information, the state information including the number N and flaw detection information, the flaw detection information including a flaw detection position of the surface to be inspected, detected by the flaw inspection unit, with respect to each of a plurality of objects to be inspected prepared in advance;
- a reward output unit that outputs a reward value in the reinforcement learning based on the number N and the flaw detection information including the flaw detection positions included in the state information;
- and
- a value function updating unit that updates an action value function based on the reward value, the state information, and the action information.
10 more elements
A machine learning method by a machine learning device that performs reinforcement learning with respect to a robot control system,
- the robot control system comprising:
- an illumination means that irradiates a surface to be inspected of an object to be inspected with illumination light;
- an imaging means that images the surface to be inspected;
- a robot that includes a robot hand;
- a control unit that, while moving the robot hand gripping the object to be inspected or the imaging means, along a movement route including a plurality of imaging points set on the surface to be inspected so that the surface to be inspected is entirely covered by a plurality of images imaged by the imaging means, causes the imaging means to image the imaging points set on the surface to be inspected;
- and
- a flaw inspection unit that detects a flaw on the surface to be inspected on the basis of the image obtained by imaging the surface to be inspected by the imaging means,
- the machine learning method comprising:
- an action information output step of outputting action information including adjustment information of the imaging region including the imaging points, to the control unit;
- a state information acquisition step of, with respect to each of a plurality of objects to be inspected prepared in advance, moving the robot hand gripping the object to be inspected or the imaging means by the control unit on the basis of the action information, and acquiring state information from the control unit and the flaw inspection unit resulting from a number N of images, obtained by imaging the surface to be inspected by the imaging means by moving the robot hand gripping the object to be inspected or the imaging means by the control unit, based on the action information, the state information including the number N and flaw detection information, the flaw detection information including a flaw detection position detected by the flaw inspection unit, and the number of imaging, on the basis of an image obtained by imaging the surface to be inspected by the imaging means;
- a reward output step of outputting a reward value in the reinforcement learning based on the number N and the flaw detection information including the flaw detection positions included in the state information;
- and
- a value function updating step of updating an action value function based on the reward value, the state information, and the action information.
10 more elements
Dependencies are inferred from the claim text.