Robot system and picking method

A robot system comprising:

• a robot mechanism that has a plurality of fingers that grasp a workpiece;
• a sensor that detects a grasped state of the workpiece by the plurality of fingers;
• a control device including a processor:
• that recognizes a number of workpieces grasped by the plurality of fingers, based on detection results of the sensor;
• and
• that, after causing the robot mechanism to perform an operation of grasping the workpiece from a placement place at which a plurality of the workpieces are placed, in a case in which the number of workpieces recognized by the control device differs from a designated number that is designated in advance, controls movement of the robot mechanism such that the number of workpieces that are grasped becomes the designated number,
• wherein the sensor includes a pressure distribution sensor that is provided at a grasping surface of at least one finger and that detects a pressure distribution of the grasping surface that the workpiece contacts,
• wherein the control device recognizes the number of workpieces by a grasped number recognition model that is learned by using, as an input, the pressure distribution detected by the sensor, and, as an output, the number of workpieces grasped by the plurality of fingers,
• wherein the control device controls the movement of the robot mechanism based on a driving method outputted from a driving method model that is learned by using, as inputs, the pressure distribution and a driving state of a driving section that drives the plurality of fingers, and, as outputs, the number of workpieces grasped by the plurality of fingers and the driving method of the driving section for making the number of workpieces be the designated number,
• wherein the control device controls the movement of the robot mechanism so as to, in a state in which the workpiece is grasped by the plurality of fingers, repeat moving of at least one finger of the plurality of fingers in at least one direction among a first direction that is a direction of movement for grasping, a second direction that intersects the first direction and a longitudinal direction of the finger, a third direction that is the longitudinal direction of the finger, or a rotation direction of rotating with the third direction being a rotation axis, until the number of workpieces recognized by the control device becomes the designated number, and
• wherein when at least one finger of the plurality of fingers is moved in the first direction, other fingers of the plurality of fingers that are not the at least one finger of the plurality of fingers move in the first direction following movement of the at least one finger of the plurality of fingers, and when the at least one finger of the plurality of fingers is moved in the second direction, the other fingers do not move in the second direction following the movement of the at least one finger of the plurality of fingers.

A picking method comprising:

• detecting a grasped state of a workpiece by a plurality of fingers of a robot mechanism that has the plurality of fingers that grasp a workpiece;
• recognizing a number of workpieces grasped by the plurality of fingers, based on detection results of the grasped state of the workpiece;
• and
• after causing the robot mechanism to perform an operation of grasping the workpiece from a placement place at which a plurality of the workpieces are placed, in a case in which the number of workpieces that has been recognized differs from a designated number that is designated in advance, controlling movement of the robot mechanism such that the number of workpieces that are grasped becomes the designated number,
• wherein at least one finger of the plurality of fingers is flexible,
• wherein in a state in which the workpiece is grasped by the plurality of fingers, the movement of the robot mechanism is controlled such that a position of at least one finger changes,
• wherein the control device controls the movement of the robot mechanism so as to, in a state in which the workpiece is grasped by the plurality of fingers, repeat moving of at least one finger of the plurality of fingers in at least one direction among a first direction that is a direction of movement for grasping, a second direction that intersects the first direction and a longitudinal direction of the fingers, a third direction that is the longitudinal direction of the fingers, or a rotation direction of rotating with the third direction being a rotation axis, until the number of workpieces recognized by the control device becomes the designated number, and
• wherein when at least one finger of the plurality of fingers is moved in the first direction, other fingers of the plurality of fingers that are not the at least one finger of the plurality of fingers move in the first direction following movement of the at least one finger of the plurality of fingers, and when the at least one finger of the plurality of fingers is moved in the second direction, the other fingers do not move in the second direction following the movement of the at least one finger of the plurality of fingers.

A picking method comprising:

• detecting a grasped state of a workpiece by a plurality of fingers of a robot mechanism that has the plurality of fingers that grasp the workpiece;
• recognizing a number of workpieces grasped by the plurality of fingers, based on detection results of the grasped state of the workpiece;
• and
• after causing the robot mechanism to perform an operation of grasping the workpiece from a placement place at which a plurality of the workpieces are placed, in a case in which the number of workpieces that has been recognized differs from a designated number that is designated in advance, controlling movement of the robot mechanism such that the number of workpieces that are grasped becomes the designated number,
• wherein a pressure distribution sensor, which is provided at a grasping surface of at least one finger and detects a pressure distribution of the grasping surface that the workpiece contacts, is included,
• wherein the number of workpieces is recognized by a grasped number recognition model that is learned by using, as an input, the detected pressure distribution, and, as an output, the number of workpieces grasped by the plurality of fingers, and
• wherein the movement of the robot mechanism is controlled based on a driving method outputted from a driving method model that is learned by using, as an input, the pressure distribution, and, as outputs, the number of workpieces grasped by the plurality of fingers and the driving method of at least one finger of the plurality of fingers, the driving method being for making the number of workpieces be the designated number,
• wherein the control device controls the movement of the robot mechanism so as to, in a state in which the workpiece is grasped by the plurality of fingers, repeat moving of at least one of the plurality of fingers in at least one direction among a first direction that is a direction of movement for grasping, a second direction that intersects the first direction and a longitudinal direction of the fingers, a third direction that is the longitudinal direction of the fingers, or a rotation direction of rotating with the third direction being a rotation axis, until the number of workpieces recognized by the control device becomes the designated number, and
• wherein when at least one finger of the plurality of fingers is moved in the first direction, other fingers of the plurality of fingers that are not the at least one finger of the plurality of fingers move in the first direction following movement of the at least one finger of the plurality of fingers, and when the at least one finger of the plurality of fingers is moved in the second direction, the other fingers do not move in the second direction following the movement of the at least one finger of the plurality of fingers.