Robot control apparatus, robot control method, robot system, and storage medium

A robot control apparatus for controlling a robot manipulating a target object, the robot control apparatus comprising:

• a camera configured to measure a change of a gripping unit configured to grip the target object when the gripping unit contacts the target object;
• one or more processors;
• and
• at least one memory storing executable instructions, which when executed by the one or more processors, cause the robot control apparatus to:
• acquire the change of the gripping unit measured by the camera;
• acquire a gripping state, which is a state of gripping of the target object by the gripping unit, based on the change of the gripping unit;
• and
• control an action of the robot based on the gripping state acquired,
• wherein the gripping unit is an end effector including a plurality of finger-like members configured to be able to move passively conforming to a shape of the target object when contacting the target object,
• wherein the robot control apparatus further comprises the end effector, and
• wherein the gripping state is acquired based on a difference between a change of a finger-like member arranged on an outer side of the end effector and a change of a finger-like member arranged on an inner side of the end effector.

A robot control method for controlling a robot manipulating a target object, the robot control method comprising:

• measuring a change of a gripping unit configured to grip the target object when the gripping unit contacts the target object, wherein the gripping unit is an end effector including a plurality of finger-like members configured to be able to move passively conforming to a shape of the target object when contacting the target object;
• acquiring the measured change of the gripping unit;
• acquiring a gripping state, which is a state of gripping of the target object by the gripping unit, based on the acquired change of the gripping unit;
• controlling an action of the robot based on the acquired gripping state;
• and
• acquiring a modulus of elasticity of the target object from the change of the gripping unit and a measurement result acquired by a force sensor configured to measure at least one of force and torque applied to the end effector,
• wherein acquiring the gripping state acquires the gripping state of the target object based on the change of the gripping unit and the modulus of elasticity.

A robot system comprising:

• a robot;
• a camera configured to measure a change of a gripping unit configured to grip a target object when the gripping unit contacts the target object, wherein the gripping unit is an end effector including a plurality of finger-like members configured to be able to move passively conforming to a shape of the target object when contacting the target object;
• a force sensor configured to measure at least one of force and torque applied to the end effector;
• one or more processors;
• and
• at least one memory storing executable instructions, which when executed by the one or more processors, cause the robot control apparatus to:
• acquire the change of the gripping unit measured by the camera;
• acquire a gripping state, which is a state of gripping of the target object by the gripping unit, based on the change of the gripping unit;
• plan an action of the robot based on the gripping state acquired;
• and
• acquire a modulus of elasticity of the target object from the change of the gripping unit and a measurement result acquired by the force sensor,
• wherein acquiring the gripping state acquires the gripping state of the target object based on the change of the gripping unit and the modulus of elasticity, and
• wherein the robot is configured to manipulate the target object based on the action of the robot planned by the planning.

A robot system comprising:

• a robot;
• a camera configured to measure a change of a gripping unit configured to grip a target object when the gripping unit contacts the target object, wherein the gripping unit is an end effector including a plurality of finger-like members configured to be able to move passively conforming to a shape of the target object when contacting the target object;
• a force sensor configured to measure at least one of force and torque applied to the end effector;
• one or more processors;
• and
• at least one memory storing executable instructions, which when executed by the one or more processors, cause the robot control apparatus to:
• acquire the change of the gripping unit measured by the camera;
• acquire a gripping state, which is a state of gripping of the target object by the gripping unit, based on the change of the gripping unit;
• and
• plan an action of the robot based on the gripping state acquired;
• and;
• acquire a modulus of elasticity of the target object from the change of the gripping unit and a measurement result acquired by the force sensor,
• wherein acquiring the gripping state acquires the gripping state of the target object based on the change of the gripping unit and the modulus of elasticity,
• wherein the the robot includes an elastic member attached to the gripping unit,
• wherein the force sensor is configured to acquire an external force applied to the target object by the gripping unit based on the change of the gripping unit measured by the camera and rigidity of the elastic member, and
• wherein the robot is configured to manipulate the target object based on the action of the robot planned by the planning.

A robot system comprising:

• a robot;
• a camera configured to measure a change of a gripping unit configured to grip a target object when the gripping unit contacts the target object;
• one or more processors;
• and
• at least one memory storing executable instructions, which when executed by the one or more processors, cause the robot control apparatus to:
• acquire the change of the gripping unit measured by the camera;
• acquire a gripping state, which is a state of gripping of the target object by the gripping unit, based on the change of the gripping unit;
• plan an action of the robot based on the gripping state acquired;
• measure at least either force or torque acting on the gripping unit;
• and
• acquire virtual dynamics of the target object based on the change of the gripping unit and a measurement result of the measured at least either force or torque acting on the gripping unit to obtain the virtual dynamics of the target object;
• wherein the robot includes
• the gripping unit that is an end effector including a plurality of finger-like members configured to be able to move passively conforming to a shape of the target object when contacting the target object, and
• a force sensor configured to obtain at least either the force or the torque acting on the end effector,
• wherein the measuring at least either force or torque acting on the gripping unit measures at least either the force or the torque obtained by the force sensor
• wherein the gripping state of the target object is acquired based on the change of the gripping unit and the virtual dynamics,
• wherein the planning plans the action of the robot based on the gripping state acquired and the virtual dynamics, and
• wherein the robot is configured to manipulate the target object based on the planned action of the robot.

A non-transitory computer-readable storage medium storing a computer program including instructions, which when executed by one or more processors of a robot control apparatus comprising a camera configured to measure a change of a gripping unit configured to grip a target object when the gripping unit contacts the target object, wherein the gripping unit is an end effector including a plurality of finger-like members configured to be able to move passively conforming to a shape of the target object when contacting the target object, cause the robot control apparatus to:

• acquire the change of the gripping unit measured by the camera;
• acquire a gripping state, which is a state of gripping of the target object by the gripping unit, based on the change of the gripping unit acquired;
• control an action of the robot based on the gripping state acquired;
• and
• acquire a modulus of elasticity of the target object from the change of the gripping unit and a measurement result acquired by a force sensor, wherein acquiring the gripping state acquires the gripping state of the target object based on the change of the gripping unit and the modulus of elasticity.

A robot control apparatus for controlling a robot manipulating a target object, the robot control apparatus comprising:

• a measurement unit configured to measure a change of a gripping unit when the gripping unit grips the target object, wherein the gripping unit is an end effector including a plurality of finger-like members movable conforming to a shape of the target object when contacting the target object;
• a recognizing unit configured to recognize softness of the target object based on a measurement result acquired by a force sensor configured to measure at least one of force and torque applied to the end effector;
• an acquisition unit configured to acquire a gripping state, which is a state of gripping of the target object by the gripping unit, based on the measured change of the gripping unit and the softness of the target object;
• a determination unit configured to determine a classification of the target object based on the change of the gripping unit and the softness of the target object;
• and
• a control unit configured to control an action of the robot based on the gripping state,
• wherein the control unit controls an arrangement location of the target object based on the determined classification of the target object.

A robot control method for controlling a robot manipulating a target object, the robot control method comprising:

• measuring a change of a gripping unit when the gripping unit grips the target object, wherein the gripping unit is an end effector including a plurality of finger-like members movable conforming to a shape of the target object when contacting the target object;
• recognizing softness of the target object based on a measurement result acquired by a force sensor configured to measure at least one of force and torque applied to the end effector;
• acquiring a gripping state, which is a state of gripping of the target object by the gripping unit, based on the measured change of the gripping unit and the softness of the target object;
• determining a classification of the target object based on the change of the gripping unit and the softness of the target object;
• and
• controlling an action of the robot based on the gripping state, wherein the controlling controls an arrangement location of the target object based on the determined classification of the target object.