Vision guided robot arm and method for operating the same

A system for operating a vision guided robot arm system comprising a robot arm provided with an end effector at a distal end thereof, a display, an image sensor and a controller, the system comprising:

• a processing unit;
• a communication unit;
• a memory having stored thereon statements and instructions that, when executed by the processing unit perform the following steps:
• receiving from the image sensor an initial image of an area comprising at least one object and displaying the initial image on the display;
• determining an object of interest amongst the at least one object and identifying the object of interest within the initial image;
• determining a potential action to be performed by a user, the potential action being related to the object of interest and providing the user with an identification of the potential action;
• receiving a confirmation of the object of interest and the potential action from the user;
• after said receiving the confirmation of the object of interest and the potential action, automatically moving the robot arm so as to position the end effector of the robot arm at a predefined position relative to the object of interest;
• and
• once the end effector is positioned at the predefined position, allowing the user to control the robot arm to perform the potential action.

A vision guiding system for a robot arm provided with an end effector at a distal end thereof, the system comprising:

• a frame securable to the robot arm;
• an image sensor device enclosed within the frame;
• a user interface comprising at least a display;
• and
• a controller for:
• receiving from the sensor image an initial image of an area comprising at least one object;
• determining an object of interest amongst the at least one object and identifying the object of interest within the initial image;
• determining a potential action to be performed by a user, the potential action being related to the object of interest and providing the user with an identification of the potential action;
• receiving a confirmation of the object of interest and the potential action from the user;
• after said receiving the confirmation of the object of interest and the potential action, automatically moving the robot arm so as to position the end effector of the robot arm at a predefined position relative to the object of interest;
• and
• once the end effector is positioned at the predefined position, allowing the user to control the robot arm to perform the potential action.

A vision guided robot arm system comprising:

• a robot arm provided with an end effector at a distal end thereof,
• an image sensor securable to the robot arm;
• a user interface comprising at least a display;
• and
• a controller for:
• receiving from the sensor image an initial image of an area comprising at least one object;
• determining an object of interest amongst the at least one object and identifying the object of interest within the initial image;
• determining a potential action to be performed by a user, the potential action being related to the object of interest and providing the user with an identification of the potential action;
• receiving a confirmation of the object of interest and the potential action from the user;
• after said receiving the confirmation of the object of interest and the potential action, automatically moving the robot arm so as to position the end effector of the robot arm at a predefined position relative to the object of interest;
• and
• once the end effector is positioned at the predefined position, allowing the user to control the robot arm to perform the potential action.