Calibration device, calibration method, and computer readable medium for visual sensor

A calibration method executed by a calibration device including a memory storing a program and a processor, the calibration device associating a robot coordinate system at a robot and an image coordinate system at a camera by placing a target mark at the robot, controlling the robot so as to move the target mark, and detecting the target mark at multiple points in a view of the camera, the processor executing the program to perform operations of the calibration method comprising:

• setting an image range in the image coordinate system;
• and
• measuring a calibration range as an operation range for the robot corresponding to the image range before implementation of calibration by controlling the robot to move the target mark and detecting the target mark by determining whether or not the target mark is detectable in the image range that was set in the image coordinate system by moving the target mark and detecting the target mark repeatedly, thereby measuring a calibration range as an operation range for the robot corresponding to the set image range, wherein
• during implementation of the calibration, the robot is controlled so as to move the target mark in the calibration range.

A non-transitory computer-readable medium encoded with a program for enabling a processor to execute the following steps, the processor controlling a calibration device that associates a robot coordinate system at a robot and an image coordinate system at a camera by placing a target mark at the robot, controlling the robot so as to move the target mark, and detecting the target mark at multiple points in a view of the camera, the program being executed by the processor to perform operations comprising:

• setting an image range in the image coordinate system;
• and
• measuring a calibration range as an operation range for the robot corresponding to the image range before implementation of calibration by controlling the robot to move the target mark and detecting the target mark by determining whether or not the target mark is detectable in the image range that was set in the image coordinate system by moving the target mark and detecting the target mark repeatedly, thereby measuring a calibration range as an operation range for the robot corresponding to the set image range, wherein
• during implementation of the calibration, the robot is controlled so as to move the target mark in the calibration range.

A calibration device that associates a robot coordinate system at a robot, position information in an image coordinate system at a first camera of a stereo camera, and position information in an image coordinate system at a second camera of the stereo camera by placing a target mark at the robot, controlling the robot so as to move the target mark, and detecting the target mark at multiple points in a view of the stereo camera including at least the first camera and the second camera, the calibration device comprising:

• a memory configured to store a program;
• and
• a processor configured to execute the program and control the calibration device to:
• set a first image range in the image coordinate system at the first camera;
• set a second image range in the image coordinate system at the second camera;
• measure a first calibration range as a first operation range for the robot corresponding to the first image range before the first camera and the second camera are calibrated by controlling the robot to move the target mark and detecting the target mark by using the first camera by determining whether or not the target mark is detectable in the first image range that was set in the image coordinate system by moving the target mark and detecting the target mark repeatedly, thereby measuring a first calibration range as a first operation range for the robot corresponding to the set first image range;
• and
• measure a second calibration range as a second operation range for the robot corresponding to the second image range before the first camera and the second camera are calibrated by controlling the robot to move the target mark and detecting the target mark by using the second camera by determining whether or not the target mark is detectable in the second image range that was set in the image coordinate system by moving the target mark and detecting the target mark repeatedly, thereby measuring a second calibration range as a second operation range for the robot corresponding to the set second image range, wherein
• while the first camera and the second camera are calibrated, the robot is controlled so as to move the target mark in at least one of the first calibration range and the second calibration range, or in a range covered by both the first calibration range and the second calibration range.

A calibration method executed by a calibration device including a memory storing a program and a processor, the calibration device associating a robot coordinate system at a robot, position information in an image coordinate system at a first camera of a stereo camera, and position information in an image coordinate system at a second camera of the stereo camera by placing a target mark at the robot, controlling the robot so as to move the target mark, and detecting the target mark at multiple points in a view of the stereo camera including at least the first camera and the second camera, the processor executing the program to perform operations of the calibration method comprising:

• setting a first image range in the image coordinate system at the first camera;
• setting a second image range in the image coordinate system at the second camera;
• measuring a first calibration range as a first operation range for the robot corresponding to the first image range before the first camera and the second camera are calibrated by controlling the robot to move the target mark and detecting the target mark by using the first camera by determining whether or not the target mark is detectable in the first image range that was set in the image coordinate system by moving the target mark and detecting the target mark repeatedly, thereby measuring a first calibration range as a first operation range for the robot corresponding to the set first image range;
• and
• measuring a second calibration range as a second operation range for the robot corresponding to the second image range before the first camera and the second camera are calibrated by controlling the robot to move the target mark and detecting the target mark by using the second camera by determining whether or not the target mark is detectable in the second image range that was set in the image coordinate system by moving the target mark and detecting the target mark repeatedly, thereby measuring a second calibration range as a second operation range for the robot corresponding to the set second image range, wherein
• while the first camera and the second camera are calibrated, the robot is controlled so as to move the target mark in at least one of the first calibration range and the second calibration range, or in a range covered by both the first calibration range and the second calibration range.

A non-transitory computer-readable medium encoded with a program for enabling a processor to execute the following steps, the processor controlling a calibration device that associates a robot coordinate system at a robot, position information in an image coordinate system at a first camera of a stereo camera, and position information in an image coordinate system at a second camera of the stereo camera by placing a target mark at the robot, controlling the robot so as to move the target mark, and detecting the target mark at multiple points in a view of the stereo camera including at least the first camera and the second camera, the program being executed by the processor to perform operations comprising:

• setting a first image range in the image coordinate system at the first camera;
• setting a second image range in the image coordinate system at the second camera;
• measuring a first calibration range as a first operation range for the robot corresponding to the first image range before the first camera and the second camera are calibrated by controlling the robot to move the target mark and detecting the target mark by using the first camera by determining whether or not the target mark is detectable in the first image range that was set in the image coordinate system by moving the target mark and detecting the target mark repeatedly, thereby measuring a first calibration range as a first operation range for the robot corresponding to the set first image range;
• and
• measuring a second calibration range as a second operation range for the robot corresponding to the second image range before the first camera and the second camera are calibrated by controlling the robot to move the target mark and detecting the target mark by using the second camera by determining whether or not the target mark is detectable in the second image range that was set in the image coordinate system by moving the target mark and detecting the target mark repeatedly, thereby measuring a second calibration range as a second operation range for the robot corresponding to the set second image range, wherein
• while the first camera and the second camera are calibrated, the robot is controlled so as to move the target mark in at least one of the first calibration range and the second calibration range, or in a range covered by both the first calibration range and the second calibration range.