# US 2025/0058470 A1 · Method of teaching robot and robot system

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0058470 A1
- Document ID: US20250058470A1
- Status: Published application
- Kind: A1
- Application number: 18/938,687
- Filed: 2024-11-06
- Published: 2025-02-20
- Earliest claimed: 2017-02-09
- Assignees: Canon Kabushiki Kaisha
- Applicants: Canon Kabushiki Kaisha
- Inventors: Hideaki Suzuki; Keita Dan; Naoki Tsukabe
- Web page: https://patentgrep.com/patent/US20250058470A1

## CPC

- B25J 9/1692: {Calibration of manipulator}
- B25J 9/0081: {with leader teach-in means}
- B25J 9/0096: {co-operating with a working support, e.g. work-table}
- B25J 9/1656: {characterised by programming, planning systems for manipulators}
- B25J 9/1664: {characterised by motion, path, trajectory planning}
- B25J 9/1687: {Assembly, peg and hole, palletising, straight line, weaving pattern movement}
- B25J 9/1697: {Vision controlled systems}
- B25J 15/0014: {having fork, comb or plate shaped means for engaging the lower surface on a object to be transported}
- B25J 15/009: {with pins for accurately positioning the object on the gripping head}
- B25J 15/0253: {comprising parallel grippers}
- B25J 15/08: having finger members (B25J15/02, B25J15/04 take precedence)
- B25J 15/103: {for gripping the object in three contact points}
- G05B 2219/36401: Record play back, teach position and record it then play back
- G05B 2219/36431: Tv camera in place of tool, on display operator marks points, crosshair
- G05B 2219/39057: Hand eye calibration, eye, camera on hand, end effector
- Y10S 901/04: Manual lead through
- Y10S 901/31: Gripping jaw
- Y10S 901/47: Optical
- B25J: MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES ({manipulators specially adapted for use in surgery A61B34/70; manipulators used in cleaning hollow articles B08B9/04}; manipulators associated with rolling mills B21B39/20; manipulators associated with forging machines B21J13/10; {manipulators associated with picking-up and placing mechanisms B23P19/007}; means for holding wheels or parts thereof B60B30/00; {vehicles with ground-engaging propulsion means, e.g. walking members B62D57/02, B62D57/032; devices for picking-up and depositing articles or materials between conveyors B65G47/90, B65G47/91; manipulators with gripping or holding means for transferring packages B65H67/065}; cranes B66C; {manipulators used in the protection or supervision of pipe-line installations F17D5/00; walking equipment adapted for nuclear steam-generators F22B37/006}; manipulators specially adapted for, or associated with, nuclear reactors G21C; {apparatus used for handling wafers during manufacture or treatment of semiconductor H10P72/50})
- G05B: CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS (systems for controlling or regulating non-electric variables G05D; systems for regulating electric or magnetic variables G05F; control devices or systems insofar as characterised by mechanical features only G05G)
- Y10S: TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS

## Abstract

A robot system includes a robot, a vision sensor, and a controller. The vision sensor is configured to be detachably attached to the robot. The controller is configured to measure a reference object by using the vision sensor and calibrate a relative relationship between a sensor portion of the vision sensor and an engagement portion of the vision sensor, and teach the robot by referring to the relative relationship and by using the vision sensor, after the vision sensor is attached to the robot.

## Claims

### Claim at position 1

1-10. (canceled)

### Claim 11

A method of controlling a robot system that includes a robot, a vision sensor, and a controller, the method comprising:
obtaining visual information of an object held at a reference position with a sensor portion of the vision sensor, the vision sensor having an engagement portion that is configured to be engaged to a portion of the robot;
calculating, with the controller, a positional relationship between the sensor portion of the vision sensor and the engagement portion of the vision sensor based on the visual information of the object and position information of the reference position; and
adjusting, with the controller, a teach point of the robot based on the positional relationship.

### Claim 12 (depends on 11)

The method according to claim 11, wherein the adjusting the teach point further includes obtaining, with the vision sensor, visual information of the object for adjusting the teach point of the robot in a state where the engagement portion is engaged with the portion of the robot.

### Claim 13 (depends on 11)

The method according to claim 11, wherein the obtaining visual information includes obtaining, with the vision sensor, visual information of the object for the calculating the positional relationship in a state where the engagement portion is not engaged with the portion of the robot.

### Claim 14 (depends on 11)

The method according to claim 11, wherein the obtaining visual information includes obtaining, with the vision sensor, visual information of the object for the calculating the positional relationship in a state where the engagement portion is engaged with a portion positioned with respect to the object held in the reference position.

### Claim 15 (depends on 11)

The method according to claim 11, further comprising operating the robot in accordance with the teach point adjusted in the adjusting.

### Claim 16 (depends on 11)

The method according to claim 11, wherein the obtaining visual information includes capturing images of the object, which has three marks.

### Claim 17 (depends on 11)

The method according to claim 11, wherein the vision sensor includes a plurality of cameras, and
wherein, in the calculating the positional relationship, the controller calculates the positional relationship based on the visual information of the object obtained with one of the plurality of cameras.

### Claim 18 (depends on 11)

The method according to claim 11, wherein the adjusting of the teach point includes adjusting a posture of the robot based on the positional relationship calculated in the calculating and storing the adjusted posture of the robot as an adjusted teach point in a memory.

### Claim 19 (depends on 11)

The method according to claim 11, wherein the engagement portion of the vision sensor includes at least two pins configured to be engaged to the portion of the robot.

### Claim 20

A method of controlling a robot system that includes a robot, a vision sensor, and a controller, the method comprising:
obtaining visual information of an object held at a reference position with a sensor portion of the vision sensor, the vision sensor having an engagement portion that is configured to be engaged to a portion of the robot;
calculating, with the controller, a positional relationship between the sensor portion of the vision sensor and the engagement portion of the vision sensor based on the visual information of the object and position information of the reference position; and
adjusting, with the controller, a posture of the robot based on the positional relationship.

### Claim 21

A robot system comprising:
a robot;
a vision sensor; and
a controller,
wherein the controller is configured to:
control the vision sensor to obtain visual information of an object held at a reference position with a sensor portion, the vision sensor having an engagement portion that is configured to be engaged to a portion of the robot;
calculate a positional relationship between the sensor portion of the vision sensor and the engagement portion of the vision sensor based on the visual information of the object and position information of the reference position; and
adjust a teach point of the robot based on the positional relationship.

### Claim 22 (depends on 21)

The robot system according to claim 21, wherein the controller is further configured to control the vision sensor to obtain visual information of the object for adjusting the teach point of the robot in a state where the engagement portion is engaged with the portion of the robot.

### Claim 23 (depends on 21)

The robot system according to claim 21, wherein the controller is configured to control the vision sensor to obtain visual information of the object for calculating the positional relationship in a state where the engagement portion is not engaged with the portion of the robot.

### Claim 24 (depends on 21)

The robot system according to claim 21, wherein the controller is configured to control the vision sensor to obtain visual information of the object for calculating the positional relationship in a state where the engagement portion is engaged with a portion positioned with respect to the object held in the reference position.

### Claim 25 (depends on 21)

The robot system according to claim 21, wherein the controller is further configured to operate the robot in accordance with the adjusted teach point.

### Claim 26 (depends on 21)

The robot system according to claim 21, wherein the controller is configured to control the vision sensor to capture images of the object, which has three marks.

### Claim 27 (depends on 21)

The robot system according to claim 21, wherein the vision sensor includes a plurality of cameras, and
wherein the controller is configured to calculate the positional relationship based on the visual information of the object obtained with one of the plurality of cameras.

### Claim 28 (depends on 21)

The robot system according to claim 21, wherein the controller is configured to adjust a posture of the robot based on the calculated positional relationship calculated and store in a memory an adjusted posture of the robot as an adjusted teach point.

### Claim 29 (depends on 21)

The robot system according to claim 21, wherein the engagement portion of the vision sensor includes at least two pins configured to be engaged to the portion of the robot.
