# US 2002/0055795 A1 · Alignment of master and slave in a minimally invasive surgical apparatus

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2002/0055795 A1
- Document ID: US20020055795A1
- Status: Published application
- Kind: A1
- Application number: 10/033,212
- Filed: 2001-12-28
- Published: 2002-05-09
- Earliest claimed: 1998-12-08
- Assignees: Intuitive Surgical, Inc.
- Inventors: Gunter D. Niemeyer; William C. Nowlin; Gary S. Guthart
- Web page: https://patentgrep.com/patent/US20020055795A1

## CPC

- A61B 1/00149: {using articulated arms}
- A61B 34/30: Surgical robots
- A61B 34/35: for telesurgery
- A61B 34/37: Leader-follower robots (A61B34/35 takes precedence)
- A61B 34/70: {Manipulators specially adapted for use in surgery}
- A61B 90/36: {Image-producing devices or illumination devices not otherwise provided for}
- B25J 3/04: involving servo mechanisms (servo-actuated heads B25J15/02)
- B25J 9/1689: {Teleoperation}
- B25J 9/1692: {Calibration of manipulator}
- B25J 19/023: {including video camera means}
- G05B 19/401: characterised by control arrangements for measuring, e.g. calibration and initialisation, measuring workpiece for machining purposes (G05B19/19 takes precedence)
- H04N 13/246: Calibration of cameras
- H04N 13/327: Calibration thereof
- A61B 17/00234: {for minimally invasive surgery (A61B17/0218, A61B17/0469, A61B17/12013, A61B17/1285, A61B17/29, A61B17/320016 take precedence)}
- A61B 2018/00982: {combined with or comprising means for visual or photographic inspections inside the body, e.g. endoscopes}
- A61B 2034/102: {Modelling of surgical devices, implants or prosthesis}
- A61B 2034/305: {Details of wrist mechanisms at distal ends of robotic arms}
- A61B 2090/506: {using a parallelogram linkage, e.g. panthograph}
- G05B 2219/39014: Match virtual world with real world
- G05B 2219/39057: Hand eye calibration, eye, camera on hand, end effector
- G05B 2219/39062: Calculate, jacobian matrix estimator
- G05B 2219/39253: Virtual arm, has end effector on any joint of real manipulator
- G05B 2219/39387: Reflex control, follow movement, track face, work, hand, visual servoing
- G05B 2219/39389: Laparoscopic surgery, camera on center of operated part, view around, scale
- G05B 2219/39391: Visual servoing, track end effector with camera image feedback
- G05B 2219/39394: Compensate hand position with camera detected deviation, new end effector attitude
- G05B 2219/39437: Joystick with additional handle for wrist and gripper control
- G05B 2219/39439: Joystick, handle, lever controls manipulator directly, manually by operator
- G05B 2219/39483: Control angle of rotation
- G05B 2219/40144: Force sensation feedback from follower
- G05B 2219/40354: Singularity detection
- G05B 2219/40552: Joint limit
- G05B 2219/41441: Position reference ffw for compensation speed reference and speed error
- G05B 2219/45118: Endoscopic, laparoscopic manipulator
- H04N 13/239: using two two-dimensional [2D] image sensors having a relative position equal to or related to the interocular distance (H04N13/243 takes precedence)
- H04N 23/555: {for picking-up images in sites, inaccessible due to their dimensions or hazardous conditions, e.g. endoscopes or borescopes}
- A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D)
- B25J: MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES ({manipulators specially adapted for use in surgery A61B34/70; manipulators used in cleaning hollow articles B08B9/04}; manipulators associated with rolling mills B21B39/20; manipulators associated with forging machines B21J13/10; {manipulators associated with picking-up and placing mechanisms B23P19/007}; means for holding wheels or parts thereof B60B30/00; {vehicles with ground-engaging propulsion means, e.g. walking members B62D57/02, B62D57/032; devices for picking-up and depositing articles or materials between conveyors B65G47/90, B65G47/91; manipulators with gripping or holding means for transferring packages B65H67/065}; cranes B66C; {manipulators used in the protection or supervision of pipe-line installations F17D5/00; walking equipment adapted for nuclear steam-generators F22B37/006}; manipulators specially adapted for, or associated with, nuclear reactors G21C; {apparatus used for handling wafers during manufacture or treatment of semiconductor H10P72/50})
- G05B: CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS (systems for controlling or regulating non-electric variables G05D; systems for regulating electric or magnetic variables G05F; control devices or systems insofar as characterised by mechanical features only G05G)
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

This invention relates to establishing alignment or a desired orientational relationship between a master and a slave of a telerobotic system. The invention can advantageously be used in a surgical apparatus. A method of establishing a desired orientational relationship between a hand-held part of a master control and an end effector of an associated slave as viewed in an image displayed on a viewer is provided. The method includes causing the end effector to remain stationary, determining a current orientation of the end effector relative to a viewing end of an image capturing device operatively associated with the viewer and determining a desired corresponding orientation of the hand-held part of the master control relative to the viewer, at which orientation the desired orientational relationship between the hand-held part of the master control and the end effector would be established. The method further includes causing the hand-held part of the master control to be moved into the desired corresponding orientation. The invention extends to a control system arranged to cause the desired orientational relationship between the hand-held part of the master control and the end effector of the associated slave, as viewed in the displayed imaged on the viewer, to be established when operative control between the master control and the slave has been interrupted.

## Claims

### Claim 1

A surgical control system arranged to cause a desired orientational relationship between a hand-held part of a master control and an end effector of an associated slave, as viewed in a displayed image on a viewer, to be established when operative control between the master control and the slave is interrupted, the control system including
a processor arranged to cause the end effector to remain stationary; and
a processor arranged to compute a current orientation of the end effector relative to a viewing end of an image capturing device operatively associated with the viewer; and to compute a desired corresponding orientation of the hand-held part of the master control at which orientation the desired orientational relationship between the hand-held part of the master control and the end effector would be established.

### Claim 2 (depends on 1)

A surgical control system as claimed in claim 1, which further includes an actuator arranged to cause the hand-held part of the master control to be moved into the desired orientation.

### Claim 3 (depends on 1)

A surgical control system as claimed in claim 1, which further includes a locking arrangement to lock the hand-held part of the master control when moved into an orientation in register with the desired orientation.

### Claim 4 (depends on 1)

A surgical control system as claimed in claim 1, which further includes a signal generator for generating a signal to indicate that the hand-held part of the master control has been moved into an orientation in register with the desired orientation.

### Claim 5 (depends on 1)

A surgical control system as claimed in claim 1, which further includes
a processor arranged to compute a current position of the end effector relative to the viewing end of the image capturing device operatively associated with the viewer, and to compute a desired corresponding position of the hand-held part of the master control at which position the desired positional relationship between the hand-held part of the master control and the end effector would be established.

### Claim 6 (depends on 5)

A surgical control system as claimed in claim 5, which further includes an actuator arranged to cause the hand-held part of the master control to be moved into the desired position.

### Claim 7 (depends on 5)

A surgical control system as claimed in claim 5, which further includes a locking arrangement to lock the hand-held part of the master control when moved into a position in register with the desired position.

### Claim 8 (depends on 5)

A surgical control system as claimed in claim 5, which further includes a signal generator for generating a signal to indicate that the hand-held part of the master control has been moved into a position in register with the desired position.
