# US 2019/0314097 A1 · Secondary instrument control in a computer-assisted teleoperated system

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0314097 A1
- Document ID: US20190314097A1
- Status: Published application
- Kind: A1
- Application number: 16/316,859
- Filed: 2017-07-14
- Published: 2019-10-17
- Earliest claimed: 2016-07-14
- Assignees: Intuitive Surgical Operation, Inc.
- Applicants: Intuitive Surgical Operation, Inc.
- Inventors: Nicola Diolaiti
- Web page: https://patentgrep.com/patent/US20190314097A1

## CPC

- A61B 34/25: {User interfaces for surgical systems}
- A61B 1/00149: {using articulated arms}
- A61B 1/04: combined with photographic or television appliances
- A61B 17/00: Surgical instruments, devices or methods (A61B18/00 takes precedence; dental tools A61C3/00; eye surgery A61F9/007; ear surgery A61F11/20)
- A61B 34/30: Surgical robots
- A61B 34/35: for telesurgery
- A61B 34/37: Leader-follower robots (A61B34/35 takes precedence)
- A61B 34/70: {Manipulators specially adapted for use in surgery}
- A61B 34/74: {Manipulators with manual electric input means}
- A61B 90/361: {Image-producing devices, e.g. surgical cameras}
- A61B 90/37: {Surgical systems with images on a monitor during operation}
- B25J 9/1689: {Teleoperation}
- B25J 13/02: Hand grip control means {(handles or pedals for crane control B66C13/56; for measuring the force applied to control members G01L5/22; hand-held casings for switching devices, e.g. joy-sticks H01H9/0214)}
- A61B 1/00193: {adapted for stereoscopic vision}
- A61B 6/487: {involving fluoroscopy}
- A61B 8/08: Clinical applications (A61B8/02, A61B8/04, A61B8/06 take precedence)
- A61B 8/12: in body cavities or body tracts, e.g. by using catheters
- A61B 34/00: Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
- A61B 2017/00203: {with speech control or speech recognition}
- A61B 2017/00424: {ergonomic, e.g. fitting in fist}
- A61B 2017/00738: {part of the tool being offset with respect to a main axis, e.g. for better view for the surgeon}
- A61B 2034/2048: {using an accelerometer or inertia sensor}
- A61B 2034/2059: {Mechanical position encoders}
- A61B 2034/2061: {using shape-sensors, e.g. fiber shape sensors with Bragg gratings}
- A61B 2034/301: {for introducing or steering flexible instruments inserted into the body, e.g. catheters or endoscopes}
- A61B 2090/368: {changing the image on a display according to the operator's position}
- A61B 2090/371: {with simultaneous use of two cameras}
- A61B 2090/571: {for clamping a support arm to a bed or other supports}
- A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D)
- B25J: MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES ({manipulators specially adapted for use in surgery A61B34/70; manipulators used in cleaning hollow articles B08B9/04}; manipulators associated with rolling mills B21B39/20; manipulators associated with forging machines B21J13/10; {manipulators associated with picking-up and placing mechanisms B23P19/007}; means for holding wheels or parts thereof B60B30/00; {vehicles with ground-engaging propulsion means, e.g. walking members B62D57/02, B62D57/032; devices for picking-up and depositing articles or materials between conveyors B65G47/90, B65G47/91; manipulators with gripping or holding means for transferring packages B65H67/065}; cranes B66C; {manipulators used in the protection or supervision of pipe-line installations F17D5/00; walking equipment adapted for nuclear steam-generators F22B37/006}; manipulators specially adapted for, or associated with, nuclear reactors G21C; {apparatus used for handling wafers during manufacture or treatment of semiconductor H10P72/50})

## Abstract

Systems and methods for a teleoperational system and control thereof are provided. An exemplary system includes a first manipulator configured to support an instrument moveable within an instrument workspace, the instrument having an instrument frame of reference, and includes an operator input device configured to receive movement commands from an operator. The system further includes a control system to implement the movement commands by comparing an orientation of the instrument with an orientation of a field of view of the instrument workspace to produce an orientation comparison. When the comparison does not meet certain criteria, the control system causes instrument motion in a first direction relative to the instrument frame in response to a movement command. When the comparison meets the criteria, the control system causes instrument in a second direction relative to the instrument frame in response to the movement command. The second direction differs from the first direction.

## Claims

### Claim 1

A teleoperational system comprising:
a first manipulator configured to support an instrument moveable within an instrument workspace, the instrument having an instrument frame of reference;
an operator input device configured to receive movement commands from an operator; and
a control system configured to implement the movement commands by:
comparing an orientation of the instrument with an orientation of a field of view of the instrument workspace to produce an orientation comparison,
when the orientation comparison does not meet an orientation criterion set, causing instrument motion in a first direction relative to the instrument frame of reference in response to a movement command, and
when the orientation comparison meets the orientation criterion set, causing instrument motion in a second direction relative to the instrument frame of reference in response to the movement command, wherein the second direction differs from the first direction.

### Claim 2 (depends on 1)

The teleoperational system of claim 1, wherein the orientation comparison comprises an orientation difference, and the orientation criterion set comprises the orientation difference exceeding an orientation difference threshold.

### Claim 3 (depends on 2)

The teleoperational system of claim 2, wherein the orientation difference threshold is greater than or equal to 135° and less than or equal to 225° relative to a centerline of the field of view.

### Claim 4 (depends on 1)

The teleoperational system of claim 1, wherein the orientation criterion set includes an indication, stored in memory, that the first manipulator is associated with a secondary platform.

### Claim 5 (depends on 1)

The teleoperational system of claim 1, wherein the control system is further configured to implement the movement commands by:
in response to the orientation comparison not meeting the orientation criterion set, causing instrument motion in a third direction relative to the instrument frame of reference in response to the movement command, and
in response to the orientation comparison meeting the orientation criterion set, causing instrument motion in a fourth direction relative to the instrument frame of reference in response to the movement command, wherein the fourth direction differs from the third direction.

### Claim 6 (depends on 1)

The teleoperational system of claim 1, further comprising a second manipulator configured to support a imaging sensor configured to provide the field of view, wherein:
the first manipulator is supported by a first base,
the second manipulator is supported by a second base, and
the first and second bases are physically separate and are moveable relative to each other.

### Claim 7 (depends on 6)

The teleoperational system of claim 6, wherein the first base is configured for mounting to a medical table.

### Claim 8

(canceled)

### Claim 9 (depends on 1)

The teleoperational system of claim 1, wherein the control system is further configured to implement the movement commands by:
detecting that the first manipulator is a secondary platform manipulator.

### Claim 10

(canceled)

### Claim 11 (depends on 1)

The teleoperational system of claim 1, wherein the control system is further configured to implement the movement commands by:
altering one or more directional components of the movement commands.

### Claim 12 (depends on 11)

The teleoperational system of claim 11, wherein altering the one or more of the directional components of the movement commands comprises inverting the one or more of the directional components of the movement commands.

### Claim 13

The teleoperational system 1, wherein the operator input device is aligned with a distal end of the instrument in the instrument frame of reference by an ergonomic offset.

### Claim 14

(canceled)

### Claim 15 (depends on 1)

The teleoperational system of claim 1, wherein the instrument moveable within the instrument workspace is a medical instrument moveable within a surgical site.

### Claim 16 (depends on 1)

The teleoperational system of claim 1, wherein the first direction is an inversion of the second direction.

### Claim 17

(canceled)

### Claim 18 (depends on 1, 2, 3, 4)

The teleoperational system of claim 1, or of any of claims 2 to 4, wherein comparing the orientation of the instrument with the orientation of the field of view of the workspace comprises:
using the orientation of the first manipulator as the orientation of the instrument; and
comparing the orientation of the first manipulator with an orientation of another manipulator that supports an imaging system providing the field of view of the workspace.

### Claim 19 (depends on 1)

The teleoperational system of claim 1, wherein comparing the orientation of the instrument with the orientation of the field of view of the workspace comprises:
determining an angle between an axis characterizing the orientation of the instrument and an axis characterizing the orientation of the field of view.

### Claim 20

(canceled)

### Claim 21

A method of controlling a teleoperational system, the method comprising:
comparing an orientation of a manipulator arm configured to receive an instrument with an orientation of a field of view of a workspace to produce an orientation comparison;
when the orientation comparison does not meet an orientation criterion set, causing instrument motion in a first direction relative to an instrument frame of reference in response to a movement command; and
when the orientation comparison meets the orientation criterion set, causing instrument motion in a second direction relative to the instrument frame of reference in response to the movement command, wherein the second direction differs from the first direction.

### Claim at position 22

22-23. (canceled)

### Claim 24 (depends on 21)

The method of claim 21, wherein the orientation comparison comprises an orientation difference, and the orientation criterion set comprises the orientation difference exceeding an orientation difference threshold.

### Claim at position 24

25-29. (canceled)

### Claim 30 (depends on 21)

The method of claim 21, wherein the second direction has a component antiparallel to the first direction.

### Claim 31

A robotic system, comprising:
an operator input system having a first input device;
a first robotic platform having a first slave manipulator arm configured to receive a first instrument, the first slave manipulator arm and the first instrument having an instrument reference frame;
a second robotic platform having a second slave manipulator arm configured to receive an imaging system, wherein the imaging system provides an imaging reference frame; and
a control system that receives movement commands via the first input device, the received movement commands indicating a first direction of movement relative to the imaging reference frame, wherein the control system implements the received movement commands on a platform of the first and second robotic platforms by:
comparing an orientation of the first instrument in the instrument reference frame with an orientation of the imaging system in the imaging reference frame,
determining a mapping to apply to the received movement commands to generate implementable movement commands for the first instrument, and
causing instrument motion in a second direction relative to the instrument reference frame in response to the movement command, wherein the second direction is different than the first direction.

### Claim 32 (depends on 31)

The robotic system of claim 31, wherein the first robotic platform comprises a first base and the second robotic platform comprises a second base, the first base being separate from and movable with respect to the first base.

### Claim 33 (depends on 32)

The robotic system of claim 32, wherein the robotic system is a medical robotic system, and wherein the first base and the second base are configured to be disposed along a rail of a medical table configured to support a patient.

### Claim 34

(canceled)

### Claim 35 (depends on 31)

The robotic system of claim 31, wherein the robotic system is a medical robotic system, and wherein the first instrument comprises a tissue probe.

### Claim at position 31

36-37. (canceled)
