# US 2012/0253360 A1 · Motion and video capture for tracking and evaluating robotic surgery and associated systems and methods

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2012/0253360 A1
- Document ID: US20120253360A1
- Status: Published application
- Kind: A1
- Application number: 13/434,585
- Filed: 2012-03-29
- Published: 2012-10-04
- Earliest claimed: 2011-03-30
- Assignees: University of Washington
- Inventors: Lee Woodruff White; Timothy Mariusz Kowalewski; Thomas S. Lendvay; Blake Hannaford
- Web page: https://patentgrep.com/patent/US20120253360A1

## CPC

- A61B 34/35: for telesurgery
- A61B 34/20: Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis
- A61B 34/30: Surgical robots
- A61B 2034/2048: {using an accelerometer or inertia sensor}
- A61B 2034/2051: {Electromagnetic tracking systems}
- A61B 2034/2059: {Mechanical position encoders}
- A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D)

## Abstract

The present technology is directed to motion and video capture for tracking and evaluating robotic surgery. In one embodiment, the system includes at least one tracking device coupled to a remote surgical tool. The tracking device is configured to use one or more sensors to sense one or more physical variables such as movement and electrical contact. In some embodiments, the data from multiple individual sensors is synchronized, received, and stored by a digital information system. The digital information system is configured to analyze the data to objectively assess surgical skill.

## Claims

### Claim 1

A system for tracking performance of a user in control of a remotely controlled tool, the system comprising:
a modification device coupled to the remotely controlled tool, wherein the modification device is configured to sense one or more physical variables associated with use of the remotely controlled tool, and wherein the modification device uses multiple recordings to sense the one or more physical variables;
a data transmission component operably coupled to the modification device and configured to transmit data, wherein the data includes information associated with the one or more physical variables;
a synchronization component configured to synchronize the multiple recordings; and
a digital information system configured to receive and store the transmitted data.

### Claim 2 (depends on 1)

The system of claim 1 wherein the remotely controlled tool comprises an end effector configured to perform a surgical function, and wherein the end effector is driven by at least one rotating spindle.

### Claim 3 (depends on 2)

The system of claim 2 wherein the modification device is configured to sense rotation of the at least one spindle.

### Claim 4 (depends on 3)

The system of claim 3 wherein the modification device is configured to sense rotation of the at least one spindle with at least one of potentiometers, optical encoders, Hall effect sensors, or a combination thereof.

### Claim 5 (depends on 2)

The system of claim 2 wherein the digital information system is configured to compute motion of the end effector.

### Claim 6 (depends on 1)

The system of claim 1 wherein the modification device comprises a motion tracker configured to transmit a signal corresponding to the position and orientation of the remotely controlled tool with respect to a reference point.

### Claim 7 (depends on 1)

The system of claim 1 wherein the modification device includes a digital device configured to broadcast a unique serial number associated with the remotely controlled tool.

### Claim 8 (depends on 1)

The system of claim 1 wherein the modification device comprises a video capture device configured to record video being output to the user, and wherein the digital information system is configured to receive and store the recorded video.

### Claim 9 (depends on 1)

The system of claim 1 wherein the modification device comprises an electrical contact sensor configured to transmit a signal relating to at least one of temperature, pH, immunohistochemistry, electrical impedance, physical impedance, an optical characteristic, tissue contact, transmissibility of radiation, or an electromagnetic characteristic.

### Claim 10

A system for tracking performance of a user in control of a robotic surgical tool, the system comprising:
a surgical tracker configured to be removably coupled to the surgical tool, the surgical tracker comprising a video capture device configured to capture video of the surgical tool and a motion capture device configured to sense the position of the surgical tool;
a data transmission component configured to transmit video and position data captured by the video capture device and the motion capture device, respectively; and
a digital information system configured to receive and store the transmitted video and position data, wherein the digital information system comprises a data recorder, a synchronization component, and a data analyzer.

### Claim 11 (depends on 10)

The system of claim 10 wherein:
the robotic surgical tool comprises an end effector;
the end effector is driven by at least one rotating spindle; and
the motion capture device is configured to sense rotation of the at least one spindle.

### Claim 12 (depends on 11)

The system of claim 11 wherein the end effector is driven by a plurality of rotating spindles, and wherein the motion capture device comprises a plurality of potentiometers, each potentiometer configured to sense rotation of an individual spindle.

### Claim 13 (depends on 10)

The system of claim 10 wherein the motion capture device comprises an electromagnetic tracker configured to transmit a signal corresponding to the position and orientation of the robotic surgical tool with respect to a static reference point.

### Claim 14 (depends on 10)

The system of claim 10 wherein the surgical tracker comprises a digital device configured to broadcast a unique serial number associated with the robotic surgical tool.

### Claim 15 (depends on 10)

The system of claim 10 wherein the synchronization component is configured to time-sync data provided by the video capture device with data provided by the motion capture device.

### Claim 16 (depends on 10)

The system of claim 10 wherein the synchronization component is configured to time-sync data provided by the video capture device and data provided by the motion capture device with data from an additional source.

### Claim 17 (depends on 10)

The system of claim 10 wherein the surgical tracker comprises an electrical contact sensor configured to transmit a signal relating to at least one of temperature, pH, immunohistochemistry, electrical impedance, physical impedance, an optical characteristic, tissue contact, transmissibility of radiation, an electromagnetic characteristic.

### Claim 18 (depends on 10)

The system of claim 10 wherein the data analyzer is configured to compute a performance indicator based on at least one of the quantity, direction, duration, pattern, force, path length, or sequence of movement of the robotic surgical tool.

### Claim 19 (depends on 10)

The system of claim 10, further comprising:
a plurality of potentiometers, each potentiometer configured to sense rotation of an individual spindle driving the robotic surgical tool;
an electromagnetic tracker configured to transmit a signal corresponding to the position and orientation of the robotic surgical tool with respect to a static reference point;
a digital device configured to broadcast a unique serial number associated with the robotic surgical tool;
an electrical contact sensor configured to transmit a signal relating to at least one of temperature, pH, immunohistochemistry, electrical impedance, physical impedance, an optical characteristic, tissue contact, transmissibility of radiation, an electromagnetic characteristic; and
an output device configured to output a performance indicator based on at least one of the quantity, direction, duration, pattern, force, path length, or sequence of movement of the robotic surgical tool.

### Claim at position 20

20-45. (canceled)
