# US 2022/0031398 A1 · Surface tracking-based surgical robot system for drilling operation and control method

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2022/0031398 A1
- Document ID: US20220031398A1
- Status: Published application
- Kind: A1
- Application number: 17/039,881
- Filed: 2020-09-30
- Published: 2022-02-03
- Earliest claimed: 2020-07-31
- Assignees: Tsinghua University
- Applicants: Tsinghua University
- Inventors: Gangtie Zheng; Shijie Zhu; Zhe Zhao; Yongwei Pan
- Web page: https://patentgrep.com/patent/US20220031398A1

## CPC

- A61B 34/20: Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis
- A61B 17/1615: {Drill bits, i.e. rotating tools extending from a handpiece to contact the worked material}
- A61B 17/17: Guides {or aligning means} for drills {, mills, pins or wires}
- A61B 34/25: {User interfaces for surgical systems}
- A61B 34/35: for telesurgery
- A61B 34/37: Leader-follower robots (A61B34/35 takes precedence)
- A61B 90/37: {Surgical systems with images on a monitor during operation}
- A61B 2034/107: {Visualisation of planned trajectories or target regions}
- A61B 2034/2046: {Tracking techniques}
- A61B 2034/2059: {Mechanical position encoders}
- A61B 2034/2065: {Tracking using image or pattern recognition}
- A61B 2090/373: {using light, e.g. by using optical scanners}
- A61B 2090/374: {NMR or MRI}
- A61B 2090/3762: {using computed tomography systems [CT]}
- A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D)

## Abstract

A surface tracking-based surgical robot system for drilling operations includes surface scanning equipment, a robot arm, and a workstation. To perform a drilling operation, surface information for the target surgery area and the surgical tool held by the robot arm is simultaneously collected with the same surface scanning equipment. A preoperative 3D image of a surgical area and a CAD model of the surgical tool are registered to the collected surface information, through which the relative position between a surgical path and the surgical tool is obtained. Using this relative position, the robot arm aligns to the predefined surgical path using a feedback control method running on a workstation. The drilling operation is then autonomously executed by the robot arm or manually performed under the guidance of the surgical tool held by the robot arm.

## Claims

### Claim 1

A surface tracking-based surgical robot system for a drilling operation, comprising:
a robot arm having a proximal end and a distal end, wherein the robot arm has at least three translational degrees of freedom and at least two rotational degrees of freedom;
a surgical tool having a proximal end and a distal end, wherein the proximal end of the surgical tool is attached to the distal end of the robot arm, and wherein the surgical tool is either:
(a) surgical drill having a drill head, the drill head comprising a cylindrical portion between a proximal end and a distal end of the drill head and a non-cylindrical component at the distal end of the drill head; or
(b) a drill guide having a cylindrical sleeve between a proximal end and a distal end of the drill guide and comprising a non-cylindrical component at the distal end of the drill guide; and
a surface scanner capable of acquiring scanned data comprising surface geometry and color information of a surgery site; and
a workstation in communication with the surface scanner and the robot arm, wherein the workstation is used to process the scanned data, plan a drilling path, and control motion of the robot arm.

### Claim 2 (depends on 1)

The surgical robot system of claim 1, wherein the non-cylindrical component is selected from the group consisting of a distally flaring-shaped component, one or more circumferential grooves, and one or more circumferential ridges.

### Claim 3 (depends on 2)

The surgical robot system of claim 2, wherein the distally flaring-shaped component has a conical shape, frustoconical shape, hemispherical shape, or bell shape.

### Claim 4 (depends on 1)

The surgical robot system of claim 1, further comprising a drill bit secured to the distal end of the drill guide or the distal end of the drill head.

### Claim 5 (depends on 1)

The surgical robot system of claim 1, wherein the surface scanner is selected from the group consisting of a laser scanner, a ToF (time-of-flight) camera, and a structured light camera/scanner.

### Claim 6 (depends on 1)

The surgical robot system of claim 1, wherein the workstation is in communication with the surface scanner and the robot arm via a wireless network.

### Claim 7 (depends on 1)

The surgical robot system of claim 1, wherein at least a portion of an outer surface of the drill guide or the drill head comprises a matte color and/or a color which is different than the color of the surgery site.

### Claim 8

A method for performing a drilling operation on a subject with a surgical robot system, comprising the steps of:
providing a surface tracking-based surgical robot system comprising a surface scanner, a workstation, and a surgical robot, the surgical robot comprising a robot arm having a surgical tool attached to a distal end of the robot arm, the surgical tool comprising a surgical drill or a drill guide;
acquiring 3D image data of a target surgery area and planning a surgical path on this 3D image data;
extracting surface geometry of the target surgery area from the 3D image data to produce surface geometry data;
positioning the surface scanner so that the target surgery area can be viewed by the surface scanner;
positioning the robot arm so that the drill guide can be viewed by the surface scanner;
selecting the target surgery area by creating a contour of the target surgery area from color 3D image data obtained from the surface scanner using a graphical user interface of the workstation;
registering the robot arm to the surface scanner;
calculating a robot movement quantity using a feedback control method according to a relative spatial relationship between the surgical path and the surgical tool, wherein the robot movement quantity comprises a translational component and a rotational component;
repeating the previous step until an alignment error between the surgical tool and the surgical path is below a preset threshold, thereby aligning the surgical tool to the surgical path;
moving the surgical tool with the robot arm in a position and direction corresponding to the surgical path using the robot movement quantity when the alignment error between the surgical tool and the surgical path is below the preset threshold, thereby performing the drilling operation.

### Claim 9 (depends on 8)

The method of claim 8, wherein the robot movement quantity comprises a translation direction component (“drobot”) and a rotation component (“rrobot”) of a tip of the surgical tool in the base coordinate frame of the robot arm (“Crobot”), wherein:
drobot=(Rrobotscan)Tetrans,
wherein Rrobotscan is a rotation matrix from the coordinate frame of the surface scanner (“Cscan”), and etrans indicates a translational error quantity, and wherein:
rrobot=(Rrobotscan)Terot,
wherein erot indicates a rotational error quantity.

### Claim 10 (depends on 9)

The method of claim 9, wherein the translational error quantity of the robot movement quantity is determined by the following formula:
etrans=dtoolpath−(dtoolpath·nscanpath)nscanpath,
wherein dtoolpath is a translational direction of the tip of the surgical tool in Crobot and nscanpath is a translational direction of the surgical path in Cscan.

### Claim 11 (depends on 9)

The method of claim 9, wherein the rotational error quantity of the robot movement quantity is determined by the following formula:
e
rot
=
r
tool
path

r
tool
path

⁢
cos
-
1
⁡
(
n
scan
path
·
n
scan
tool

n
scan
path

⁢

n
scan
tool

)
wherein rtoolpath is a rotational component of the surgical path in in Crobot, nscantool is a translational direction of the tip of the surgical tool in Cscan, and nscanpath is a translational direction of the surgical path in Cscan.

### Claim 12 (depends on 8)

The method of claim 8, wherein the 3D image data is acquired with a CT or MRI machine.

### Claim 13 (depends on 8)

The method of claim 8, wherein the surface geometry data extracted from the 3D image data is selected from the group consisting of point clouds, triangular facets and meshes.

### Claim 14 (depends on 8)

The method of claim 8, further comprising the step of preprocessing the surface geometry data, wherein preprocessing of the surface geometry data comprises the steps of down-sampling the data and removing a portion of the data corresponding to areas of the target surgery area which cannot be viewed from the surface scanner.

### Claim 15 (depends on 8)

The method of claim 8, wherein a position and direction of the surgical path is continuously tracked by the surface scanner while aligning the surgical tool to the surgical path and moving the surgical tool with the robot arm in the position and direction corresponding to the surgical path.

### Claim 16 (depends on 15)

The method of claim 15, further comprising the steps of:
segmenting the surgical tool from the color 3D image data obtained from the scanner using binarization and morphologic operations;
segmenting surface data corresponding to the segmented area of the previous step;
registering the segmented surface data of the previous step to a CAD model of the surgical tool to acquire a transformation from the CAD model of the surgical tool to the surgical tool;
calculating position and direction of the surgical tool with respect to the surface scanner.

### Claim 17 (depends on 8)

The method of claim 8, wherein registering the robot arm to the surface scanner comprises the steps of:
recording a first direction of the surgical tool tracked by the surface scanner and also calculating a direction of the surgical tool with respect to a base coordinate frame of a robot arm coordinate frame using kinematic data obtained from the robot arm;
pointing the surgical tool to a second direction, recording the direction of the surgical tool tracked by the surface scanner and also calculating the direction of the surgical tool with respect to the base coordinate frame of the robot arm using the kinematic data obtained from the robot arm;
calculating the rotation matrix from the base coordinate frame of the robot arm to a coordinate frame of the surface scanner according to the directions in both coordinate frames acquired in the previous two steps using a singular value decomposition method.

### Claim 18 (depends on 17)

The method of claim 17, wherein the singular value decomposition method is performed using the following singular value decomposition equation:
R
robot
scan
=
argmin
R
∈
Rotation
⁢
⁢
matrix
⁢
∑
i
=
1
,
2
⁢

R
⁡
(
n
robot
tool
)
i
-
(
n
robot
tool
)
i

wherein R is a rotation matrix, Rrobotscan is the rotation matrix from a base coordinate frame of the robot arm to a coordinate frame of the surface scanning equipment, nrobottool is a direction of the distal end of the surgical drill obtained using kinematic data obtained from the robot arm, and nscantool is a direction of the distal end of the surgical drill obtained from image data from the scanner.
