# US 2017/0245942 A1 · System and Method For Precision Position Detection and Reproduction During Surgery

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2017/0245942 A1
- Document ID: US20170245942A1
- Status: Published application
- Kind: A1
- Application number: 15/443,742
- Filed: 2017-02-27
- Published: 2017-08-31
- Earliest claimed: 2016-02-26
- Assignees: Radlink, Inc.
- Applicants: Radlink, Inc.
- Inventors: Brad L. Penenberg; Wenchao Tao
- Web page: https://patentgrep.com/patent/US20170245942A1

## CPC

- A61B 34/20: Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis
- A61B 5/067: {using accelerometers or gyroscopes}
- A61B 5/1114: {Tracking parts of the body}
- A61B 6/463: {characterised by displaying multiple images or images and diagnostic data on one display}
- A61B 6/50: specially adapted for specific body parts; specially adapted for specific clinical applications
- A61B 6/505: {for diagnosis of bone}
- A61B 90/37: {Surgical systems with images on a monitor during operation}
- G06T 11/60: Creating or editing images; Combining images with text
- G06T 13/20: Three-dimensional [3D] animation
- G06T 13/80: Two-dimensional [2D] animation, e.g. using sprites
- G06T 19/20: Editing of three-dimensional [3D] images, e.g. changing shapes or colours, aligning objects or positioning parts
- A61B 5/064: {using markers (A61B5/062 takes precedence)}
- A61B 2034/2048: {using an accelerometer or inertia sensor}
- A61B 2034/2055: {Optical tracking systems}
- A61B 2034/2063: {Acoustic tracking systems, e.g. using ultrasound}
- A61B 2034/254: {being adapted depending on the stage of the surgical procedure}
- A61B 2090/376: {using X-rays, e.g. fluoroscopy}
- A61B 2505/05: Surgical care
- A61B 2562/0219: Inertial sensors, e.g. accelerometers, gyroscopes, tilt switches
- G06T 2210/41: Medical
- G06T 2219/2004: Aligning objects, relative positioning of parts
- A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

A computerized visual orientation surgery assist system and method receives initial anatomic image information of a patient scan, which may be taken at a registration position of the patient; receives initial surgical instrument positional information from a first positional sensor positioned on a surgical instrument, where the positional sensor senses three-dimensional spatial position transmits the surgical instrument positional information; establishes the initial surgical instrument positional information as a surgical instrument origin in three-dimensional space for the initial anatomic image information; displays a visual representation of the initial anatomic image information on a computerized display, the visual representation including a surgical instrument representation based on the initial surgical instrument positional information; receives subsequent surgical instrument positional information from the first sensor associated with movement of the surgical instrument; and updates the computerized display to reflect the subsequent surgical instrument positional information.

## Claims

### Claim 1

A visual orientation surgery assist system comprising:
a first positional sensor positioned on a surgical instrument, the first positional sensor sensing three-dimensional spatial position and transmitting three-dimensional positional information of the surgical instrument; and
a computerized display system including a display, a receiver receiving the positional information, a microcontroller operatively coupled to the receiver and to the display and having access to system memory, the system memory including software instructions causing the microcontroller to perform the steps of:
receiving initial anatomic image information of a patient scan taken at a registration position of a patient;
receiving initial positional information of the surgical instrument from the first positional sensor;
establishing the initial positional information of the surgical instrument as a surgical instrument origin in three-dimensional space for the initial anatomic image information;
displaying a visual representation of the initial anatomic image information on the display, the visual representation including a representation of the surgical instrument based on the initial positional information of the surgical instrument;
receiving subsequent positional information of the surgical instrument from the first positional sensor associated with movement of the surgical instrument; and
updating the display to reflect the subsequent positional information of the surgical instrument.

### Claim 2 (depends on 1)

The visual orientation surgery assist system of claim 1, further comprising a second positional sensor positioned on the patient, the second positional sensor sensing three-dimensional spatial position and transmitting three-dimensional positional information of the patient;
wherein the system memory further includes software instructions causing the microcontroller to perform the steps of:
receiving initial positional information of the patient from the second positional sensor;
establishing the initial positional information of the patient as a patient origin in three-dimensional space for the initial anatomic image information;
receiving subsequent positional information of the patient from the second positional sensor associated with movement of the patient; and
updating the display to reflect the subsequent positional information of the patient with respect to the initial positional information of the patient.

### Claim 3 (depends on 2)

The visual orientation surgery assist system of claim 2, wherein the system memory further includes software instructions causing the microcontroller to perform the step of:
updating the display to reflect the subsequent positional information of the surgical instrument with respect to one of the initial positional information of the patient and subsequent positional information of the patient.

### Claim 4 (depends on 1)

The visual orientation surgery assist system of claim 1, wherein the first positional sensor includes at least one of a triple-axis gyrometer, a triple-axis accelerometer, and a triple-axis magnetometer.

### Claim 5 (depends on 1)

The visual orientation surgery assist system of claim 1, wherein the first positional sensor includes an ultrasound sensor.

### Claim 6 (depends on 1)

The visual orientation surgery assist system of claim 1, wherein the first positional sensor includes a laser sensor.

### Claim 7 (depends on 1)

The visual orientation surgery assist system of claim 1, wherein the first positional sensor includes a motion sensor.

### Claim 8 (depends on 1)

The visual orientation surgery assist system of claim 1, wherein the positional information of the surgical instrument transmitted by the first positional sensor includes pitch, yaw, and roll information.

### Claim 9 (depends on 1)

The visual orientation surgery assist system of claim 1, wherein the patient scan includes an x-ray scan.

### Claim 10 (depends on 9)

The visual orientation surgery assist system of claim 9, wherein the visual representation of the initial anatomic image information on the display includes x-ray scan images.

### Claim 11 (depends on 1)

The visual orientation surgery assist system of claim 1, wherein the subsequent positional information of the surgical instrument updated to the display includes translational information with respect to the surgical instrument origin overlaid with the visual representation of the initial anatomic image information.

### Claim 12 (depends on 3)

The visual orientation surgery assist system of claim 3, wherein the subsequent positional information of the surgical instrument updated to the display includes translational information with respect to the patient origin overlaid with the visual representation of the initial anatomic image information.

### Claim 13 (depends on 3)

The visual orientation surgery assist system of claim 3, wherein the software instructions cause the microcontroller to perform the additional step of providing at least one of a visual and an audible notification when the subsequent positional information of the surgical instrument updated to the display reaches a predetermined proximity to the patient origin.

### Claim 14 (depends on 1)

The visual orientation surgery assist system of claim 1, wherein the software instructions cause the microcontroller to perform the additional step of providing at least one of a visual and an audible notification when the subsequent positional information of the surgical instrument updated to the display reaches a predetermined distance from the surgical instrument origin.

### Claim 15 (depends on 3)

The visual orientation surgery assist system of claim 3, wherein the subsequent positional information of the patient updated to the display and the subsequent positional information of the surgical instrument updated to the display include reference lines reflecting updated orientations for surgical procedural steps overlaid with the visual representation of the initial anatomic image information.

### Claim 16 (depends on 3)

The visual orientation surgery assist system of claim 3, wherein the subsequent positional information of the patient updated to the display and the subsequent positional information of the surgical instrument updated to the display include reference ellipses reflecting updated orientations for surgical procedural steps overlaid with the visual representation of the initial anatomic image information.

### Claim 17 (depends on 1)

The visual orientation surgery assist system of claim 1, wherein the visual representation of the initial anatomic image information on the display includes an animated virtual representation of the surgical instrument associated with the location of the first positional sensor.

### Claim 18 (depends on 3)

The visual orientation surgery assist system of claim 3, wherein the visual representation of the initial anatomic image information on the display includes an animated virtual representation of an anatomical body part associated with the location of the second positional sensor on the patient's anatomy.

### Claim 19 (depends on 17)

The visual orientation surgery assist system of claim 17, wherein the subsequent positional information of the surgical instrument updated to the display includes animation of the virtual representation of the surgical instrument reflecting a change in three-dimensional spatial position between the initial positional information of the surgical instrument and the subsequent positional information of the surgical instrument.

### Claim 20 (depends on 3)

The visual orientation surgery assist system of claim 3,
wherein the visual representation of the initial anatomic image information on the display includes an animated virtual representation of the surgical instrument associated with the location of the first positional sensor;
wherein the visual representation of the initial anatomic image information on the display includes an animated virtual representation of an anatomical body part associated with the location of the second positional sensor on the patient's anatomy;
wherein the subsequent positional information of the surgical instrument updated to the display includes animation of the virtual representation of the surgical instrument;
wherein the subsequent positional information of the patient updated to the display includes animation of the virtual representation of the anatomical body part; and
wherein the animation of at least one of the virtual representation of the anatomical body part and the virtual representation of the surgical instrument includes a representation of surgical steps to be performed with respect to the anatomical body part.

### Claim 21 (depends on 20)

The visual orientation surgery assist system of claim 20, wherein the representation of surgical steps to be performed with respect to the anatomical body part is an animated representation of surgical steps that represent movement of at least one of the surgical instrument and the patient.

### Claim 22 (depends on 3)

The visual orientation surgery assist system of claim 3, wherein the second positional sensor is positioned on the patient's skin over a bony prominence using one of an adhesive and an incise drape.

### Claim 23 (depends on 3)

The visual orientation surgery assist system of claim 3, wherein the second positional sensor is positioned on the patient's bone using pins.

### Claim 24 (depends on 3)

The visual orientation surgery assist system of claim 3, wherein the system memory further includes software instructions causing the microcontroller to perform the steps of:
receiving subsequent anatomic image information of a patient scan;
updating the display to include the subsequent anatomic image information; and
providing an indication of whether a corrective surgical step needs to be performed.

### Claim 25

A computerized visual orientation surgery assist method comprising the steps of:
receiving initial anatomic image information of a patient scan taken at a registration position of a patient;
receiving initial surgical instrument positional information from a first positional sensor positioned on a surgical instrument, the first positional sensor sensing three-dimensional spatial position and transmitting three-dimensional positional information of the surgical instrument;
establishing the initial surgical instrument positional information as a surgical instrument origin in three-dimensional space for the initial anatomic image information;
displaying a visual representation of the initial anatomic image information on a computerized display, the visual representation including a surgical instrument representation based on the initial surgical instrument positional information;
receiving subsequent surgical instrument positional information from the first positional sensor associated with movement of the surgical instrument; and
updating the computerized display to reflect the subsequent surgical instrument positional information.

### Claim 26 (depends on 25)

The method of claim 25, wherein the step of updating the computerized display includes displaying an indication that reflects the subsequent surgical instrument positional information with respect to the surgical instrument origin.

### Claim 27 (depends on 25)

The method of claim 25, further comprising the steps of:
receiving initial patient positional information from a second positional sensor positioned on a patient, the second positional sensor sensing three-dimensional spatial position and transmitting three-dimensional positional information of the patient;
establishing the initial patient positional information as a patient origin in three-dimensional space for the initial anatomic image information;
receiving subsequent patient positional information from the second positional sensor associated with movement of the patient; and
updating the computerized display to reflect the subsequent patient positional information with respect to the initial patient positional information.

### Claim 28 (depends on 27)

The method of claim 27, further comprising the step of updating the computerized display to reflect the subsequent surgical instrument positional information with respect to one of the initial patient positional information and subsequent patient positional information.

### Claim 29 (depends on 25)

The method of claim 25, wherein the step of displaying a visual representation of the initial anatomic image information on the computerized display includes displaying one or more x-ray images from the patient scan.

### Claim 30 (depends on 25)

The method of claim 25, wherein the steps of receiving initial surgical instrument positional information and receiving subsequent surgical instrument positional information include receiving pitch, yaw, and roll information from the first positional sensor.

### Claim 31 (depends on 30)

The method of claim 30, wherein the step of updating the computerized display includes displaying tilt and rotation information of the surgical instrument overlaid with the visual representation of the initial anatomic image information.

### Claim 32 (depends on 25)

The method of claim 25, wherein the step of updating the computerized display includes displaying translational information of the surgical instrument based on the subsequent surgical instrument positional information with respect to the surgical instrument origin overlaid with the visual representation of the initial anatomic image information.

### Claim 33 (depends on 28)

The method of claim 28, wherein the step of updating the computerized display includes displaying translational information of the surgical instrument based on the subsequent surgical instrument positional information with respect to the patient origin overlaid with the visual representation of the initial anatomic image information.

### Claim 34 (depends on 28)

The method of claim 28, further comprising a step of providing at least one of a visual and an audible notification when the subsequent surgical instrument positional information updated to the computerized display reaches a predetermined proximity to the patient origin.

### Claim 35 (depends on 25)

The method of claim 25, further comprising a step of providing at least one of a visual and an audible notification when the subsequent surgical instrument positional information updated to the computerized display reaches a predetermined distance from the surgical instrument origin.

### Claim 36 (depends on 28)

The method of claim 28, wherein the step of updating the computerized display includes displaying reference lines based on the subsequent surgical instrument positional information and the subsequent patient positional information, the reference lines reflecting updated orientations for surgical procedural steps, overlaid with the visual representation of the initial anatomic image information.

### Claim 37 (depends on 28)

The method of claim 28, wherein the step of updating the computerized display includes displaying reference ellipses based on the subsequent surgical instrument positional information and the subsequent patient positional information, the reference ellipses reflecting updated orientations for surgical procedural steps, overlaid with the visual representation of the initial anatomic image information.

### Claim 38 (depends on 25)

The method of claim 25, wherein the step of displaying a visual representation of the initial anatomic image information on the computerized display includes displaying an animated virtual representation of the surgical instrument associated with the location of the first positional sensor.

### Claim 39 (depends on 28)

The method of claim 28, wherein the step of updating the computerized display includes displaying an animated virtual representation of an anatomical body part associated with the location of the second positional sensor on the patient's anatomy.

### Claim 40 (depends on 38)

The method of claim 38, wherein the step of updating the computerized display includes displaying animation of the virtual representation of the surgical instrument reflecting a change in three-dimensional spatial position between the initial surgical instrument positional information and the subsequent surgical instrument positional information.

### Claim 41 (depends on 28)

The method of claim 28,
wherein the step of displaying the visual representation of the initial anatomic image information on the computerized display includes displaying an animated virtual representation of the surgical instrument associated with the location of the first positional sensor;
wherein the step of displaying the visual representation of the initial anatomic image information on the computerized display includes displaying an animated virtual representation of an animated body part associated with the location of the second positional sensor on the patient's anatomy;
wherein the step of updating the computerized display to reflect the subsequent surgical instrument positional information includes displaying animation of the virtual representation of the surgical instrument;
wherein the step of updating the computerized display to reflect the subsequent patient positional information includes displaying animation of the virtual representation of the anatomical body part; and
wherein at least one of the step of displaying animation of the virtual representation of the surgical instrument and the step of displaying animation of the virtual representation of the anatomical body part includes displaying a representation of surgical steps to be performed with respect to the anatomical body part.

### Claim 42 (depends on 41)

The method of claim 41, wherein displaying the representation of surgical steps to be performed with respect to the anatomical body part includes displaying an animated representation or surgical steps that represent movement of at least one of the surgical instrument and the patient.

### Claim 43 (depends on 27)

The method of claim 27, wherein the second positional sensor is positioned on the patient's skin over a bony prominence using one of an adhesive and an incise drape.

### Claim 44 (depends on 27)

The method of claim 27, wherein the second positional sensor is positioned on the patient's bone using pins.

### Claim 45 (depends on 27)

The method of claim 27, further comprising the steps of:
receiving subsequent anatomic image information of a patient scan;
updating the display to include the subsequent anatomic image information; and
providing an indication of whether a corrective surgical step needs to be performed.

### Claim 46

A visual orientation surgery assist system comprising:
a first positional sensor positioned on a surgical instrument, the first positional sensor sensing three-dimensional spatial position and transmitting three-dimensional positional information of the surgical instrument;
a second positional sensor positioned on a patient, the second positional sensor sensing three-dimensional spatial position and transmitting three-dimensional positional information of the patient;
a computerized display system including a display, a receiver receiving the positional information from the first positional sensor and the second positional sensor, a microcontroller operatively coupled to the receiver and to the display and having access to system memory, the system memory including software instructions causing the microcontroller to perform the steps of:
receiving initial anatomic image information of a patient scan;
receiving initial surgical instrument positional information from the first positional sensor and initial patient positional information from the second positional sensor;
displaying a visual representation of the initial anatomic image information on the display, the visual representation including a surgical instrument representation based on the initial surgical instrument positional information and an anatomical body part representation based on the initial patient positional information;
receiving subsequent surgical instrument positional information from the first positional sensor associated with movement of the surgical instrument;
receiving subsequent patient positional information from the second positional sensor associated with movement of the patient; and
updating the surgical instrument representation to reflect the subsequent surgical instrument positional information and the anatomical body part representation to reflect the subsequent patient positional information.
