# US 2020/0402639 A1 · Systems and methods for planning and performing a computer assisted procedure

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2020/0402639 A1
- Document ID: US20200402639A1
- Status: Published application
- Kind: A1
- Application number: 16/904,907
- Filed: 2020-06-18
- Published: 2020-12-24
- Earliest claimed: 2019-06-21
- Assignees: Intellijoint Surgical Inc.
- Applicants: Intellijoint Surgical Inc.
- Inventors: ANDRE NOVOMIR HLADIO; JOSEPH ARTHUR SCHIPPER; JUSTIN AARON MICHAEL
- Web page: https://patentgrep.com/patent/US20200402639A1

## CPC

- G16H 20/40: relating to mechanical, radiation or invasive therapies, e.g. surgery, laser therapy, dialysis or acupuncture
- A61B 34/10: Computer-aided planning, simulation or modelling of surgical operations
- G06F 30/10: Geometric CAD
- G06Q 10/06316: {Sequencing of tasks or work}
- G06T 3/14: Transformations for image registration, e.g. adjusting or mapping for alignment of images
- G06T 3/147: using affine transformations
- G06T 7/344: {involving models}
- G06T 17/00: Three-dimensional [3D] modelling for computer graphics
- G16H 30/40: for processing medical images, e.g. editing
- G16H 40/20: for the management or administration of healthcare resources or facilities, e.g. managing hospital staff or surgery rooms
- G16H 50/20: for computer-aided diagnosis, e.g. based on medical expert systems
- G16H 50/50: for simulation or modelling of medical disorders
- A61B 34/20: Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis
- A61B 2034/105: {Modelling of the patient, e.g. for ligaments or bones}
- A61B 2090/364: {Correlation of different images or relation of image positions in respect to the body}
- A61B 2090/3762: {using computed tomography systems [CT]}
- G06F 2111/16: Customisation or personalisation
- G06T 2207/10081: Computed x-ray tomography [CT]
- G06T 2207/10116: X-ray image
- G06T 2210/41: Medical
- G16H 40/63: for local operation
- G16H: HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D)
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

Preoperative planning of a procedure such as an orthopedic procedure is enabled to use first images of patient anatomy in a functional position to define a 3D model and a plan for the procedure and to export the plan to systems configured to use surface information derived from second images of the patient. First images may comprise X-rays including biplanar X-rays. Second images may comprise volumetric datasets such as CT scans. The plans and the surface information may be used together via relative to a common coordinate system. Systems configured to use surface information derived from CT scans, typically of patients in non-functional positions are thus enabled to use plans prepared from images of patients in functional positions such as from (synchronized) biplanar X-rays of patient anatomy.

## Claims

### Claim 1

A computing device comprising a processor and a non-transient storage device storing instructions which when executed by the processor configure the computing device to:
define a 3D model from first images of a patient's anatomy;
define a plan using the 3D model to assist to perform a procedure on the patient's anatomy;
co-register the plan and surface information obtained from second images of the patient's anatomy to a common coordinate system; and
export the plan and the surface information as co-registered for use by a second computing device configured to assist with the procedure.

### Claim 2 (depends on 1)

The computing device of claim 1, wherein to co-register comprises defining co-registration information to enable use of the plan and the surface information obtained from second images of the patient's anatomy relative to the common coordinate system; and wherein defining co-registration information comprises computing a rigid transformation that minimizes a metric of agreement between surface information derived from the first images and the surface information derived from the second images.

### Claim 3 (depends on 2)

The computing device of claim 2, configured to use an iterative closet point algorithm to minimize the metric of agreement.

### Claim 4 (depends on 2)

The computing device of claim 2, wherein defining co-registration information comprises receiving a candidate co-registration and providing for display a visualization, metric, or other indicator of agreement between the surface information under the candidate co-registration and the first images alongside a user interface that enables a user to change and/or accept the candidate co-registration

### Claim 5 (depends on 2)

The computing device of claim 2, wherein to export includes exporting the co-registration information.

### Claim 6 (depends on 1)

The computing device of claim 1, wherein the patient's anatomy in the first images is in a functional position.

### Claim 7 (depends on 1)

The computing device of claim 1, wherein the first images comprise biplanar X-rays.

### Claim 8 (depends on 1)

The computing device of claim 1, wherein the patient's anatomy of the second images is in a non-functional position.

### Claim 9 (depends on 1)

The computing device claim 1, wherein the second images comprise at least one of:
images defined in accordance with computed tomography (CT) techniques;
DICOM images; and
a segmented 3D model.

### Claim 10 (depends on 1)

The computing device of claim 1, further configured to at least one of: receive the surface information defined from the second images; and, receive the second images and define the surface information from the second images.

### Claim 11 (depends on 1)

The computing device claim 1, further configured to provide workflow to guide a user to provide input to perform at least one of:
defining the 3D model;
defining the plan;
defining the co-registration information; and
exporting the plan and surface information.

### Claim 12 (depends on 1)

The computing device of claim 1, further configured to define the co-registration information to additionally co-register one or both of the first images and the 3D model for use with the common coordinate system and wherein to export further includes exporting one or both of the first images and the 3D model in the common coordinate system.

### Claim 13

A computing device comprising a processor and a non-transient storage device storing instructions which when executed by the processor configure the computing device to:
co-register a plan for a procedure with respect to a patient's anatomy with surface information for the patient's anatomy relative to a common coordinate system, the plan defined from first images of the patient's anatomy and the surface information obtained from second images of the patient's anatomy; and
export the plan and the surface information as co-registered for use by a second computing device configured to assist with the procedure.

### Claim 14 (depends on 13)

The computing device of claim 13, wherein to co-register comprises defining co-registration information to enable use of the plan with the surface information obtained from the second images of the patient's anatomy relative to the common coordinate system; and wherein defining co-registration information comprises computing a rigid transformation that minimizes a metric of agreement between surface information derived from the first images and the surface information derived from the second images.

### Claim 15 (depends on 14)

The computing device of claim 14, wherein defining co-registration information comprises receiving a candidate co-registration and providing for display a visualization, metric, or other indicator of agreement between the surface information under the candidate co-registration and the first images alongside a user interface that enables a user to change and/or accept the candidate co-registration.

### Claim 16 (depends on 14)

The computing device of claim 14, wherein to export includes exporting the co-registration information.

### Claim 17 (depends on 13)

The computing device of claim 13, wherein the patient's anatomy in the first images is in a functional position and wherein the patient's anatomy of the second images is in a non-functional position.

### Claim 18 (depends on 13)

The computing device of claim 13, wherein the first images comprise biplanar X-rays.

### Claim 19 (depends on 13)

The computing device of claim 13, wherein the second images comprise images defined in accordance with computed tomography (CT) techniques.

### Claim 20 (depends on 13)

The computing device of claim 13, wherein the computing device is at least one of: further configured to receive the plan defined from the first images; and further configured to receive the second images and define the surface information from the second images.
