# US 11,158,062 B2 · Automated implant movement analysis systems and related methods > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 11,158,062 B2 - Document ID: US11158062B2 - Status: Granted - Kind: B2 - Application number: 16/752,799 - Filed: 2020-01-27 - Published: 2020-08-13 - Granted: 2021-10-26 - Earliest claimed: 2019-02-13 - Assignees: Sectra AB - Applicants: Sectra AB - Inventors: Olof Sandberg; Claes Lundström - Web page: https://patentgrep.com/patent/US11158062B2 ## CPC - G16H 50/70: for mining of medical data, e.g. analysing previous cases of other patients - A61B 34/10: Computer-aided planning, simulation or modelling of surgical operations - G06F 18/22: Matching criteria, e.g. proximity measures - G06T 7/0012: {Biomedical image inspection} - G06T 7/0014: {using an image reference approach} - G06T 7/0016: {involving temporal comparison} - G06T 7/11: Region-based segmentation - G06T 7/174: involving the use of two or more images - G06T 7/215: Motion-based segmentation - G06T 7/30: Determination of transform parameters for the alignment of images, i.e. image registration - G06T 7/38: Registration of image sequences - G06V 10/754: {involving a deformation of the sample pattern or of the reference pattern; Elastic matching} - G16H 20/40: relating to mechanical, radiation or invasive therapies, e.g. surgery, laser therapy, dialysis or acupuncture - G16H 30/20: for handling medical images, e.g. DICOM, HL7 or PACS - G16H 30/40: for processing medical images, e.g. editing - G16H 50/50: for simulation or modelling of medical disorders - A61B 2034/102: {Modelling of surgical devices, implants or prosthesis} - A61B 2576/00: Medical imaging apparatus involving image processing or analysis (A61B1/00009, A61B6/52 and A61B8/52 take precedence) - G06T 2207/10028: Range image; Depth image; 3D point clouds - G06T 2207/10081: Computed x-ray tomography [CT] - G06T 2207/30008: Bone - G06T 2207/30052: Implant; Prosthesis - G06V 2201/03: Recognition of patterns in medical or anatomical images - G16H: HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA - A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D) - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING ## Abstract Methods, systems, workstations, and computer program products that provide automated implant analysis of batches of image data sets of a plurality of different patients having an implant coupled to bone using a first data set of a first patient from the batch of image data sets, the first data set comprising a first image stack and a second image stack and allowing a user to select parameter settings for implant movement analysis of the implant including selecting a first object of interest and a second reference object. Measurements of movement of the implant and/or coupled bone can be automatically calculated and selected parameter settings can be automatically propagated to other image data sets of other patients of the batch of image data sets and measurements for the batch of image data sets of others of the different patients can be automatically calculated. ## Claims ### Claim 1 An automated implant analysis method comprising: obtaining a batch of image data sets of a plurality of different patients having an implant coupled to bone; providing a first data set of a first patient from the batch of image data sets, the first data set comprising a first image stack and a second image stack; allowing a user to select parameter settings for implant movement analysis of the implant including selecting a first object of interest and a second reference object; segmenting the first image stack and the second image stack to identify corresponding object pairs of the first object and the second object; registering each of the identified object pairs; automatically calculating measurements of movement of the implant and/or coupled bone after the registration; automatically propagating the selected parameter settings to other image data sets of other patients of the batch of image data sets; and electronically automatically repeating the segmentation, registration and calculated measurements for the batch of image data sets of others of the different patients. ### Claim 2 (depends on 1) The method of claim 1, wherein the first object is a target study object, wherein one of the first object and the second reference object is the implant, wherein the parameter settings include relating a coordinate system to the reference object, and identifying which measurements are to be calculated such as rotation and location of selected points of interest of the target study object. ### Claim 3 (depends on 1) The method of claim 1, wherein, after the first data set is analyzed, for identifying the first and second objects in the image data sets of the others of the different patients before a respective registration, the implant and associated position is first automatically electronically identified, then the second object is identified using the implant position as guidance. ### Claim 4 (depends on 1) The method of claim 1, further comprising automatically electronically defining a cohort analysis template based on the user selected parameter settings and the first object and the second reference object of the data set of the first patient, and wherein the cohort analysis template is used to automatically propagate the selected parameter settings to the other image data sets thereby using identical parameter settings across all comparisons provided by the calculated measurements. ### Claim 5 (depends on 1) The method of claim 1, further comprising providing a display of results of the calculated measurement of movement of the implant in the batch of image data sets. ### Claim 6 (depends on 1) The method of claim 1, further comprising providing a visualization of an aggregated view of overlying registered images of image data sets of the different patients with overlapping regions visually deemphasized relative to outliers. ### Claim 7 (depends on 6) The method of claim 6, wherein the overlapping regions have a reduced optical opacity relative to the outliers and/or are presented translucent or transparent. ### Claim 8 (depends on 6) The method of claim 6, wherein the visualization is presented with sub-regions shown with different opacities or contrast, and wherein different sub-regions are shown with an opacity and/or contrast that is inversely proportional to a number of objects overlapping in a respective sub-region. ### Claim 9 (depends on 1) The method of claim 1, further comprising displaying thumbnail images of registered objects of different patients. ### Claim 10 (depends on 9) The method of claim 9, further comprising: electronically linking the thumbnail images to an aggregated view of all the registered objects of the different patients; and allowing a user to navigate from a selected thumbnail image to the aggregated view. ### Claim 11 (depends on 1) The method of claim 1, wherein the segmenting step is carried out automatically, and wherein the method further comprises automatically repeating the segmenting step using different tuning parameters before the registering step to thereby provide more accurate segmentation of the first and second objects. ### Claim 12 (depends on 1) The method of claim 1, further comprising, before the segmenting step, automatically selecting relevant image stack pairs from the first and second patient image stacks, wherein the image stack pairs have the first and/or second object. ### Claim 13 (depends on 1) The method of claim 1, further comprising providing an electronic implant blueprint corresponding to the implant, wherein one or more of the segmenting, registering or calculating measurements is carried out using the electronic implant blueprint. ### Claim 14 (depends on 1) The method of claim 1, further comprising providing an electronic implant blueprint corresponding to the implant, wherein the segmenting is carried out a plurality of times for the first data set using a plurality of different threshold levels that varies noise levels to match the blueprint with the segmented first and/or second object. ### Claim 15 (depends on 1) The method of claim 1, further comprising providing an electronic implant blueprint corresponding to the implant, wherein the registration comprises matching point clouds of points generated on one or more surfaces of the first and/or second object. ### Claim 16 (depends on 1) The method of claim 1, further comprising: providing an electronic implant blueprint corresponding to the implant; defining points on the electronic implant blueprint where measurements are to be made; and transferring the defined points to an image-domain implant, wherein the registration is carried out using the defined points. ### Claim 17 (depends on 1) The method of claim 1, further comprising: providing an electronic implant blueprint corresponding to the implant; electronically defining reference points on the electronic implant blueprint; then electronically translating the blueprint reference points to the segmented implant object, wherein the automatically calculating measurements of movement of the implant and/or coupled bone after the registration is carried out using the translated blueprint reference points. ### Claim 18 (depends on 1) The method of claim 1, further comprising: providing an electronic implant blueprint corresponding to the implant; and electronically defining focus surface locations on the electronic implant blueprint, wherein, before the registration, automatically electronically translating the blueprint focus surface locations to corresponding locations on segmented first and/or second object, then generating an unevenly distributed point cloud with higher concentration at focus surface locations, then performing the registration using the generated point cloud. ### Claim 19 (depends on 1) The method of claim 1, wherein, before the registration, automatically electronically deriving shape characteristics across one or more surfaces of a segmented first and/or second object, then electronically defining high curvature locations as focus surface locations, then electronically generating an unevenly distributed point cloud with higher concentration at focus surface locations, then electronically performing the registration using the generated point cloud. ### Claim 20 (depends on 1) The method of claim 1, further comprising: providing an electronic implant blueprint corresponding to the implant in the first patient; electronically comparing a segmented first or second reference object to the implant blueprint; and adjusting segmentation parameters and repeating the segmentation of the first data set. ### Claim 21 (depends on 1) A workstation comprising or in communication with an image processing circuit configured to carry out the method of claim 1. ### Claim 22 (depends on 9) The method of claim 9, wherein the thumbnail images of registered objects of different patients are sorted by an amount of calculated measurement of movement. ### Claim 23 (depends on 10) The method of claim 10, wherein the selected thumbnail image is visually emphasized in the aggregated view relative to other registered images of other thumbnail images.