# US 2021/0082115 A1 · System and method for creating a decision support material indicating damage to an anatomical joint

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0082115 A1
- Document ID: US20210082115A1
- Status: Published application
- Kind: A1
- Application number: 17/107,765
- Filed: 2020-11-30
- Published: 2021-03-18
- Earliest claimed: 2015-12-18
- Assignees: Episurf IP-Management AB
- Applicants: Episurf IP-Management AB
- Inventors: Richard LILLIESTRÅLE; Anders KARLSSON; Jeanette SPÅNGBERG; Nina BAKE
- Web page: https://patentgrep.com/patent/US20210082115A1

## CPC

- A61B 6/466: {adapted to display 3D data}
- A61B 6/505: {for diagnosis of bone}
- A61B 6/5211: {involving processing of medical diagnostic data}
- A61B 6/5217: {extracting a diagnostic or physiological parameter from medical diagnostic data}
- A61B 34/10: Computer-aided planning, simulation or modelling of surgical operations
- A61F 2/30942: {for designing or making customized prostheses, e.g. using templates, CT or NMR scans, finite-element analysis or CAD-CAM techniques}
- G06F 18/22: Matching criteria, e.g. proximity measures
- G06F 18/24: Classification techniques
- G06T 7/0012: {Biomedical image inspection}
- G06T 7/13: Edge detection
- G06T 15/00: Three-dimensional [3D] image rendering
- G06T 17/00: Three-dimensional [3D] modelling for computer graphics
- G06T 19/00: Manipulating three-dimensional [3D] models or images for computer graphics
- G06V 10/751: {Comparing pixel values or logical combinations thereof, or feature values having positional relevance, e.g. template matching}
- G06V 20/647: {by matching two-dimensional images to three-dimensional objects}
- G16H 30/20: for handling medical images, e.g. DICOM, HL7 or PACS
- G16H 30/40: for processing medical images, e.g. editing
- G16H 50/20: for computer-aided diagnosis, e.g. based on medical expert systems
- G16H 50/70: for mining of medical data, e.g. analysing previous cases of other patients
- A61B 17/17: Guides {or aligning means} for drills {, mills, pins or wires}
- A61B 17/1764: {for the knee}
- A61B 2034/102: {Modelling of surgical devices, implants or prosthesis}
- A61B 2034/105: {Modelling of the patient, e.g. for ligaments or bones}
- A61B 2034/107: {Visualisation of planned trajectories or target regions}
- A61B 2034/108: {Computer aided selection or customisation of medical implants or cutting guides}
- A61F 2/30756: {Cartilage endoprostheses (A61F2/3603 takes precedence)}
- A61F 2/32: for the hip
- A61F 2/38: for elbows or knees
- A61F 2/40: for shoulders
- A61F 2/42: for wrists or ankles; for hands, e.g. fingers; for feet, e.g. toes
- A61F 2002/30759: {Mosaicplasty, i.e. using a plurality of individual cartilage plugs for filling a substantial cartilage defect}
- A61F 2002/30948: {using computerized tomography, i.e. CT scans}
- A61F 2002/4633: {for selection of endoprosthetic joints or for pre-operative planning}
- G06T 2207/10116: X-ray image
- G06T 2207/30008: Bone
- G06T 2207/30204: Marker
- G06T 2210/41: Medical
- G06T 2219/004: Annotating, labelling
- G06V 2201/03: Recognition of patterns in medical or anatomical images
- A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D)
- A61F: FILTERS IMPLANTABLE INTO BLOOD VESSELS; PROSTHESES; DEVICES PROVIDING PATENCY TO, OR PREVENTING COLLAPSING OF, TUBULAR STRUCTURES OF THE BODY, e.g. STENTS; ORTHOPAEDIC, NURSING OR CONTRACEPTIVE DEVICES; FOMENTATION; TREATMENT OR PROTECTION OF EYES OR EARS; BANDAGES, DRESSINGS OR ABSORBENT PADS; FIRST-AID KITS (dental prosthetics A61C)
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G16H: HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA

## Abstract

In accordance with one or more embodiments herein, a system for creating a decision support material indicating damage to at least a part of an anatomical joint of a patient, wherein the created decision support material comprises one or more damage images, is provided. The system comprises a storage media and at least one processor, wherein the at least one processor is configured to i) receive a series of radiology images of the at least part of the anatomical joint from the storage media; ii) obtain a three-dimensional image representation of the at least part of the anatomical joint which is based on at least a part of said series of radiology images, by generating said three-dimensional image representation in an image segmentation process based on said series of radiology images, or receiving said three-dimensional image representation from a storage media; iii) identify tissue parts of the anatomical joint in at least one of at least a part of said series of radiology images and/or the three-dimensional image representation using image analysis; iv) determine damage to the identified tissue parts in the anatomical joint by analyzing at least one of at least a part of said series of radiology images and/or the three-dimensional image representation of the at least part of the anatomical joint; v) determine suitable sizes and suitable implanting positions for one or more graft plugs based on the determined damage; vi) mark damage to the anatomical joint and suitable sizes and implanting positions for the one or more graft plugs in the obtained three-dimensional image representation of the anatomical joint; and vii) generate a decision support material, where the determined damage to the at least part of the anatomical joint and the suitable sizes and implanting positions for the one or more graft plugs are marked in at least one of the one or more damage images of the decision support material, and at least one of the one or more damage images is generated based on the obtained three-dimensional image representation of the at least part of the anatomical joint.

## Claims

### Claim 1

A system for creating a decision support material indicating damage to at least a part of an anatomical joint of a patient, wherein the created decision support material comprises one or more damage images, the system comprising a storage media and at least one processor, wherein the at least one processor is configured to:
i) receive a series of radiology images of the at least part of the anatomical joint from the storage media;
ii) obtain a three-dimensional image representation of the at least part of the anatomical joint which is based on at least a part of said series of radiology images, by generating said three-dimensional image representation in an image segmentation process based on said series of radiology images, or receiving said three-dimensional image representation from a storage media;
iii) identify tissue parts of the anatomical joint in at least one of at least a part of said series of radiology images and/or the three-dimensional image representation using image analysis;
iv) determine damage to the identified tissue parts in the anatomical joint by analyzing at least one of at least a part of said series of radiology images and/or the three-dimensional image representation of the at least part of the anatomical joint;
v) determine suitable sizes and suitable implanting positions for one or more graft plugs based on the determined damage;
vi) mark damage to the anatomical joint and suitable sizes and implanting positions for the one or more graft plugs in the obtained three-dimensional image representation of the anatomical joint; and
vii) generate a decision support material, where the determined damage to the at least part of the anatomical joint and the suitable sizes and implanting positions for the one or more graft plugs are marked in at least one of the one or more damage images of the decision support material, and at least one of the one or more damage images is generated based on the obtained three-dimensional image representation of the at least part of the anatomical joint.

### Claim 2 (depends on 1)

The system according to claim 1, wherein at least one of the one or more damage images is an interactive 3D model of the anatomical joint or part of it.

### Claim 3 (depends on 1)

The system according to claim 1, wherein the processor is configured to identify bone parts and/or cartilage parts of the joint in said at least one radiology image by:
detecting high contrast areas such as edges or contours in the radiology image; and
identifying structures, such as bone and/or cartilage, in the radiology image through comparing the detected areas with predefined templates.

### Claim 4 (depends on 1)

The system according to claim 1, wherein the processor is configured to determine damage to the identified tissue parts in the anatomical joint by:
detecting an irregular shape of a contour of at least one tissue part of the anatomical joint; or
detecting that the intensity in an area within or adjacent to bone and/or cartilage parts of the anatomical joint is higher or lower than a predetermined value; or
comparing at least one identified tissue part with a template representing a predefined damage pattern for an anatomical joint;

### Claim 5 (depends on 1)

The system according to claim 1, wherein the processor is further configured to associate the radiology images and the three-dimensional image representation, so that a marking made in one of the images appears in the same position in another image.

### Claim 6 (depends on 1)

The system according to claim 1, wherein the anatomical joint is an ankle, and the damage that is determined and marked in at least one of the one or more damage images of the decision support material is related to the talus.

### Claim 7 (depends on 1)

The system according to claim 1, wherein the image analysis identifies both bone parts and cartilage parts of the anatomical joint or part of it and damage is determined to both the bone parts and the cartilage parts.

### Claim 8 (depends on 1)

The system according to claim 1, wherein the processor is configured to:
select a suitable implant from a predefined set of implants with varying dimensions, and/or propose a transfer guide tool for graft transplantation, possibly including suitable size and/or suitable harvesting and/or implantation positions for at least one graft plug based on data from the radiology images and/or the three-dimensional image representation of the at least part of the anatomical joint; and to
visualize the selected implant and/or the transfer guide tool and/or the suitable harvesting and/or implantation positions for at least one graft plug in at least one of the one or more damage images.

### Claim 9 (depends on 1)

The system according to claim 1, wherein the decision support material is adapted to be used by medical staff, and includes a recommendation for a suitable treatment for repair of the determined damage.

### Claim 10

A method for creating a decision support material indicating damage to at least a part of an anatomical joint of a patient, wherein the created decision support material comprises one or more damage images, the method comprising the steps of:
i) receiving a series of radiology images of the at least part of the anatomical joint;
ii) obtaining a three-dimensional image representation of the at least part of the anatomical joint which is based on at least a part of said series of radiology images, by generating said three-dimensional image representation in an image segmentation process based on said series of radiology images, or receiving said three-dimensional image representation from a storage media;
iii) identifying tissue parts of the anatomical joint in at least one of at least a part of said series of radiology images using image analysis;
iv) determining damage to the identified tissue parts in the anatomical joint by analyzing at least one of the at least a part of said series of radiology images and/or the three-dimensional image representation of the at least part of the anatomical joint;
v) determining suitable sizes and suitable implanting positions for one or more graft plugs based on the determined damage;
vi) marking damage to the anatomical joint and suitable sizes and implanting positions for the one or more graft plugs in the obtained three-dimensional image representation of the at least part of the anatomical joint; and
vii) generating a decision support material, where the determined damage to the anatomical joint and the suitable sizes and implanting positions for the one or more graft plugs are marked in at least one of the one or more damage images of the decision support material, and at least one of the one or more damage images is generated based on the obtained three-dimensional image representation of the at least part of the anatomical joint.

### Claim 11 (depends on 10)

The method according to claim 10, wherein at least one of the one or more damage images is an interactive 3D model of the anatomical joint or part of it.

### Claim 12 (depends on 10)

The method according to claim 10, wherein the image analysis identifies bone parts and/or cartilage parts of the joint in said at least one radiology image by the steps of:
detecting high contrast areas such as edges or contours in the radiology image; and
identifying structures, such as bone and/or cartilage, in the radiology image through comparing the detected edges or contours with predefined templates.

### Claim 13 (depends on 10)

The method according to claim 10, wherein damage is determined using the identified tissue parts and a selection of:
detecting an irregular shape of a contour of the at least one tissue part of the anatomical joint; or
detecting that the intensity in an area within or adjacent to bone and/or cartilage parts of the anatomical joint is higher or lower than a predetermined value; or
comparing at least one identified tissue part with a template representing a predefined damage pattern for an anatomical joint;

### Claim 14 (depends on 10)

The method according to claim 10, wherein the radiology images and the three-dimensional image representation are associated, so that a marking made in one of the images appears in the same position in another of the images.

### Claim 15 (depends on 10)

The method according to claim 10, wherein the anatomical joint is an ankle, and the damage that is determined and marked in at least one of the one or more damage images of the decision support material is related to the talus.

### Claim 16 (depends on 10)

The method according to claim 10, wherein the image analysis identifies both bone parts and cartilage parts of the anatomical joint or part of it and damage is determined to both the bone parts and the cartilage parts.

### Claim 17 (depends on 10)

The method according to claim 10, further comprising:
selecting a suitable implant from a predefined set of implants with varying dimensions, and/or proposing a transfer guide tool for graft transplantation, possibly including suitable size and/or suitable harvesting and/or implantation positions for at least one graft plug based on data from the radiology images and/or the three-dimensional image representation of the at least part of the anatomical joint; and
visualizing the selected implant and/or the transfer guide tool and/or the suitable harvesting and/or implantation positions for at least one graft plug in at least one of the one or more damage images.

### Claim 18 (depends on 10)

The method according to claim 10, wherein the decision support material is adapted to be used by medical staff, and includes a recommendation for a suitable treatment for repair of the determined damage.

### Claim 19 (depends on 10)

A decision support material indicating damage to at least a part of an anatomical joint of a patient, wherein the decision support material comprises one or more damage images generated by the method steps of claim 10, wherein the decision support material is stored in a non-transitory computer-readable storage medium and wherein at least one of the one or more damage images is an interactive 3D model of the anatomical joint or part of the anatomical joint.

### Claim 20 (depends on 10)

A non-transitory machine-readable medium on which is stored machine-readable code which, when executed by a processor, controls the processor to perform the method steps of claim 10.
