# US 2019/0167221 A1 · Method For Visualizing A Bone > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2019/0167221 A1 - Document ID: US20190167221A1 - Status: Published application - Kind: A1 - Application number: 16/326,071 - Filed: 2016-08-18 - Published: 2019-06-06 - Earliest claimed: 2016-08-18 - Assignees: Stryker European Holdings I, LLC - Applicants: Stryker European Holdings I, LLC - Inventors: Bernd Simon; Arno Blau - Web page: https://patentgrep.com/patent/US20190167221A1 ## CPC - A61B 6/505: {for diagnosis of bone} - A61B 6/4441: {the rigid structure being a C-arm or U-arm} - A61B 6/466: {adapted to display 3D data} - A61B 6/487: {involving fluoroscopy} - A61B 6/5217: {extracting a diagnostic or physiological parameter from medical diagnostic data} - A61B 6/5223: {generating planar views from image data, e.g. extracting a coronal view from a 3D image} - A61B 6/583: {using calibration phantoms} - A61B 6/584: {determining position of components of the apparatus or device using images of the phantom} - G06F 18/2431: Multiple classes - G06T 7/13: Edge detection - G06T 15/08: Volume rendering - G06T 19/00: Manipulating three-dimensional [3D] models or images for computer graphics - G06T 19/20: Editing of three-dimensional [3D] images, e.g. changing shapes or colours, aligning objects or positioning parts - G16H 50/30: for calculating health indices; for individual health risk assessment - A61B 6/5205: {involving processing of raw data to produce diagnostic data} - A61B 2090/367: {creating a 3D dataset from 2D images using position information} - A61B 2090/376: {using X-rays, e.g. fluoroscopy} - A61B 2090/3966: {Radiopaque markers visible in an X-ray image} - G06T 2207/10116: X-ray image - G06T 2207/30008: Bone - G06T 2207/30052: Implant; Prosthesis - G06T 2207/30204: Marker - G06T 2210/41: Medical - G06T 2219/2016: Rotation, translation, scaling - G06V 2201/033: of skeletal patterns - A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D) - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL - G16H: HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING ## Abstract A method and a corresponding system are provided. The method comprises steps of providing 2D images and subsequently detecting outlines of a primary structure in each of the images. A visual representation of the 2D images is generated and the 2D images are then arranged as 2D slices in a 3D visual representation. To this end, at least two of the 2D images are taken at different imaging angles. The method provides a 3D visual representation of a region of interest comprising a primary structure to support a spatial sense of a user. ## Claims ### Claim 1 A method for visualizing a bone, in particular a femur or a hip bone, the method comprising: providing 2D images of the bone wherein at least two of these 2D images are taken at different imaging angles, detecting outlines of a primary structure in the 2D images of the bone, generating visual representations of the 2D images based on the outlines, and arranging the visual representations of the 2D images as 2D slices in a 3D visual representation based on the different imaging angles under which the 2D images are taken for supporting a spatial sense of a user. ### Claim 2 (depends on 1) The method according to claim 1, wherein the primary structure is at least one of a bone, and a bone fragment. ### Claim 3 (depends on 1) The method according to claim 1, wherein the primary structure is at least one of an implant, and a reference body. ### Claim 4 (depends on 1) The method according to claim 1, further comprising the steps of: detecting at least three markers in the 2D images, wherein a marker is one of a reference body, a part of a reference body, an implant or a bone shape, and determining a spatial arrangement of the primary structure based on the position of the at least three markers, wherein the step of arranging the visual representation of the 2D images in the 3D visual representation is based on the determined spatial arrangement. ### Claim 5 (depends on 1) The method according to claim 1, further comprising the step of: classifying the primary structure into a class of implants, a class of bones, a class of bone fragments and/or a class of reference bodies, wherein the step of arranging the visual representation of the 2D images in the 3D visual representation is based on the classification of the primary structure. ### Claim 6 (depends on 5) The method according to claim 5, wherein the visualization of the primary structure is limited to at least one of the classes of implants, bones, bone fragments and/or reference bodies. ### Claim 7 (depends on 1) The method according to claim 1, wherein the 3D visual representation is rotatable showing the visual representations of the 2D images from different viewpoints. ### Claim 8 (depends on 1) The method according to claim 1, wherein the visualization of the primary structure is based on a detection of a predetermined surgery step, wherein detection of the predetermined surgery step is based on a number and a position of primary structures in the 2D images. ### Claim 9 (depends on 1) The method according to claim 1, wherein the 2D images are X-ray images. ### Claim 10 A system (9) for visualizing a bone, in particular a femur or a hip bone, comprising: a detection unit, and a processing unit, wherein the detection unit is configured to provide 2D images of the bone, wherein at least two 2D images are taken at different imaging angles, wherein the detection unit is further configured to detect outlines of a primary structure in the 2D images of the bone, wherein the processing unit is configured to generate visual representations of the 2D images based on the outlines, and wherein the processing unit is further configured to arrange the visual representations of the 2D images as 2D slices in a 3D visual representation based on the different imaging angles under which the 2D images are taken to support a spatial sense of a user. ### Claim 11 (depends on 1) A computer program, which, when executed by a processor, performs the method steps according to claim 1. ### Claim 12 (depends on 11) A computer readable medium, on which a computer program according to claim 11 is stored. ### Claim 13 (depends on 1) The method according to claim 1 wherein only two 2D images of a femur are used with the two 2D images taken at angles of at least 15° from one another. ### Claim 14 (depends on 13) The method according to claim 13 wherein the two 2D images are x-ray images.