# US 11,896,313 B2 · Orthopedic fixation with imagery analysis > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 11,896,313 B2 - Document ID: US11896313B2 - Status: Granted - Kind: B2 - Application number: 17/163,850 - Filed: 2021-02-01 - Published: 2021-05-27 - Granted: 2024-02-13 - Earliest claimed: 2010-05-19 - Assignees: DePuy Synthes Products, Inc. - Applicants: DePuy Synthes Products, Inc. - Inventors: Arkadijus Nikonovas - Web page: https://patentgrep.com/patent/US11896313B2 ## CPC - A61B 34/10: Computer-aided planning, simulation or modelling of surgical operations - A61B 17/62: Ring frames, i.e. devices extending around the bones to be positioned ({A61B17/6433} , A61B17/66 take precedence) - A61B 17/66: {Alignment}, compression or distraction mechanisms - G16H 20/40: relating to mechanical, radiation or invasive therapies, e.g. surgery, laser therapy, dialysis or acupuncture - G16H 30/40: for processing medical images, e.g. editing - G16Z 99/00: Subject matter not provided for in other main groups of this subclass - A61B 90/14: Fixators for body parts, e.g. skull clamps; Constructional details of fixators, e.g. pins - A61B 2090/367: {creating a 3D dataset from 2D images using position information} - A61B 2090/3966: {Radiopaque markers visible in an X-ray image} - A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D) - G16H: HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA - G16Z: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS, NOT OTHERWISE PROVIDED FOR ## Abstract Methods of orthopedic fixation and imagery analysis are provided. Images of first and second bone segments attached to a fixation apparatus are captured. Fixator elements identified in the images can be used to obtain imaging scene parameters. Bone elements identified in the images can be used with the imaging scene parameters to reconstruct a three dimensional representation of positions and/or orientations of the first and second bone segments with respect to the fixation apparatus. ## Claims ### Claim 1 A computer-implemented method of orthopedic fixation imagery analysis, the computer-implemented method comprising: acquiring, by one or more computing devices, first and second two dimensional images of a fixation apparatus and first and second bone segments attached thereto, wherein the first two dimensional image is captured from a first orientation and the second two dimensional image is captured from a second orientation that is different from the first orientation; obtaining, by the one or more computing devices, imaging scene parameters based in part on respective locations of a plurality of fixator elements in the first and the second two dimensional images, the plurality of fixator elements having corresponding physical locations in three dimensional space, wherein the obtaining of the imaging scene parameters comprises: identifying the respective locations of the plurality of fixator elements in the first and the second two dimensional images; and computing, based on the plurality of fixator elements, first and second transformation matrices associated with relating the corresponding physical locations of the plurality of fixator elements in the three dimensional space to the respective locations of the plurality of fixator elements in the first and the second two dimensional images; and reconstructing, by the one or more computing devices, a three dimensional representation of the first and the second bone segments with respect to the fixation apparatus based upon the imaging scene parameters. ### Claim 2 (depends on 1) The computer-implemented method of claim 1, wherein the obtaining of the imaging scene parameters is based on a comparison of the respective locations of the plurality of fixator elements in the first and the second two dimensional images with the corresponding physical locations of the plurality of fixator elements in the three dimensional space. ### Claim 3 (depends on 1) The computer-implemented method of claim 1, wherein the first and the second transformation matrices correspond to the first and the second two dimensional images, respectively. ### Claim 4 (depends on 1) The computer-implemented method of claim 1, wherein the obtaining of the imaging scene parameters further comprises: decomposing the first and the second transformation matrices into the imaging scene parameters. ### Claim 5 (depends on 1) The computer-implemented method of claim 1, wherein the computing of the first and the second transformation matrices is based at least in part on one or more lines representing at least one of the plurality of fixator elements. ### Claim 6 (depends on 5) The computer-implemented method of claim 5, wherein the computing of the first and the second transformation matrices comprises constructing rows of matrices based on the one or more lines. ### Claim 7 (depends on 5) The computer-implemented method of claim 5, wherein the computing of the first and the second transformation matrices is based, at least in part, on a point value and a gradient value for each of the one or more lines. ### Claim 8 (depends on 1) The computer-implemented method of claim 1, further comprising identifying respective locations of a plurality of bone elements in the first and the second two dimensional images, the plurality of bone elements comprising anatomical features of the first and the second bone segments. ### Claim 9 (depends on 8) The computer-implemented method of claim 8, wherein the three dimensional representation is further reconstructed based upon the respective locations of the plurality of bone elements. ### Claim 10 (depends on 1) The computer-implemented method of claim 1, wherein the first and the second orientations are not orthogonal with respect to each other. ### Claim 11 One or more non-transitory computer-readable storage media having stored thereon instructions that, upon execution by one or more computing devices, cause the one or more computing devices to perform operations comprising: acquiring, by the one or more computing devices, first and second two dimensional images of a fixation apparatus and first and second bone segments attached thereto, wherein the first two dimensional image is captured from a first orientation and the second two dimensional image is captured from a second orientation that is different from the first orientation; obtaining, by the one or more computing devices, imaging scene parameters based in part on respective locations of a plurality of fixator elements in the first and the second two dimensional images, the plurality of fixator elements having corresponding physical locations in three dimensional space, wherein the obtaining of the imaging scene parameters comprises: identifying the respective locations of the plurality of fixator elements in the first and the second two dimensional images; and computing, based on the plurality of fixator elements, first and second transformation matrices associated with relating the corresponding physical locations of the plurality of fixator elements in the three dimensional space to the respective locations of the plurality of fixator elements in the first and the second two dimensional images; and reconstructing, by the one or more computing devices, a three dimensional representation of the first and the second bone segments with respect to the fixation apparatus based upon the imaging scene parameters. ### Claim 12 (depends on 11) The one or more non-transitory computer-readable storage media having of claim 11, wherein the obtaining of the imaging scene parameters is based on a comparison of the respective locations of the plurality of fixator elements in the first and the second two dimensional images with the corresponding physical locations of the plurality of fixator elements in the three dimensional space. ### Claim 13 (depends on 11) The one or more non-transitory computer-readable storage media of claim 11, wherein the first and the second transformation matrices correspond to the first and the second two dimensional images, respectively. ### Claim 14 (depends on 11) The one or more non-transitory computer-readable storage media of claim 11, wherein the obtaining of the imaging scene parameters further comprises: decomposing the first and the second transformation matrices into the imaging scene parameters. ### Claim 15 (depends on 11) The one or more non-transitory computer-readable storage media of claim 11, wherein the computing of the first and the second transformation matrices is based at least in part on one or more lines representing at least one of the plurality of fixator elements. ### Claim 16 (depends on 15) The one or more non-transitory computer-readable storage media of claim 15, wherein the computing of the first and the second transformation matrices comprises constructing rows of matrices based on the one or more lines. ### Claim 17 (depends on 15) The one or more non-transitory computer-readable storage media of claim 15, wherein the computing of the first and the second transformation matrices is based, at least in part, on a point value and a gradient value for each of the one or more lines. ### Claim 18 (depends on 11) The one or more non-transitory computer-readable storage media of claim 11, wherein the operations further comprise identifying respective locations of a plurality of bone elements in the first and the second two dimensional images, the plurality of bone elements comprising anatomical features of the first and the second bone segments. ### Claim 19 (depends on 18) The one or more non-transitory computer-readable storage media of claim 18, wherein the three dimensional representation is further reconstructed based upon the respective locations of the plurality of bone elements. ### Claim 20 (depends on 11) The one or more non-transitory computer-readable storage media of claim 11, wherein the first and the second orientations are not orthogonal with respect to each other.