3d model generation using thermal imaging and x-ray
AssigneeZimmer, Inc.
InventorVinay Tikka
Life of this patent
Estimating the term…
Abstract
A system and method for generating a 3D model of patient anatomy, including for example, a bone, soft tissue, or the like. A system may include a thermal image camera to generate a thermal image, an x-ray device to capture an x-ray image of a bone of a patient, and a processor coupled to memory. The processor may perform operations including generating a thermal map of the patient anatomy from the thermal image, and generate a 3D bone model of the bone from the x-ray image. A machine learning technique may be used to generate a 3D model of the patient anatomy including for example, the bone, soft tissue, or the like. The 3D model may be output for display.
Claims20
A method for generating a soft tissue and bone model of a patient, the method comprising:
- receiving a plurality of thermal images;
- generating a thermal map of patient anatomy by stitching together at least two of the plurality of thermal images;
- accessing a 3D bone model of a bone of the patient anatomy generated from two x-ray images of the bone;
- using the thermal map, at least one of the two x-ray images, and the 3D bone model as inputs to a machine learning algorithm, the machine learning algorithm to output a 3D model of the patient anatomy including the bone and soft tissue of the patient anatomy;
- and
- outputting the 3D model for display.
A machine-readable medium including instructions for generating a soft tissue and bone model of a patient, the instructions causing a processor to:
- receive a plurality of thermal images;
- generate a thermal map of patient anatomy by stitching together at least two of the plurality of thermal images;
- access a 3D bone model of a bone of the patient anatomy generated from two x-ray images of the bone;
- use the thermal map, at least one of the two x-ray images, and the 3D bone model as inputs to a machine learning algorithm, the machine learning algorithm to output a 3D model of the patient anatomy including the bone and soft tissue of the patient anatomy;
- and
- output the 3D model for display.
A system for generating a soft tissue and bone model of a patient, the system comprising:
- a thermal image camera to generate a plurality of thermal images;
- and
- a processor coupled to memory, the processor to perform operations comprising:
- receive two x-ray images of a bone of a patient;
- generating a thermal map of patient anatomy by stitching together at least two of the plurality of thermal images;
- generating a 3D bone model of the bone from the two x-ray image of the bone;
- using the thermal map, at least one of the two x-ray images, and the 3D bone model as inputs to a machine learning algorithm, the machine learning algorithm to output a 3D model of the patient anatomy including the bone and soft tissue of the patient anatomy;
- and
- outputting the 3D model for display.
Dependencies are inferred from the claim text.