Back to results
US 11,687,834 B2Granted
Displaying augmented image data for medically invasive devices via image processing
AssigneesGabriel Fine, Nathan Silberman
InventorsGabriel Fine, Nathan Silberman
Life of this patent
Estimating the term…
Abstract
A system and method is disclosed for displaying augmented image data for invasive medical devices. A current orientation and a current position of the invasive medical device within a patient can be determined by applying a trained model of the invasive medical device to unannotated images of the invasive medical device as captured by an imaging device. The images of the invasive medical device can be displayed and overlaid with the current orientation and current position of the invasive medical device. User input can be received to initialize tracking of an orientation and a position of the invasive medical device as the invasive medical device is moved within the patient.
Claims20
A system for augmenting imaging data depicting an invasive medical device, the system comprising:
- an invasive medical device configured to be inserted into a patient as part of a medical procedure;
- an imaging device configured to generate one or more images of the invasive medical device within the patient, wherein the imaging device is separate from the invasive medical device and is capable of being positioned at a vantage point relative to the patient from which the one or more images of the invasive medical device within the patient are captured;
- a database programmed to store a trained model for the invasive medical device, wherein the trained model was generated from one or more machine learning algorithms being trained on annotated images of the invasive medical device with orientation and position information, wherein the trained model is programmed to be used to determine orientation and position information from unannotated images of the invasive medical device;
- an imaging computer system that is programmed to:
- receive the one or more images of the invasive medical device from the imaging device,
- access the trained model for the invasive medical device from the database,
- determine a current orientation and a current position of the invasive medical device within the patient by applying the trained model to the one or more images of the invasive medical device, and
- output the current orientation and the current position of the invasive medical device;
- and
- a display at a user device to monitor the invasive medical device within the patient, the display being programmed to (i) output the one or more images of the invasive medical device as captured by the imaging device from the vantage point of the imaging device relative to the patient, wherein the one or more images of the invasive medical device are overlaid with the current orientation and the current position of the invasive medical device, as determined from application of the trained model to the one or more images, and (ii) receive user input to initialize tracking of an orientation and a position of the invasive medical device as the invasive medical device is moved within the patient.
7 more elements
A method for augmenting imaging data depicting an invasive medical device, the method comprising:
- inserting an invasive medical device into a patient as part of a medical procedure;
- generating, by an imaging device, one or more images of the invasive medical device within the patient, wherein the imaging device is separate from the invasive medical device and is capable of being positioned at a vantage point relative to the patient from which the one or more images of the invasive medical device within the patient are captured;
- generating, by a computing system, a trained model for the invasive medical device using one or more machine learning algorithms that are trained on annotated images of the invasive medical device with orientation and position information, wherein the trained model is configured to be used in determining orientation and position information from unannotated images of the invasive medical device;
- receiving, by the computing system and from the imaging device, the one or more images of the invasive medical device;
- accessing, by the computing system, the trained model for the invasive medical device;
- applying, by the computing system, the trained model to the one or more images of the invasive medical device;
- determining, by the computing system and based on applying the trained model to the one or more images, a current orientation and a current position of the invasive medical device within the patient;
- and
- outputting, at a user device, a display comprising (i) the one or more images of the invasive medical device as captured by the imaging device from the vantage point of the imaging device relative to the patient, wherein the one or more images of the invasive medical device are overlaid with the current orientation and the current position of the invasive medical device, as determined from application of the trained model to the one or more images, wherein the display at the user device is configured to (ii) receive user input to initialize tracking of an orientation and a position of the invasive medical device as the invasive medical device is moved within the patient.
6 more elements
Dependencies are inferred from the claim text.