Artificial-intelligence-assisted surgery
Assigneemetamorphosis GmbH
InventorArno Blau
Life of this patent
Estimating the term…
Abstract
Supported by artificial intelligence, an object is classified in an X-ray projection image. A 3D representation as well as a localization of the classified object can be determined by matching a model of the classified object to a visualization of the classified object in the X-ray image.
Claims15
A system for determining a 3D representation and localization of an object in an X-ray projection image with respect to a coordinate system, the system comprising a processing unit configured to execute a computer program product including sets of instructions causing the system to perform the following method:
- receiving one X-ray projection image, the X-ray projection image comprising an image characteristic including a pillow effect,
- classifying an object in the X-ray projection image,
- receiving a model of the classified object,
- determining a 3D representation of the classified object based on the X-ray projection image of the object and on the model of the classified object, and
- localizing the classified object with respect to the coordinate system, by applying the model to match the classified object in the X-ray image, wherein the step of localizing comprises determining of a 3D orientation of the object with respect to the coordinate system and determining of a 2D spatial position of a projection of the object onto a projection plane of the X-ray projection image, wherein matching of the model with the classified object takes into account the image characteristic of the X-ray projection image;
- providing aspects of the 3D representation and localization of the classified object, as determined based on the X-ray projection image, as a priori information;
- and
- performing at least one of a transparent visualization or a 3D reconstruction of the classified object based on the 3D representation and the localization of the classified object.
A non-transitory computer readable medium comprising processor-executable instructions for reading data from a processor in communication with an X-ray imaging device, the processor-executable instructions when executed on the processor in a device configure the device to:
- receiving one X-ray projection image, the X-ray projection image comprising an image characteristic including a pillow effect;
- classifying an object in the X-ray projection image;
- receiving a model of the classified object;
- determining a 3D representation of the classified object based on the X-ray projection image of the object and on the model of the classified object;
- and
- localizing the classified object with respect to the coordinate system, by applying the model to match the classified object in the X-ray image, wherein the step of localizing comprises determining of a 3D orientation of the object with respect to the coordinate system and determining of a 2D spatial position of a projection of the object onto a projection plane of the X-ray projection image;
- and
- accounting for the image characteristic when matching the model with the classified object;
- providing aspects of the 3D representation and localization of the classified object, as determined based on the X-ray projection image, as a priori information;
- and
- performing at least one of a transparent visualization or a 3D reconstruction of the classified object based on the 3D representation and the localization of the classified object.
Dependencies are inferred from the claim text.