Positioning medical views in augmented reality

A non-transitory computer readable storage medium storing computer instructions which, when being executed by at least one processor, cause the at least one processor to perform a method comprising:

• acquiring 3D-image data which describes at least one three-dimensional image representation of a patient's body part;
• acquiring object position data which describes a spatial position of an augmented reality device and a spatial position of at least one object including a device or instrument present within a field of view of the augmented reality device with respect to the patient's body part;
• determining reconstructed image data based on the 3D-image data, which describes at least one two-dimensional reconstructed image calculated from the three-dimensional image representation, wherein a location of the at least one two-dimensional reconstructed image relative to the three-dimensional image representation is determined based on the spatial position of the device or instrument relative to the patient's body part;
• determining image augmentation data based on the reconstructed image data and the object position data, which describes the at least one two-dimensional reconstructed image displayed within the field of view provided by the augmented reality device, wherein an image location and/or at least one image orientation of the at least one displayed two-dimensional reconstructed image is defined with respect to the spatial position of the at least one object being selected from a group consisting of:
• one or more sections of an at least temporarily static installation of an operating theatre,
• one or more sections of a medical device or instrument, and
• one or more sections of a patient's anatomy including one or more anatomical directions.

A system, comprising:

• at least one processor to execute instructions stored on memory causing the at least one processor to:
• acquire 3D-image data which describes at least one three-dimensional image representation of a patient's body part;
• acquiring object position data which describes a spatial position of an augmented reality device and a spatial position of at least one object including a device or instrument present within a field of view of the augmented reality device with respect to the patient's body part;
• determine reconstructed image data based on the 3D-image data, which describes at least one two-dimensional reconstructed image calculated from the three-dimensional image representation, wherein a location of the at least one two-dimensional reconstructed image relative to the three-dimensional image representation is determined based on the spatial position of the device or instrument relative to the patient's body part;
• determine image augmentation data based on the reconstructed image data and the object position data, which describes the at least one two-dimensional reconstructed image displayed within the field of view provided by the augmented reality device,
• wherein an image location and/or at least one image orientation of the at least one displayed two-dimensional reconstructed image is defined with respect to the spatial position of the at least one object being selected from a group consisting of:
• one or more sections of an at least temporarily static installation of an operating theatre,
• one or more sections of a medical device or instrument,
• one or more sections of a patient's anatomy including one or more anatomical directions;
• at least one electronic data storage device storing at least the 3D-image data;
• and
• the augmented reality device,
• wherein the at least one processor is operably coupled to
• the at least one electronic data storage device for acquiring, from the at least one electronic data storage device, at least the 3D-image data, and
• the augmented reality device for issuing a control signal to the augmented reality device for controlling an operation of the augmented reality device on the basis of the image augmentation data.