Augmented reality pre-registration
AssigneeBrainlab AG
InventorsNils Frielinghaus, Christoffer Hamilton
Life of this patent
Estimating the term…
Abstract
The disclosed method encompasses pre-registering an anatomical body part with a coordinate system used by an augmented reality device (such as augmented reality glasses) for outputting (e.g. displaying or projecting) augmentation information. An example of the augmentation information is the position (in the real image captured by the augmented reality device) of a fine registration area on the anatomical body part which a user is supposed to identify for fine registration of the anatomical body part with a tracking coordinate system used by a medical position tracking system. The disclosed method is usable in a medical environment such as for surgery or radiotherapy.
Claims17
A computer-implemented method for pre-registering an anatomical body part of a patient's body, using output of an augmented reality device having a distance measurement unit, the method comprising executing, on at least one processor of at least one computer, the following steps:
- determining a pre-registration of the anatomical body part being the result of determining a position of the anatomical body part in an augmented reality coordinate system associated with the augmented reality device based on the result of a distance measurement by the distance measurement unit,
- wherein the augmented reality coordinate system is a coordinate system in which positional values of augmentation information are defined for display by the augmented reality device,
- wherein the augmented reality device comprises a display included in glasses wearable by a user and the distance measurement unit is positioned on the glasses;
- acquiring, based on a distance measurement by the distance measurement unit, surface detection data which describes a surface geometry of a marker device tracked by a medical position tracking system;
- acquiring marker device template data which describes a geometrical template of the marker device;
- determining a relative position between the augmented reality device and the anatomical body part based on the surface detection data and the marker device template data;
- positionally registering a viewing direction of the augmented reality device with a tracking coordinate system based on the determined relative position between the augmented reality device and the marker device,
- wherein at least one of the pre-registration or the position of a fine registration region is determined based on the registration of the viewing direction;
- determining, based on the pre-registration, the position of the fine registration region of the anatomical body part in a real image acquired by the augmented reality device,
- wherein the fine registration region is an area which serves as an area for fine registration with the tracking coordinate system of the medical position tracking system using a pointing tool tracked by the medical position tracking system for identifying at least one point in the fine registration region to the medical position tracking system;
- and
- outputting, by the augmented reality device, augmentation information describing the position of the fine registration region.
A system for determining augmentation information relating to positional tracking by a medical position tracking system, the system comprising:
- at least one computer having at least one processor with associated memory, the memory storing instructions causing the at least one processor to:
- determine a pre-registration of an anatomical body part being the result of determining a position of the anatomical body part in an augmented reality coordinate system associated with an augmented reality device based on the result of a distance measurement by a distance measurement unit;
- wherein the augmented reality device comprises a display included in glasses wearable by a user and the distance measurement unit is positioned on the glasses;
- wherein the augmented reality coordinate system is a coordinate system in which positional values of augmentation information are defined for display by the augmented reality device;
- acquiring, based on a distance measurement by the distance measurement unit, surface detection data which describes
- a surface geometry of a marker device tracked by the medical position tracking system;
- acquiring marker device template data which describes a geometrical template of the marker device;
- determining a relative position between the augmented reality device and the anatomical body part based on the surface detection data and the marker device template data;
- positionally registering a viewing direction of the augmented reality device with a tracking coordinate system based on the determined relative position between the augmented reality device and the marker device,
- wherein at least one of the pre-registration or the position of a fine registration region is determined based on the registration of the viewing direction;
- determining, based on the pre-registration, the position of the fine registration region of the anatomical body part in a real image acquired by the augmented reality device,
- wherein the fine registration region is an area which serves as an area for fine registration with the tracking coordinate system of the medical position tracking system using a pointing tool tracked by the medical position tracking system for identifying at least one point in the fine registration region to the medical position tracking system;
- and
- outputting, by the augmented reality device, augmentation information describing the position of the fine registration region.
Dependencies are inferred from the claim text.