System and method for dynamic augmented reality imaging of an antomical site

A system (1) for dynamic augmented reality imaging of an anatomical site (C) in the field of orthodontics, dental surgery, or dentistry, comprising:

• at least one image capturing device (2) for capturing first real-time 3D images (3) of the anatomical site (C);
• at least one display device (4) for real-time display of said first 3D images (3) captured by said capture device (2);
• storage means (7) for storing at least one second 3D anatomical image (6) of the site (C);
• an electronic device (8) comprising a controller (9) configured to receive and process said first 3D images (3) and said second 3D images (6);
• wherein said controller (9) is configured to display on said display device (4) an augmented reality image (11) obtained by superimposing said second 3D image (6) on said first 3D image (3) while identifying common reference elements (12) of said first 3D image (3) and of said second 3D image (6);
• wherein said common reference elements (12) are anthropometric or cephalometric points or relevant points of craniofacial structures and are identified automatically by said controller (9) or manually by a healthcare professional (D);
• and wherein said second image (6) is a non-virtual 3D image that is obtained from portions of fan beam or cone beam computed tomography (CBCT) or magnetic resonance images showing internal structures of the anatomical site (C) that are invisible to the naked eye that depict critical structures of vascular, nervous, lymphatic or complex radical systems, said augmented reality image (11) being clipped to the anatomical site (C) by means of said common reference elements (12), irrespective of the spatial position of said electronic device (8) during displacements of the electronic device (8) relative to the anatomical site (C), further comprising a plurality of third images (13) of virtual incisions and/or sutures, images of anchor or implant devices or surgery that may be done by a healthcare professional (D) on the anatomical site (C), said third images (13) being composed of dots, lines and/or surfaces, which are transferred onto said first images (3) and/or second images (6) automatically, using artificial intelligence algorithms or manually by the healthcare professional (D), and are digitally loaded into said storage means (7), wherein said augmented reality image (11) is a dynamic 3D image that moves relative to any movements of the anatomical site (C) or any movements of the electronic device (8).

A system (1) for dynamic augmented reality imaging of an anatomical site (C), in the field of orthodontics, dental surgery, or dentistry comprising:

• an electronic device (8), configured as a smartphone or tablet, comprising:
• at least one image capturing device (2) for capturing first real-time 3D images (3) of the anatomical site (C);
• at least one display device (4) for real-time display of said first 3D images (3) captured by said capture device (2);
• storage means (7) for storing at least one second anatomical 3D image (6) of the site (C);
• and
• a controller (9) configured to receive and process said first 3D images (3) and said second 3D images (6);
• wherein said controller (9) is configured to display on said display device (4) an augmented reality image (11) obtained by superimposing said second 3D image (6) on said first 3D image (3) while identifying common reference elements (12) of said first 3D image (3) and of said second 3D image (6);
• wherein said common reference elements (12) are anthropometric or cephalometric points or relevant points of craniofacial structures and are identified automatically by said controller (9) or manually by a healthcare professional (D);
• and wherein said second image (6) is a non-virtual 3D image that is obtained from portions of fan beam or cone beam computed tomography (CBCT) or magnetic resonance images showing internal structures of the anatomical site (C) that are invisible to the naked eye that depict critical structures of vascular, nervous, lymphatic or complex radical systems, said augmented reality image (11) being clipped to the anatomical site (C) by means of said common reference elements (12), irrespective of the spatial position of said electronic device (8) during displacements of the electronic device (8) relative to the anatomical site (C), wherein said augmented reality image (11) is a dynamic 3D image that moves relative to any movements of the anatomical site (C) or any movements of the electronic device (8) and, wherein said electronic device (8) further comprises an accelerometer and a gyroscope.