Visualization of ultrasound images in physical space

A non-transitory computer-readable medium for real-time augmented visualization of anatomical features and storing instructions that when executed by one or more processors cause the one or more processors to:

• acquire image data, using an ultrasound device, from an anatomical structure of a subject;
• receive visual image data of the subject, the image data including deformation data for the anatomical structure, the deformation data being data collected about the mobility of the anatomical structure in response to one or more forces;
• determine device pose of the ultrasound device in real space;
• determine image pose data of the image data and the visual image data in virtual space, with relation to the device pose of the ultrasound device, the subject, and an operator in real space;
• and
• map a perspective pose of an anatomical structure image in virtual space to the subject in real space, the anatomical structure image being a visual representation of the anatomical structure constructed from at least the image data, the visual image data, and the image pose data, the anatomical structure image incorporating one or more visualizations of the non-rigid deformation of the anatomical structure, in response to the one or more forces, as derived from the deformation data.

A method for real-time augmented visualization of anatomical features, comprising:

• acquiring image data, using an ultrasound device, from an anatomical structure of a subject;
• receiving visual image data of the subject, the image data including deformation data for the anatomical structure, the deformation data being data collected about the mobility of the anatomical structure in response to one or more forces;
• determining device pose of the ultrasound device in real space;
• determining image pose data of the image data and the visual image data in virtual space, with relation to the device pose of the ultrasound device, the subject, and an operator in real space;
• and
• mapping a perspective pose of an anatomical structure image in virtual space to the subject in real space, the anatomical structure image being a visual representation of the anatomical structure constructed from at least the image data, the visual image data, and the image pose data, the anatomical structure image incorporating one or more visualizations of the non-rigid deformation of the anatomical structure, in response to the one or more forces, as derived from the deformation data.