US 2021/0343186 A1 · SIMULATION FEATURES COMBINING MIXED REALITY AND MODULAR TRACKING

Abstract

Techniques and systems are described for providing modularity, tracking and simulation features of a mixed reality simulator. A modular approach to tracking systems, tracked instruments, and interchangeable modular physical models is described. Enhanced indicators and indicator interfaces improve imaging probe and instrument orientation and alignment with respect to a physical target, including but not necessarily within a combined physical and virtual system; these include anisotropy indicators, indicators of alignment in both in-plane and out-of-plane ultrasound or other imaging techniques, and perpendicularity indicators for better placement of probes and instruments over curved surfaces. A universal needle hub is described that integrates tracking system components and simulation feedback components usably with varying needle types.

Claims21

Dependent claims

An instrument connector device comprising:

an instrument connecting component for removably connecting a first medical instrument to the instrument connector device;
and
a second instrument connecting component for connecting at least a second medical instrument to the instrument connector device, wherein the instrument connector device is configured to provide at least one of haptic, tactile, auditory, or visual feedback via a feedback unit, in response to an interaction in a mixed reality system comprising at least one of a virtual model or a physical model.

An apparatus comprising at least one processor and at least one memory including computer program code, the at least one memory and the computer program code configured to, with the processor, cause the apparatus to at least:

receive an indication of at least one of a position or an orientation of a tracked instrument relative to a physical model or a virtual model, the tracked instrument having an associated imaging plane;
cause display of at least one of a virtual representation or a 3D visualization of the physical model or the virtual model, wherein in an instance an angle of the imaging plane relative to at least one of (a) the physical model or the virtual model or portion thereof, or (b) another instrument, has a first predefined relationship with a predetermined threshold angle, cause the displayed virtual representation or the displayed 3D visualization to have a first display property, and in an instance the angle of the imaging plane relative to at least one of (a) the physical model, the virtual model, or a portion thereof, or (b) another instrument, has a second predefined relationship with the predetermined threshold angle, cause the displayed virtual representation or the displayed 3D visualization to have a second display property.

Dependencies are inferred from the claim text.

Facts

Application

17/376,498Filed 15 Jul 2021

Priority

10 Jan 2015

Published

4 Nov 2021

Term ends

Not estimatedThe source records don’t support an estimate.

Classification6 codes

G09B 23/285
For medicine: for injections, endoscopy, bronchoscopy, sigmoidscopy, insertion of contraceptive devices or enemas
G06T 19/006
Manipulating three-dimensional [3D] models or images for computer graphics: mixed reality
G09B 9/00
Simulators for teaching or training purposes
G09B 19/00
Teaching not covered by other main groups of this subclass

Family

Application62/101,997Us provisional application · filed 10 Jan 2015

Application15/538,990Continuation · filed 22 Jun 2017

Application17/376,498Continuation

US 11,094,223 B2Related patent

US 12,387,621 B2Related patent

US 2017/0372640 A1Published application

US 2021/0343186 A1This patent

From the US filing history. Foreign family members aren’t listed.

Simulation features combining mixed reality and modular tracking

Life of this patent

Simulation features combining mixed reality and modular tracking

Life of this patent

Abstract

Claims21