Method for Using a Physical Object to Manipulate a Corresponding Virtual Object in a Virtual Environment, and Associated Apparatus and Computer Program Product

A method for planning a procedure, comprising:

• displaying a first virtual element on a display device with a controller device having a processor and configured to be in communication with the display device;
• manipulating a physical control element, the control element being in communication with the controller device and being configured to correspond to the first virtual element;
• and
• displaying, via the processor of the controller device and on the display device, a response of the first virtual element corresponding to the actual manipulation of the control element.

A method for planning a procedure, comprising:

• displaying a first virtual element on a display device;
• analyzing, via a processor, physical manipulation of a control element interface configured to correspond to the first virtual element;
• and
• displaying, in response to the analysis of the physical manipulation of the control element interface, a response of the first virtual element corresponding to the physical manipulation of the control element interface.

A system comprising processing circuitry operatively coupled with a control element interface, wherein the processing circuitry is configured to cause the system to at least:

• display a first virtual element on a display device;
• analyze physical manipulation of a control element interface configured to correspond to the first virtual element;
• and
• display, in response to physical manipulation of the control element interface, a response of the first virtual element corresponding to the physical manipulation of the control element interface.

A computer program product comprising at least one non-transitory computer readable storage medium having computer readable program instructions stored thereon, the computer readable program instructions comprising program instructions which, when executed by at least one processor implemented on a system for planning a procedure, cause the system to perform a method comprising:

• displaying a first virtual element via a display device;
• analyzing, via a processor, physical manipulation of a control element interface configured to correspond to the first virtual element;
• and
• displaying, in response to the analysis of the physical manipulation of the control element interface, a response of the first virtual element corresponding to the physical manipulation of the control element interface.