Methods and apparatuses for applying free space inputs for surface constrained controls

A device, comprising:

• a processing device configured to:
• determine a virtual boundary within an augmented reality construct;
• and
• define a portion of the virtual boundary within the augmented reality construct configured to receive and end-effector input within the augmented reality construct;
• and
• a sensor coupled to the processing device, wherein the sensor is configured to:
• sense the end-effector input from an end-effector within the portion of the virtual boundary
• wherein the processing device is further configured to:
• generate a device input that corresponds to the end-effector input;
• and
• send the device input to another device.

An apparatus, comprising:

• a processing device configured to:
• determine a virtual boundary within an augmented reality construct;
• define a portion of the virtual boundary within the augmented reality construct configured to receive an end-effector input;
• and
• a sensor coupled to the processing device, wherein the sensor is configured to:
• sense an end-effector input from an end-effector within the portion of the virtual boundary, the end-effector input being a motion where an end-effector moves from a first plane to a second plane,
• wherein the processing device is further configured to:
• generate a device input that corresponds to the end-effector input;
• and
• send the device input to a device.