Selection using a multi-device mixed interactivity system

A multi-device mixed interactivity system comprising:

• a selection device configured to:
• determine real input based on real device space tracker data associated with the selection device, wherein the selection device is a mobile device having a first display that displays a virtual object;
• a mixed-reality device configured to:
• determine virtual input based on virtual device space tracker data associated with the mixed-reality device, wherein the mixed-reality device is a head-mounted display having a second display that displays the virtual object;
• an integrated processing component to:
• initialize an interaction context for receiving selection inputs;
• access the real input based on real device space tracker data associated with the selection device;
• access the virtual input based on virtual device space tracker data associated with the mixed-reality device;
• integrating the real device space tracker data and the virtual device space tracker data to generate a virtual space input as a selection input, wherein integrating the real device space tracker data and the virtual device space tracker data supports each of the each of the following interaction context selections:
• (1) a freehand selection from a touchscreen input of the first display of the virtual object,
• (2) a selection of the virtual object based on the real device not intersecting with the virtual object,
• (3) a selection of the virtual object based on the real device intersection with the virtual object, and
• (4) a volume-based selection of the virtual object to generate the selection input;
• wherein one or more selected portions of the virtual object, which are based on the selected input, can be isolated for display on the first display and the second display;
• wherein the virtual space input is based on motion data of the real input corresponding to the selection device being received in combination with motion data of the virtual input corresponding to the mixed-reality device;
• generate a selection profile based on the selection input, wherein the selection profile comprises one or more selection profile attributes for isolating a portion of the virtual object;
• determine a selected portion of the virtual object based on the selection profile;
• and
• cause display of the selected portion of the virtual object based on the selection profile on the first display or the second display.

A computer-implemented method for implementing multi-device mixed interactivity systems, the method comprising:

• accessing a real input based on real device space tracker data associated with a selection device, the selection device having a first display that displays a virtual object;
• accessing a virtual input based on virtual device space tracker data associated with a mixed-reality device, the mixed-reality device having a second display that displays the virtual object;
• integrating the real device space tracker data and the virtual device space tracker data to generate a virtual space input as a selection input, wherein integrating the real device space tracker data and the virtual device space tracker data supports each of the following interaction context selections:
• (1) a freehand selection from a touchscreen input of the first display of the virtual object,
• (2) a selection of the virtual object based on the real device not intersecting with the virtual object,
• (3) a selection of the virtual object based on the real device intersection with the virtual object, and
• (4) a volume-based selection of the virtual object to generate the selection input;
• wherein one or more selected portions of the virtual object, which are based on the selected input, can be isolated for display on the first display and the second display;
• wherein the virtual space input is based on motion data of the real input corresponding to the selection device being received in combination with motion data of the virtual input corresponding to the mixed-reality device;
• generating a selection profile based on the selection input, wherein the selection profile comprises one or more selection profile attributes for isolating a portion of the virtual object;
• determining a selected portion of the virtual object based on the selection profile;
• and
• causing display of the selected portion of the virtual object based on the selection profile.