US 2018/0321737 A1 · INTEGRATED MIXED-INPUT SYSTEM

Abstract

In various embodiments, methods and systems for implementing an integrated mixed-input system are provided. The integrated mixed-input system includes paired mixed-input devices for interacting and controlling virtual space input interfaces using real inputs and virtual inputs, sensors, and passive and active haptic feedback associated with the paired mixed-input devices. Real device space tracker data and virtual device space tracker data are accessed via the paired mixed-input devices to determine real input and virtual input that are processed to determine virtual space input. The real device space tracker data and virtual device space tracker data also are used to generate different interaction contexts. In one embodiment, integrated mixed-input system supports interface deviation, where a physical mixed-input device interface is a different size from a size of the virtual space input interface. The virtual space input is communicated to control the virtual space input interface.

Claims20

Dependent claims

One or more computer storage media having computer-executable instructions embodied thereon that, when executed, by one or more processors, cause the one or more processors to perform a method for implementing integrating mixed-input systems, the method comprising:

determining real input based on real device space tracker data associated with a physical mixed-input device;
determining virtual input based on virtual device space tracker data associated with a virtual mixed-input device, wherein a physical mixed-input device interface of the physical mixed-input device comprises a first interface size which is smaller than a second interface size, and wherein a virtual space input interface has the second interface size which is larger, wherein the virtual space input interface is dynamically shifted, such that, a target input portion of the virtual space input interface overlaps with the physical mixed-input device interface to receive the real input, wherein the virtual space input interface is generated as part of a wholly immersive virtual experience;
determining a virtual space input for the virtual space input interface based on the real input and the virtual input in an interaction context;
and
communicating the virtual space input to control the virtual space input interface.

2 more elements

An integrated mixed-input system comprising:

a physical mixed-input device configured to:
determine real input based on real device space tracker data associated with the physical mixed-input device, wherein the physical mixed-input device is a mobile device having a display that displays the physical mixed-input device interface;
a virtual mixed-input device configured to:
determine virtual input based on virtual device space tracker data associated with the virtual mixed-input device, wherein the virtual mixed-input device is a head-mounted display that displays the virtual space input interface;
an integrated processing component to:
generate an interaction context based on the real device space tracker data and the virtual device space tracker data for a virtual space input interface;
determine the virtual space input based on the real input and the virtual input in the interaction context;
and
communicate the virtual space input to control the virtual space input interface.

6 more elements

A computer-implemented method for implementing integrating mixed-input systems, the method comprising:

determining real input based on real device space tracker data associated with a physical mixed-input device;
determining virtual input based on virtual device space tracker data associated with a virtual mixed-input device;
generating an interaction context based on the real device space tracker data and the virtual device space tracker data for a virtual space input interface, wherein the interaction context comprises a virtual representation of the physical mixed-input device coupled to a virtual second hand corresponding to a physical second hand;
determining a virtual space input for the virtual space input interface based on the real input and the virtual input via the interaction context;
and
communicating the virtual space input to control the virtual space input interface.

3 more elements

Dependencies are inferred from the claim text.

Integrated mixed-input system

Life of this patent

Integrated mixed-input system

Life of this patent

Abstract

Claims20