System and methods for device interaction using a pointing device and attention sensing device
AssigneeMirametrix Inc.
InventorsNicholas J. Sullivan, Martin Gamsby
Life of this patent
Estimating the term…
Abstract
A system and methods are provided to manage gestures and positional data from a pointing device, considering an attention sensing device with known accuracy characteristics. The method uses the state of the user's attention and the pointing device data as input, mapping them against predefined regions on the device's screen(s). It then uses both the mapping results and raw inputs to affect the device, such as sending instructions or moving the pointing cursor.
Claims16
A method for positioning a cursor during user interaction with a scene shown on one or more displays, said method comprising:
- receiving user input from a pointing device configured to at least detect positional or change-in-positional information;
- receiving user attention data from an attention sensing device, where the attention data is output as one or more points on the one or more displays;
- receiving a predefined set of regions within the one or more displays, said regions being defined by respective coordinates and dimensions, and said regions describing a supported granularity of the attention sensing device;
- receiving a current cursor position in the scene from a device;
- determining an attention region from the set of regions and attention data;
- determining a cursor region from the set of regions, pointing device positional information, and current cursor position;
- checking whether the attention region and cursor region do not correspond to the same region once change-in-positional information has been received from the pointing device;
- and
- moving the cursor to a predetermined location within the attention region when determining the attention region and cursor region do not correspond to the same region;
- or moving the cursor within the cursor region in accordance with the pointing device positional information.
A method for generating gesture based commands and positioning a cursor during user interaction with a scene shown on one or more displays, said method comprising:
- receiving user input from a pointing device capable of detecting positional or change-in-positional information and user generated gestures;
- receiving user attention data from an attention sensing device, wherein the attention data is output as one or more points on the one or more displays;
- receiving a predefined set of regions within the one or more displays, said regions being defined by respective coordinates and dimensions, and said regions describing a supported granularity of the attention sensing device;
- receiving coordinate and dimensional information for all objects in the scene from an object tracker;
- receiving a current cursor position in the scene from a device;
- determining an attention region from the set of regions and attention data;
- determining a cursor region from the set of regions, pointing device positional information, and current cursor position;
- checking whether the attention region and cursor region do not correspond to the same region upon receiving one or more user generated gestures;
- upon determining the attention region and cursor region do not correspond to the same region, checking whether the attention region contains only one object within it;
- or executing at least one user action based on at least one user generated gesture, wherein said user action is executed with the current cursor position as a starting point;
- and
- after determining the attention region contains only one object within it, executing at least one user action based on at least one user generated gesture, wherein said user action is executed with a predetermined location within the attention region as a starting point;
- or moving the cursor position to a predetermined location within the attention region.
Dependencies are inferred from the claim text.