US 7,064,742 B2Granted

Input devices using infrared trackers

AssigneeSiemens Corporate Research, Inc.

InventorsNassir Navab, Yakup Genc

Life of this patent

Estimating the term…

Loading patent…

Abstract

An interaction/input device for use in systems utilizing infrared video-based trackers is provided. The interaction/input device is employed by placing markers, e.g., small retroreflective disks, in a predetermined configuration on a planar surface to simulate physical buttons. Once in view of the infrared tracker, the system will recognize the predetermined configuration as the input device which can then be physically manipulated by the user. The user will put their fingers on one of these markers or disks, and in turn, the infrared video-based tracker will recognize this action and process it accordingly. Optionally, an augmented reality system employing the input device of the present invention can also augment simulated menus in the user's view, via a head-mounted display, giving the user the necessary feedback for interaction. By exploiting conventional tracking technology, the interaction/input device can be implemented with minimal additional hardware and minimal additional processing required by the system.

Claims7

Dependent claims

A system comprising:

a video-based tracking system for locating real-world objects;
a processor for determining the position and orientation of a user's view based on the location of the real-world objects;
a display device for displaying an augmented reality image to the user, the augmented reality image being a view of real-world objects augmented with virtual objects;
and
an input device including a plurality of markers placed in a predetermined pattern in the real world, the input device being physically separate from the video-based tracking system, wherein the tracking system locates the input device and the processor determines its functionality based on the pattern of the markers such that a user can change the pattern of the markers by selectively making at least some of the markers visible and covering at least some of the markers thereby forming a new pattern, wherein the new pattern corresponds to a different programmed response to be performed by the tracking system, the markers emulating button functions such that at least one marker is augmented on the display device with a virtual object representing a menu of selectable options, the video-based tracking system identifying the new pattern and converting the new pattern into an associated function that is performed by the processor.

2 more elements

Dependencies are inferred from the claim text.