US 8,805,010 B2Granted

Gesture identification using an ad-hoc multidevice network

AssigneeMicrosoft Corporation

InventorsEric Horvitz, Kenneth P. Hinckley, Hrvoje Benko

Life of this patent

Estimating the term…

Loading patent…

Abstract

Methods, systems, and computer-readable media for establishing an ad hoc network of devices that can be used to interpret gestures. Embodiments of the invention use a network of sensors with an ad hoc spatial configuration to observe physical objects in a performance area. The performance area may be a room or other area within range of the sensors. Initially, devices within the performance area, or with a view of the performance area, are indentified. Once identified, the sensors go through a discovery phase to locate devices within an area. Once the discovery phase is complete and the devices within the ad hoc network are located, the combined signals received from the devices may be used to interpret gestures made within the performance area.

Claims18

Dependent claims

One or more computer-storage devices having computer-executable instructions embodied thereon that when executed by a computing device perform a method of identifying gestures using a multidevice network with an ad hoc spatial configuration, wherein one or more devices in the multidevice network do not possess complete location information for other devices in the multidevice network, the method comprising:

completing an initial discovery phase to identify a first device, a second device, and one or more additional devices with a view of the performance area and an ability to communicate sensory data describing the view;
receiving a first sensory input generated by a first set of one or more sensors associated with the will first device, the first sensory input describing a first view of a performance area;
receiving a second sensory input generated by a second set of one or more sensors associated with the second device, the second sensory input describing a second view of the performance area that differs from the first view;
identifying a person within the performance area that appears in both the first view and the second view;
calculating a location of the first device relative to the second device by comparing the first device's distance from the person and the first device's orientation to the person with the second device's distance to the person and the second device's orientation to the person;
determining that the person performed a gesture using sensory input from the first device and the second device, wherein the gesture is performed facing neither the first device nor the second device;
determining that the sensory input from the first device and the second device is inadequate to interpret the gesture;
and
conducting a supplemental discovery phase to heuristically add devices to the ad hoc network in order to gain access to sensors that are able to provide data that allows the gesture to be interpreted.

6 more elements

A method of identifying gestures using a multidevice network with an ad hoc spatial configuration, wherein one or more devices in the multidevice network do not possess complete location information for other devices in the multidevice network, the method comprising:

completing an initial discovery phase to identify a first device, a second device, and one or more additional devices with a view of the performance area and an ability to communicate sensory data describing the view;
receiving a first sensory input generated by a first set of one or more sensors associated with the will first device, the first sensory input describing a first view of a performance area;
receiving a second sensory input generated by a second set of one or more sensors associated with the second device, the second sensory input describing a second view of the performance area that differs from the first view;
identifying a person within the performance area that appears in both the first view and the second view;
calculating a location of the first device relative to the second device by comparing the first device's distance from the person and the first device's orientation to the person with the second device's distance to the person and the second device's orientation to the person;
determining that the person performed a gesture using sensory input from the first device and the second device, wherein the gesture is performed facing neither the first device nor the second device;
determining that the sensory input from the first device and the second device is inadequate to interpret the gesture;
and
conducting a supplemental discovery phase to heuristically add devices to the ad hoc network in order to gain access to sensors that are able to provide data that allows the gesture to be interpreted.

6 more elements

Dependencies are inferred from the claim text.