Gesture onset detection on multiple devices
AssigneeGoogle Inc.
InventorsBoris Smus, Christian Plagemann, Ankit Mohan
Life of this patent
Estimating the term…
Abstract
Implementations of the disclosed subject matter provide techniques for improved identification of a gesture based on data obtained from multiple devices. A method may include receiving an indication of an onset of a gesture, from a first device, at a gesture coordinating device. Next, first subsequent data describing the gesture may be received from a second device, at the gesture coordinating device. Based on the indication and the first subsequent data, the gesture may be identified. In response to identification of the gesture, an action may be performed based on the gesture identified. In some cases, the gesture coordinating device may be a cloud-based device.
Claims20
A method comprising:
- obtaining first sensor data that is generated by an always on first hardware sensor that continuously operates on a powered on mobile device;
- transmitting at least a portion of the first sensor data to a gesture coordinating device;
- in response to transmitting at least a portion of the first hardware sensor data, receiving an initial message from the gesture coordinating device;
- in response to receiving the initial message from the gesture coordinating device, powering on a second hardware sensor that does not continuously operate on the powered on mobile device, wherein the first hardware sensor is more power efficient than the second hardware sensor;
- obtaining second sensor data that is generated by the second hardware sensor;
- and
- in response to obtaining the second sensor data, performing, by the mobile device, one or more actions associated with a particular gesture.
A system comprising:
- one or more computers and one or more storage devices storing instructions that are operable, when executed by the one or more computers, to cause the one or more computers to perform operations comprising:
- obtaining first sensor data that is generated by an always on first hardware sensor that continuously operates on a powered on mobile device;
- transmitting at least a portion of the first sensor data to a gesture coordinating device;
- in response to transmitting at least a portion of the first hardware sensor data, receiving an initial message from the gesture coordinating device;
- in response to receiving the initial message from the gesture coordinating device, powering on a second hardware sensor that does not continuously operate on the powered on mobile device, wherein the first hardware sensor is more power efficient than the second hardware sensor;
- obtaining second sensor data that is generated by the second hardware sensor;
- and
- in response to obtaining the second sensor data, performing, by the mobile device, one or more actions associated with a particular gesture.
A non-transitory computer-readable medium storing software comprising instructions executable by one or more computers which, upon such execution, cause the one or more computers to perform operations comprising:
- obtaining first sensor data that is generated by an always on first hardware sensor that continuously operates on a powered on mobile device;
- transmitting at least a portion of the first sensor data to a gesture coordinating device;
- in response to transmitting at least a portion of the first hardware sensor data, receiving an initial message from the gesture coordinating device;
- in response to receiving the initial message from the gesture coordinating device, powering on a second hardware sensor that does not continuously operate on the powered on mobile device, wherein the first hardware sensor is more power efficient than the second hardware sensor;
- obtaining second sensor data that is generated by the second hardware sensor;
- and
- in response to obtaining the second sensor data, performing, by the mobile device, one or more actions associated with a particular gesture.
Dependencies are inferred from the claim text.