US 11,385,722 B2 · Robust radar-based gesture-recognition by user equipment

Robust radar-based gesture-recognition by user equipment

AssigneeGoogle Inc.

InventorsJung Ook Hong, Patrick M. Amihood, John David Jacobs, Abel Seleshi Mengistu, Leonardo Giusti, Vignesh Sachidanandam, Devon James O'Reilley Stern, Ivan Poupyrev, Brandon Barbello, Tyler Reed Kugler, Johan Prag, Artur Tsurkan, Alok Chandel, Lucas Dupin Moreira Costa, Selim Flavio Cinek

Life of this patent

Estimating the term…

Abstract

Systems and techniques are described for robust radar-based gesture-recognition. A radar system (104) detects radar-based gestures on behalf of application subscribers. A state machine (2000) transitions between multiple states based on inertial sensor data. A no-gating state (2002) enables the radar system (104) to output radar-based gestures to application subscribers. The state machine (2000) also includes a soft-gating state (2004) that prevents the radar system (104) from outputting the radar-based gestures to the application subscribers. A hard-gating state (2006) prevents the radar system (104) from detecting radar-based gestures altogether. The techniques and systems enable the radar system (104) to determine when not to perform gesture-recognition, enabling user equipment (102) to automatically reconfigure the radar system (104) to meet user demand. By so doing, the techniques conserve power, improve accuracy, or reduce latency relative to many common techniques and systems for radar-based gesture-recognition.

Claims22

Dependent claims

An apparatus comprising:

a radar system that detects radar-based gestures on behalf of application subscribers;
an inertial measurement unit that produces inertial data;
and
a state machine configured to transition between multiple states for controlling the radar system based on the inertial data and one or more context-sensitive transition functions, the multiple states including:
a no-gating state in which the state machine enables the radar system to output indications of the radar-based gestures to the application subscribers;
a soft-gating state in which the state machine prevents the radar system from outputting the indications of the radar-based gestures to one or more of the application subscribers by shielding a gesture-recognition model from radar data collected by the radar system or by shielding one or more of the application subscribers from the output of the gesture-recognition model;
and
a hard-gating state in which the state machine prevents the radar system from detecting the radar-based gestures by disabling the gesture-recognition model.

5 more elements

A method of controlling a radar system of a device, the method performed by the device and comprising:

receiving inertial data from an inertial measurement unit of the device;
and
configuring, based on the inertial data and via at least one or more context-sensitive transition functions, the device to one of multiple radar system gating states, the radar system detecting radar-based gestures on behalf of application subscribers, the application subscribers configured to receive an output from a gesture-recognition model, the multiple states including:
a no-gating radar system gating state in which the radar system is enabled to output indications of the radar-based gestures to the application subscribers;
a soft-gating radar system gating state in which the radar system is prevented from outputting the indications of the radar-based gestures to one or more of the application subscribers by shielding the gesture-recognition model from radar data collected by the radar system or by shielding one or more of the application subscribers from the output of the gesture-recognition model;
and
a hard-gating radar system gating state in which the radar system is prevented from detecting the radar-based gestures by disabling the gesture-recognition model.

4 more elements

Dependencies are inferred from the claim text.

Facts

Application

16/886,626Filed 28 May 2020 · continuation in part

Priority

26 Jul 2019

Published

US 2021/0026454 A128 Jan 2021

Granted

12 Jul 2022

Term ends

Not estimatedThe source records don’t support an estimate.

Classification32 codes

G06F 3/017
Input arrangements or combined input and output arrangements for interaction between user and computer: gesture based interaction, e.g. based on a…
G01S 7/415
Using analysis of echo signal for target characterisation; Target signature; Target cross-section: identification of targets based on measurements…
G01S 13/06
Systems using reflection of radio waves, e.g. primary radar systems; Analogous systems: systems determining position data of a target
G01S 13/86
Systems using the reflection or reradiation of radio waves, e.g. radar systems; Analogous systems using reflection or reradiation of waves whose…:…

Family

Application62/879,361Us provisional application · filed 26 Jul 2019

PCT/US2019/049208Parent of this continuation-in-part · filed 30 Aug 2019

PCT/US2019/049216Parent of this continuation-in-part · filed 30 Aug 2019

PCT/US2019/049212Parent of this continuation-in-part · filed 30 Aug 2019

Application62/894,566Us provisional application · filed 30 Aug 2019

PCT/US2019/053676Parent of this continuation-in-part · filed 27 Sep 2019

PCT/US2019/055731Parent of this continuation-in-part · filed 10 Oct 2019

US 2021/0026454 A1Pre-grant publication · published 28 Jan 2021

US 11,385,722 B2This patent

From the US filing history. Foreign family members aren’t listed.