# US 2021/0342008 A1 · Context-Sensitive Control of Radar-Based Gesture-Recognition

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0342008 A1
- Document ID: US20210342008A1
- Status: Published application
- Kind: A1
- Application number: 16/965,735
- Filed: 2019-09-27
- Published: 2021-11-04
- Earliest claimed: 2019-08-30
- Assignees: Google Inc.
- Applicants: Google LLC
- Inventors: Vignesh Sachidanandam; Ivan Poupyrev; Leonardo Giusti; Devon James O'Reilley Stern; Jung Ook Hong; Patrick M. Amihood; John David Jacobs; Abel Seleshi Mengistu; Brandon Barbello; Tyler Reed Kugler
- Web page: https://patentgrep.com/patent/US20210342008A1

## CPC

- G06F 3/017: {Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883)}
- G01S 7/415: {Identification of targets based on measurements of movement associated with the target}
- G01S 13/06: Systems determining position data of a target
- G01S 13/878: {Combination of several spaced transmitters or receivers of known location for determining the position of a transponder or a reflector (G01S13/874 takes precedence)}
- G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)}
- G06F 3/0346: with detection of the device orientation or free movement in a three-dimensional [3D] space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
- G06F 21/31: User authentication
- G06F 21/32: using biometric data, e.g. fingerprints, iris scans or voiceprints
- H04M 1/72454: according to context-related or environment-related conditions
- Y02D 30/70: in wireless communication networks
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G01S: RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- H04M: TELEPHONIC COMMUNICATION (circuits for controlling other apparatus via a telephone cable and not involving telephone switching apparatus G08)
- Y02D: CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE

## Abstract

This document describes techniques and systems for radar-based gesture-recognition with context-sensitive gating and other context-sensitive controls. Sensor data from a proximity sensor (108) and/or a movement sensor (108) produces a context of a user equipment (102). The techniques and systems enable the user equipment (102) to recognize contexts when a radar system (104) can be unreliable and should not be used for gesture-recognition, enabling the user equipment (102) to automatically disable or “gate” the output from the radar system (104) according to context. The user equipment (102) prevents the radar system (104) from transitioning to a high-power state (1910) to perform gesture-recognition in contexts where radar data detected by the radar system (104) is likely due to unintentional input. By so doing, the techniques conserve power, improve accuracy, or reduce latency relative to many common techniques and systems for radar-based gesture-recognition.

## Claims

### Claim 1

A method for context-sensitive control of radar-based gesture-recognition, the method comprising:
receiving, from a plurality of sensors of a user equipment, sensor data;
determining, based on the sensor data, a context of the user equipment;
determining whether the context satisfies requirements for radar-based gesture-recognition; and
responsive to determining that the context does not satisfy the requirements for radar-based gesture-recognition, gating a radar system to prevent the radar system from outputting indications of radar-based gestures to application subscribers of the user equipment.

### Claim 2 (depends on 1)

The method of claim 1, wherein the context is a first context, and the sensor data is first sensor data, the method further comprising:
receiving, from the plurality of sensors, second sensor data;
determining, based on the second sensor data, a second context of the user equipment;
determining whether the second context satisfies the requirements for radar-based gesture-recognition; and
responsive to determining that the second context satisfies the requirements for radar-based gesture-recognition, outputting the indications of radar-based gestures to the application subscribers of the user equipment.

### Claim 3 (depends on 2)

The method of claim 2, further comprising:
further responsive to determining that the second context satisfies the requirements for radar-based gesture-recognition:
inputting radar data obtained by the radar system to a model that determines the radar-based gestures from the inputted radar data; and
outputting, from the model, the indications of radar-based gestures to the application subscribers.

### Claim 4 (depends on 1)

The method of claim 1, wherein the plurality of sensors comprise an inertial measurement unit.

### Claim 5 (depends on 1)

The method of claim 1, wherein the plurality of sensors exclude camera sensors.

### Claim 6 (depends on 1)

The method of claim 1, wherein the plurality of sensors comprise a proximity sensor, an ambient light sensor, a microphone, or a barometer.

### Claim 7 (depends on 1)

The method of claim 1, wherein:
determining the context of the user equipment comprises determining whether the user is holding the user equipment, orientation of how the user is holding the user equipment, or whether the user is walking; and
determining whether the context satisfies the requirements for radar-based gesture-recognition comprises determining whether the context satisfies the requirements for radar-based gesture recognition based on whether the user is holding the user equipment, the orientation of how the user is holding the user equipment, or whether the user is walking.

### Claim 8 (depends on 1)

The method of claim 1, wherein:
determining the context of the user equipment comprises determining whether the radar system is occluded by an object; and
determining whether the context satisfies the requirements for radar-based gesture-recognition comprises determining whether the context satisfies the requirements for radar-based gesture recognition based on whether the radar system is occluded by an object.

### Claim 9 (depends on 1)

The method of claim 1, wherein:
determining the context of the user equipment comprises determining whether ambient light determined based on the sensor data indicates low-light conditions; and
determining whether the context satisfies the requirements for radar-based gesture-recognition comprises determining whether the context satisfies the requirements for radar-based gesture-recognition based on whether the ambient light determined based on the sensor data indicates low-light conditions.

### Claim 10 (depends on 1)

The method of claim 1, wherein:
determining the context of the user equipment comprises determining whether a wired or wireless charging system is powering the user equipment; and
determining whether the context satisfies the requirements for radar-based gesture-recognition comprises determining whether the context satisfies the requirements for radar-based gesture-recognition based on determining whether a wired or wireless charging system is powering the user equipment.

### Claim 11 (depends on 1)

The method of claim 1, wherein determining the context of the user equipment comprises determining wireless signals received by the user equipment, the method further comprising:
adjusting settings of the radar system to prevent interference to the wireless signals received by the user equipment.

### Claim 12 (depends on 1)

The method of claim 1, wherein determining the context of the user equipment comprises determining variations in meteorological conditions, the method further comprising adjusting settings of the radar system to account for the meteorological conditions while recognizing radar-based gestures.

### Claim 13 (depends on 1)

The method of claim 1, wherein:
determining the context of the user equipment comprises determining whether inputs are detected at a presence-sensitive display; and
determining whether the context satisfies the requirements for radar-based gesture-recognition comprises determining whether the context satisfies the requirements for radar-based gesture-recognition based on whether inputs are detected at the presence-sensitive display.

### Claim 14

(canceled)

### Claim 15

A computer-readable storage media comprising computer-executable instructions for context-sensitive control of radar-based gesture-recognition that, when executed, cause one or more processors of a user equipment to:
receive, from a plurality of sensors of the user equipment, sensor data;
determine, based on the sensor data, a context of the user equipment;
determine whether the context satisfies requirements for radar-based gesture-recognition; and
responsive to a determination that the context does not satisfy the requirements for radar-based gesture-recognition, gate a radar system of the user equipment to prevent the radar system from outputting indications of radar-based gestures to application subscribers of the user equipment.

### Claim 16 (depends on 15)

The computer-readable storage media of claim 15, wherein the context is a first context and the sensor data is first sensor data, the computer-executable instructions, when executed, further cause the one or more processors of the user equipment to:
receive, from the plurality of sensors, second sensor data;
determine, based on the second sensor data, a second context of the user equipment;
determine whether the second context satisfies the requirements for radar-based gesture-recognition; and
responsive to a determination that the second context satisfies the requirements for radar-based gesture-recognition, output the indications of radar-based gestures to the application subscribers of the user equipment.

### Claim 17 (depends on 16)

The computer-readable storage media of claim 16, the computer-executable instructions, when executed, further cause the one or more processors of the user equipment, responsive to the determination that the second context satisfies the requirements for radar-based gesture-recognition, to:
input radar data obtained by the radar system to a model that determines the radar-based gestures from the inputted radar data; and
output, from the model, the indications of radar-based gestures to the application subscribers.

### Claim 18 (depends on 15)

The computer-readable storage media of claim 15, wherein:
the determination of the context of the user equipment comprises determine whether the user is holding the user equipment, orientation of how the user is holding the user equipment, or whether the user is walking; and
the determination of whether the context satisfies the requirements for radar-based gesture-recognition comprises determine whether the context satisfies the requirements for radar-based gesture recognition based on whether the user is holding the user equipment, the orientation of how the user is holding the user equipment, or whether the user is walking.

### Claim 19 (depends on 15)

The computer-readable storage media of claim 15, wherein:
the determination of the context of the user equipment comprises determine whether the radar system is occluded by an object; and
the determination of whether the context satisfies the requirements for radar-based gesture-recognition comprises determine whether the context satisfies the requirements for radar-based gesture recognition based on whether the radar system is occluded by an object.

### Claim 20 (depends on 15)

The computer-readable storage media of claim 15, wherein:
the determination of the context of the user equipment comprises determine whether ambient light determined based on the sensor data indicates low-light conditions; and
the determination of whether the context satisfies the requirements for radar-based gesture-recognition comprises determine whether the context satisfies the requirements for radar-based gesture-recognition based on whether the ambient light determined based on the sensor data indicates low-light conditions.

### Claim 21 (depends on 15)

The computer-readable storage media of claim 15, wherein the determination of the context of the user equipment comprises determine wireless signals received by the user equipment, the computer-executable instructions, when executed, further cause the one or more processors of the user equipment to:
adjust settings of the radar system to prevent interference to the wireless signals received by the user equipment.
