# US 2013/0154919 A1 · User control gesture detection

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2013/0154919 A1
- Document ID: US20130154919A1
- Status: Published application
- Kind: A1
- Application number: 13/332,348
- Filed: 2011-12-20
- Published: 2013-06-20
- Earliest claimed: 2011-12-20
- Assignees: Microsoft Corporation
- Inventors: Desney S. Tan; Shwetak Patel; Daniel S. Morris; Sidhant Gupta
- Web page: https://patentgrep.com/patent/US20130154919A1

## CPC

- G06F 3/017: {Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883)}
- G01S 15/50: Systems of measurement, based on relative movement of the target
- G01S 15/88: Sonar systems specially adapted for specific applications (seismic or acoustic prospecting or detecting G01V1/00)
- G06F 3/03: Arrangements for converting the position or the displacement of a member into a coded form
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G01S: RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES

## Abstract

The description relates to user control gestures. One example allows a speaker and a microphone to perform a first functionality. The example simultaneously utilizes the speaker and the microphone to perform a second functionality. The second functionality comprises capturing sound signals that originated from the speaker with the microphone and detecting Doppler shift in the sound signals. It correlates the Doppler shift with a user control gesture performed proximate to the computer and maps the user control gesture to a control function.

## Claims

### Claim 1

A computer, comprising:
a speaker and a microphone; and,
a gesture identification component configured to cause sounds of a given frequency to be emitted from the speaker and captured by the microphone, the gesture identification component further configured to evaluate the captured sounds around the given frequency to detect Doppler effect shifts caused by user gestures, the gesture identification component further configured to map a Doppler effect shift to an individual control function and to cause the control function to be executed by the computer, and wherein the gesture identification component is further configured to allow the speaker and the microphone to perform other functions during the emitting and capturing.

### Claim 2 (depends on 1)

The computer of claim 1, further comprising a user input device and wherein the gesture identification component is further configured not to evaluate the captured sounds when a user is engaging the user input device.

### Claim 3 (depends on 2)

The computer of claim 2, wherein the user input device comprises a physical keyboard, a virtual keyboard, a mouse, a track pad, or a touch screen.

### Claim 4 (depends on 1)

The computer of claim 1, wherein the speaker comprises a single speaker or multiple speakers and the microphone comprises a single microphone or multiple microphones.

### Claim 5 (depends on 1)

The computer of claim 1, wherein the gesture identification component is further configured to allow a user to define a range from the computer within which the control function is to be executed and outside of which the control function is not to be executed.

### Claim 6 (depends on 5)

The computer of claim 5, wherein the gesture identification component is further configured to evaluate an amplitude of Doppler effect shift to determine whether the user movement occurred within the range.

### Claim 7 (depends on 5)

The computer of claim 5, wherein the range extends radially in three dimensions from the computer.

### Claim 8 (depends on 1)

The computer of claim 1, wherein the other function of the speaker is playing music and wherein the sounds of the given frequency comprise a portion of the music.

### Claim 9 (depends on 1)

The computer of claim 1, wherein the gesture identification component is configured to test a range of frequencies and evaluate the corresponding captured sounds and to select the given frequency when interference associated with the given frequency is relatively less than other frequencies of the range of frequencies.

### Claim 10 (depends on 9)

The computer of claim 9, wherein the interference comprises other sounds generated by the speaker or background noise.

### Claim 11 (depends on 9)

The computer of claim 9, wherein the gesture identification component is configured to retest the range of frequencies according to one or more parameters.

### Claim 12 (depends on 11)

The computer of claim 11, wherein the one or more parameters relate to a predefined period of time or relate to detected interference at the given frequency exceeding a predefined threshold.

### Claim 13

A computer-readable storage media having instructions stored thereon that when executed by a computing device cause the computing device to perform acts, comprising:
emitting a sound signal from a computer;
capturing sound at the computer;
comparing a frequency range of the emitted sound signal to the same frequency range of the captured sound to detect Doppler shift created by a user control gesture;
mapping the user control gesture to a control function; and,
executing the control function on the computing device.

### Claim 14 (depends on 13)

The computer-readable storage media of claim 13, wherein the emitting comprises simultaneously emitting the sound signal at a constant frequency and other sound signals from a single speaker set.

### Claim 15 (depends on 13)

The computer-readable storage media of claim 13, wherein the capturing is performed by multiple microphones and further comprising comparing the detected Doppler shift differences for the multiple microphones to identify further information about the user control gesture.

### Claim 16 (depends on 15)

The computer-readable storage media of claim 15, wherein the comparing the detected Doppler shift differences for the multiple microphones to identify further information about the user control gesture comprises determining whether the user control gesture was a single hand gesture or a two handed gesture.

### Claim 17 (depends on 13)

The computer-readable storage media of claim 13, wherein the comparing comprises utilizing the Doppler shift to identify the user control gesture from other user control gestures that create other Doppler shifts.

### Claim 18

A computer-readable storage media having instructions stored thereon that when executed by a computing device cause the computing device to perform acts, comprising:
allowing a speaker and a microphone to perform a first functionality;
simultaneously utilizing the speaker and the microphone to perform a second functionality, the second functionality comprising:
capturing sound signals that originated from the speaker with the microphone;
detecting Doppler shift in the sound signals;
correlating the Doppler shift with a user control gesture performed proximate to the computer; and,
mapping the user control gesture to a control function.

### Claim 19 (depends on 18)

The computer-readable storage media of claim 18, wherein the first functionality comprises a telephone functionality.

### Claim 20 (depends on 18)

The computer-readable storage media of claim 18, wherein the control function relates to the first functionality.
