# US 2022/0284899 A1 · Detecting and suppressing voice queries

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2022/0284899 A1
- Document ID: US20220284899A1
- Status: Published application
- Kind: A1
- Application number: 17/749,892
- Filed: 2022-05-20
- Published: 2022-09-08
- Earliest claimed: 2017-05-11
- Assignees: Google Inc.
- Applicants: Google LLC
- Inventors: Alexander H. GRUENSTEIN; Aleksandar KRACUN; Matthew SHARIFI
- Web page: https://patentgrep.com/patent/US20220284899A1

## CPC

- G10L 15/22: Procedures used during a speech recognition process, e.g. man-machine dialogue
- G10L 15/08: Speech classification or search
- G10L 15/26: Speech to text systems (G10L15/08 takes precedence)
- G10L 17/00: Speaker identification or verification techniques
- H04L 63/1425: {Traffic logging, e.g. anomaly detection}
- H04L 63/1458: {Denial of Service}
- G06F 16/3331: Query processing
- G06F 16/433: {using audio data}
- G10L 15/1822: {Parsing for meaning understanding}
- G10L 2015/0636: {Threshold criteria for the updating}
- G10L 2015/088: {Word spotting}
- G10L 2015/223: {Execution procedure of a spoken command}
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

A computing system receives requests from client devices to process voice queries that have been detected in local environments of the client devices. The system identifies that a value that is based on a number of requests to process voice queries received by the system during a specified time interval satisfies one or more criteria. In response, the system triggers analysis of at least some of the requests received during the specified time interval to trigger analysis of at least some received requests to determine a set of requests that each identify a common voice query. The system can generate an electronic fingerprint that indicates a distinctive model of the common voice query. The fingerprint can then be used to detect an illegitimate voice query identified in a request from a client device at a later time.

## Claims

### Claim 1

A client device-implemented method, comprising:
detecting, by a client device, an utterance of a hotword in a local environment of the client device;
receiving, by the client device and in response to the detecting, a voice query including one or more words following the hotword;
generating, by the client device, an electronic fingerprint for the received voice query;
determining, by the client device, whether the received voice query is blacklisted based on a comparison of the electronic fingerprint of the received voice query with electronic fingerprints of blacklisted voice queries stored in a local database of the client device; and
suppressing, by the client device, performance of an operation indicated by the received voice query when the received voice query is determined to be blacklisted.

### Claim 2 (depends on 1)

The method of claim 1, further comprising:
performing, by the client device, the operation indicated by the received voice query when the received voice query is determined not to be blacklisted.

### Claim 3 (depends on 1)

The method of claim 1, wherein the suppressing includes, when the operation indicated by the received voice query was not performed, blocking, by the client device, the operation from being performed.

### Claim 4 (depends on 1)

The method of claim 1, wherein the suppressing includes, when the operation indicated by the received voce query was performed, reversing, by the client device, the operation.

### Claim 5 (depends on 1)

The method of claim 1, further comprising:
storing, by the client device, first information data associated with the received voice query and second information data associated with the suppressed operation associated with the received voice query into a suppression log; and
transmitting, by the client device, the first information and the second information in the suppression log to a server system including one or more computers.

### Claim 6 (depends on 1)

The method of claim 1, wherein the received voice query is one of a plurality of voice queries received by the client device, and the method further comprises:
determining, by the client device and for each of the plurality of voice queries, whether the respective voice query corresponds to one of the blacklisted voice queries stored in the local database.

### Claim 7 (depends on 1)

The method of claim 1, wherein the received voice query is one of a plurality of voice queries received by the client device, and the method further comprises:
selecting, by the client device, a subset of the plurality of voice queries; and
determining, by the client device and for each of the subset of the plurality of voice queries, whether the respective voice query corresponds to one of the blacklisted voice queries stored in the local database.

### Claim 8 (depends on 1)

The method of claim 1, further comprising:
receiving, by the client device, the electronic fingerprints of the blacklisted voice queries from a server system including one or more computers; and
storing, by the client device, the electronic fingerprints of the blacklisted voice queries into the local database.

### Claim 9 (depends on 1)

The method of claim 1, further comprising:
receiving, by the client device, additional electronic fingerprints to add the local database from a server system including one or more computers.

### Claim 10 (depends on 1)

The method of claim 1, further comprising:
transmitting, by the client device, audio data of the received voice query and a voice query processing request corresponding to the received voice query to a server system including one or more computers.

### Claim 11

A non-transitory computer-readable storage medium including computer executable instructions, wherein the instructions, when executed by a computer, cause the computer to perform a method, the method comprising:
detecting an utterance of a hotword in a local environment of a client device;
receiving, in response to the detecting, a voice query including one or more words following the hotword;
generating an electronic fingerprint for the received voice query;
determining whether the received voice query is blacklisted based on a comparison of the electronic fingerprint of the received voice query with electronic fingerprints of blacklisted voice queries stored in a local database of the client device; and
suppressing performance of an operation indicated by the received voice query when the received voice query is determined to be blacklisted.

### Claim 12 (depends on 11)

The non-transitory computer-readable storage medium of claim 11, further comprising performing the operation indicated by the received voice query when the received voice query is determined not to be blacklisted.

### Claim 13 (depends on 11)

The non-transitory computer-readable storage medium of claim 11, wherein the suppressing includes blocking the operation from being performed when the operation indicated by the received voice query was not performed.

### Claim 14 (depends on 11)

The non-transitory computer-readable storage medium of claim 11, wherein the suppressing includes reversing the operation when the operation indicated by the received voce query was performed.

### Claim 15 (depends on 11)

The non-transitory computer-readable storage medium of claim 11, further comprising:
storing first information data associated with the received voice query and second information data associated with the suppressed operation associated with the received voice query into a suppression log; and
transmitting the first information and the second information in the suppression log to a server system including one or more computers.

### Claim 16 (depends on 11)

The non-transitory computer-readable storage medium of claim 11, wherein the received voice query is one of a plurality of voice queries received by the client device, and further comprising:
determining, for each of the plurality of voice queries, whether the respective voice query corresponds to one of the blacklisted voice queries stored in the local database.

### Claim 17 (depends on 11)

The non-transitory computer-readable storage medium of claim 11, wherein the received voice query is one of a plurality of voice queries received by the client device, and further comprising:
selecting a subset of the plurality of voice queries; and
determining, for each of the subset of the plurality of voice queries, whether the respective voice query corresponds to one of the blacklisted voice queries stored in the local database.

### Claim 18 (depends on 11)

The non-transitory computer-readable storage medium of claim 11, further comprising:
receiving the electronic fingerprints of the blacklisted voice queries from a server system including one or more computers; and
storing the electronic fingerprints of the blacklisted voice queries into the local database.

### Claim 19 (depends on 11)

The non-transitory computer-readable storage medium of claim 11, further comprising:
receiving additional electronic fingerprints to add the local database from a server system including one or more computers.

### Claim 20

An apparatus, comprising:
processing circuitry configured to
detect an utterance of a hotword in a local environment of the apparatus,
receive, in response to detecting, a voice query including one or more words following the hotword,
generate an electronic fingerprint for the received voice query,
determine whether the received voice query is blacklisted based on a comparison of the electronic fingerprint of the received voice query with electronic fingerprints of blacklisted voice queries stored in a local database of the apparatus, and
suppress performance of an operation indicated by the received voice query when the received voice query is determined to be blacklisted.
