# US 2019/0356776 A1 · Systems and methods for cluster-based voice verification

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0356776 A1
- Document ID: US20190356776A1
- Status: Published application
- Kind: A1
- Application number: 16/529,203
- Filed: 2019-08-01
- Published: 2019-11-21
- Earliest claimed: 2018-02-08
- Assignees: Capital One Services, LLC
- Applicants: Capital One Services, LLC
- Inventors: Austin Walters; Jeremy Goodsitt; Fardin Abdi Taghi Abad
- Web page: https://patentgrep.com/patent/US20190356776A1

## CPC

- H04M 3/42042: {Notifying the called party of information on the calling party (details within substation equipment H04M1/57, signalling details H04Q3/72)}
- G10L 17/00: Speaker identification or verification techniques
- G10L 17/26: Recognition of special voice characteristics, e.g. for use in lie detectors; Recognition of animal voices
- G10L 25/51: for comparison or discrimination
- G10L 25/06: the extracted parameters being correlation coefficients
- G10L 25/27: characterised by the analysis technique
- G10L 25/30: using neural networks
- H04M 2201/41: using speaker recognition
- H04M 2203/556: Statistical analysis and interpretation
- H04M 2203/6045: Identity confirmation
- H04M: TELEPHONIC COMMUNICATION (circuits for controlling other apparatus via a telephone cable and not involving telephone switching apparatus G08)
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING

## Abstract

Systems for caller identification and authentication may include an authentication server. The authentication server may be configured to receive audio data including speech of a plurality of telephone calls, use audio data for at least a subset of the plurality of telephone calls to store a plurality of known characteristics each associated with a specific demographic, and/or use audio data for at least one of the plurality of telephone calls to identify the telephone caller making the telephone call based on determining a most similar known characteristic of the plurality of known characteristics to the audio data of the caller.

## Claims

### Claim 1

A method comprising:
receiving, by a processor of an authentication server, audio data including speech of a user;
analyzing, by the processor, the audio data to identify at least one characteristic of the speech of the user;
associating, by the processor, the at least one characteristic to a cluster based on a comparison with a plurality of known characteristics, each known characteristic being associated with at least one cluster;
receiving, by the processor, data indicative of a purported demographic of the user;
comparing, by the processor, the data indicative of the purported demographic to data indicative of the at least one cluster; and
identifying, by the processor, the user as at least one of:
likely belonging to the purported demographic in response to determining the data indicative of the purported demographic matches the data indicative of the at least one cluster, and
unlikely to belong to the purported demographic in response to determining the data indicative of the purported demographic matches data indicative of a different cluster.

### Claim 2 (depends on 1)

The method of claim 1, wherein:
the at least one characteristic of the speech of the user comprises a plurality of words;
each known characteristic comprises a plurality of associated words; and
the associating comprises determining a similarity of the plurality of words and the plurality of associated words of the associated cluster.

### Claim 3 (depends on 2)

The method of claim 2, wherein:
the at least one characteristic of the speech of the user comprises an occurrence frequency for each of the plurality of words;
each known characteristic comprises an occurrence frequency for each of the plurality of associated words; and the associating comprises determining a similarity of the occurrence frequency for each of the plurality of words and the occurrence frequency for each of the plurality of associated words of the associated cluster.

### Claim 4 (depends on 2)

The method of claim 2, wherein:
the at least one characteristic of the speech of the user further comprises at least one acoustic characteristic;
each known characteristic further comprises at least one acoustic characteristic; and
the analyzing of the audio data to identify at least one acoustic characteristic of the speech of the user comprises:
correlating each of a plurality of portions of an acoustic or frequency component of the audio data with each of at least a subset of the plurality of words; and
determining the at least one acoustic characteristic for how the user says at least one of the subset of the plurality of words based on the portion of the acoustic or frequency component of the audio data correlated with the at least one of the subset of the plurality of words.

### Claim 5 (depends on 1)

The method of claim 1, wherein:
the at least one characteristic of the speech of the user comprises at least one acoustic characteristic;
each known characteristic comprises at least one acoustic characteristic; and
the associating comprises determining a similarity of the at least one acoustic characteristic and the at least one acoustic characteristic of the associated cluster.

### Claim 6 (depends on 1)

The method of claim 1, wherein:
the data indicative of the at least one of the plurality of users comprises current individual data and historical individual data;
determining the data indicative of the purported demographic matches the data indicative of the at least one of the plurality of users comprises determining at least one of the current individual data and the historical individual data matches the at least one of the plurality of users associated with the associated cluster; and
determining the data indicative of the purported demographic matches data indicative of a different at least one of the plurality of users comprises determining at least one of the current individual data and the historical individual data matches the at least one user associated with the known characteristic different from the associated cluster.

### Claim 7 (depends on 1)

The method of claim 1, further comprising:
receiving, by the processor, a threat score for the user;
wherein the identifying, by the processor, the user as likely belonging to the purported demographic comprises lowering the threat score or maintaining the threat score as received.

### Claim 8 (depends on 1)

The method of claim 1, further comprising:
receiving, by the processor, a threat score for the user;
wherein the identifying, by the processor, the user as unlikely to belong to the purported demographic comprises raising the threat score.

### Claim 9

A system for user authentication, the system comprising:
a recorder configured to record audio data of speech spoken by a user;
an authentication server comprising a processor and a non-transitory memory, the memory storing instructions that, when executed by the processor, cause the processor to perform processing comprising:
receiving audio data including speech of a plurality of users;
using audio data for at least a subset of the plurality of users to store a plurality of known characteristics, each known characteristic being associated with at least one cluster, the storing comprising:
for each of the subsets of the plurality of users, determining identifying data for each user, and analyzing the audio data to identify at least one characteristic of the speech of the user, and
storing the at least one characteristic of the speech of each user included in the plurality of users based on the identifying data for the user as the known characteristic; and
using audio data for at least one of the plurality of users to identify the user, the identifying comprising:
analyzing the audio data to identify at least one characteristic of the speech of the user,
associating the at least one characteristic to a cluster based on a comparison with a plurality of known characteristics, each known characteristic being associated with at least one cluster,
receiving data indicative of a purported demographic of the user, and
identifying the user as:
likely belonging to the purported demographic in response to determining the data indicative of the purported demographic matches the data indicative of the at least one of the plurality of users, or
unlikely to belong to the purported demographic in response to determining the data indicative of the purported demographic matches data indicative of a different at least one of the plurality of users.

### Claim 10 (depends on 9)

The system of claim 9, wherein:
the at least one characteristic of the speech of the user comprises a plurality of words;
each known characteristic comprises a plurality of associated words; and
the associating comprises determining a similarity of the plurality of words and the plurality of associated words of the associated cluster.

### Claim 11 (depends on 10)

The system of claim 10, wherein:
the at least one characteristic of the speech of the user comprises an occurrence frequency for each of the plurality of words;
each known characteristic comprises an occurrence frequency for each of the plurality of associated words; and
the associating comprises determining a similarity of the occurrence frequency for each of the plurality of words and the occurrence frequency for each of the plurality of associated words of the associated cluster.

### Claim 12 (depends on 10)

The system of claim 10, wherein:
the at least one characteristic of the speech of the user further comprises at least one acoustic characteristic;
each known characteristic further comprises at least one acoustic characteristic; and
the analyzing of the audio data to identify at least one acoustic characteristic of the speech of the user comprises:
correlating each of a plurality of portions of an acoustic or frequency component of the audio data with each of at least a subset of the known characteristics; and
determining the at least one acoustic characteristic for how the user says at least one of the subset of the plurality of words based on the portion of the acoustic or frequency component of the audio data correlated with the at least one of the subsets of the known characteristics.

### Claim 13 (depends on 9)

The system of claim 9, wherein:
the at least one characteristic of the speech of the user comprises at least one acoustic characteristic;
each known characteristic comprises at least one acoustic characteristic; and
the associating comprises determining a similarity of the at least one acoustic characteristic and the at least one acoustic characteristic of the associated cluster.

### Claim 14 (depends on 9)

The system of claim 9, wherein:
the processing further comprises receiving a threat score for the user; and
the identifying the user as unlikely to have the purported demographic comprises affecting the threat score.

### Claim 15

A non-transitory computer readable medium storing instructions that, when executed by a processor, cause the processor to perform processing comprising:
receiving audio data including speech of a user;
analyzing the audio data to identify at least one characteristic of the speech of the user;
associating the at least one characteristic to a cluster based on a comparison with a plurality of known characteristics, each known characteristic being associated with at least one cluster;
receiving data indicative of a purported demographic of the user;
comparing the data indicative of the purported demographic to data indicative of the at least one cluster; and
identifying the user as at least one of:
likely belonging to the purported demographic in response to determining the data indicative of the purported demographic matches the data indicative of the at least one cluster, and
unlikely to belong to the purported demographic in response to determining the data indicative of the purported demographic matches data indicative of a different cluster.

### Claim 16 (depends on 15)

The computer readable medium of claim 15, wherein:
the at least one characteristic of the speech of the user comprises a plurality of words;
each known characteristic comprises a plurality of associated words; and
the associating comprises determining a similarity of the plurality of words and the plurality of associated words of the associated cluster.

### Claim 17 (depends on 16)

The computer readable medium of claim 16, wherein:
the at least one characteristic of the speech of the user comprises an occurrence frequency for each of the plurality of words;
each known characteristic comprises an occurrence frequency for each of the plurality of associated words; and
the associating comprises determining a similarity of the occurrence frequency for each of the plurality of words and the occurrence frequency for each of the plurality of associated words of the associated cluster.

### Claim 18 (depends on 16)

The computer readable medium of claim 16, wherein:
the at least one characteristic of the speech of the user further comprises at least one acoustic characteristic;
each known characteristic further comprises at least one acoustic characteristic; and
the analyzing of the audio data to identify at least one acoustic characteristic of the speech of the user comprises:
correlating each of a plurality of portions of an acoustic or frequency component of the audio data with each of at least a subset of the plurality of words; and
determining the at least one acoustic characteristic for how the user says at least one of the subset of the plurality of words based on the portion of the acoustic or frequency component of the audio data correlated with the at least one of the subset of the plurality of words.

### Claim 19 (depends on 15)

The computer readable medium of claim 15, wherein:
the at least one characteristic of the speech of the user comprises at least one acoustic characteristic;
each known characteristic comprises at least one acoustic characteristic; and
the associating comprises determining a similarity of the at least one acoustic characteristic and the at least one acoustic characteristic of the associated cluster.

### Claim 20 (depends on 15)

The computer readable medium of claim 15, wherein:
the data indicative of the at least one of the plurality of users comprises current individual data and historical individual data;
determining the data indicative of the purported demographic matches the data indicative of the at least one of the plurality of users comprises determining at least one of the current individual data and the historical individual data matches the at least one of the plurality of users associated with the associated cluster; and
determining the data indicative of the purported demographic matches data indicative of a different at least one of the plurality of users comprises determining at least one of the current individual data and the historical individual data matches the at least one users associated with the known characteristic different from the associated cluster.