US 2024/0079013 A1 · Assessing Speaker Recognition Performance

Abstract

A method for evaluating a verification model includes receiving a first and a second set of verification results where each verification result indicates whether a primary model or an alternative model verifies an identity of a user as a registered user. The method further includes identifying each verification result in the first and second sets that includes a performance metric. The method also includes determining a first score of the primary model based on a number of the verification results identified in the first set that includes the performance metric and determining a second score of the alternative model based on a number of the verification results identified in the second set that includes the performance metric. The method further includes determining whether a verification capability of the alternative model is better than a verification capability of the primary model based on the first score and the second score.

Claims20

Dependent claims

A computer-implemented method executed on data processing hardware that causes the data processing hardware to perform operations comprising:

receiving a set of verification results, each verification result in the set of verification results indicating whether an alternative verification model executing on a respective user device verified an identity of a respective user as one of one or more registered users of the respective user device during an interaction between the respective user and the respective user device;
determining a performance score of the alternative verification model based on a number of the verification results identified in the set of verification results that includes a performance metric;
determining a verification capability of the alternative verification model is better than a verification capability of a primary verification model based on the first performance score;
and
based on determining the verification capability of the alternative verification model is better than the verification capability of the primary verification model, replacing primary verification model executing on at least one respective user device with the alternative verification model.

2 more elements

A system comprising:

data processing hardware;
and
memory hardware in communication with the data processing hardware, the memory hardware storing instructions that when executed on the data processing hardware cause the data processing hardware to perform operations comprising:
receiving a set of verification results, each verification result in the set of verification results indicating whether an alternative verification model executing on a respective user device verified an identity of a respective user as one of one or more registered users of the respective user device during an interaction between the respective user and the respective user device;
determining a performance score of the alternative verification model based on a number of the verification results identified in the set of verification results that includes a performance metric;
determining a verification capability of the alternative verification model is better than a verification capability of a primary verification model based on the first performance score;
and
based on determining the verification capability of the alternative verification model is better than the verification capability of the primary verification model, replacing primary verification model executing on at least one respective user device with the alternative verification model.

5 more elements

Dependencies are inferred from the claim text.

Assessing Speaker Recognition Performance

Life of this patent

Assessing Speaker Recognition Performance

Life of this patent

Abstract

Claims20