# US 2019/0244622 A1 · System and method for speaker authentication and identification

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0244622 A1
- Document ID: US20190244622A1
- Status: Published application
- Kind: A1
- Application number: 16/385,511
- Filed: 2019-04-16
- Published: 2019-08-08
- Earliest claimed: 2017-11-29
- Assignees: ILLUMA Labs Inc.
- Applicants: ILLUMA Labs Inc.
- Inventors: Milind BORKAR
- Web page: https://patentgrep.com/patent/US20190244622A1

## CPC

- G10L 17/16: Hidden Markov models [HMM]
- G10L 17/04: Training, enrolment or model building
- G06F 17/16: Matrix or vector computation {, e.g. matrix-matrix or matrix-vector multiplication, matrix factorization (matrix transposition G06F7/78)}
- G10L 17/02: Preprocessing operations, e.g. segment selection; Pattern representation or modelling, e.g. based on linear discriminant analysis [LDA] or principal components; Feature selection or extraction
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

A system and method for enrolling a speaker in a speaker authentication and identification system (AIS), the method comprising: generating a user account, the user account comprising: a user identifier based on one or more metadata elements associated with an audio input received from an end device; generating a first i-vector from an audio frame of the audio input, a trained T-matrix, and a Universal Background Model (UBM), wherein the first i-vector generation comprises an optimized computation; and associating the user account with the first i-vector.

## Claims

### Claim 1

A method for enrolling a speaker in a speaker authentication and identification system (AIS), the method comprising:
generating a user account, the user account comprising: a user identifier based on one or more metadata elements associated with an audio input received from an end device;
generating a first i-vector from an audio frame of the audio input, a trained T-matrix, and a Universal Background Model (UBM), wherein the first i-vector generation comprises an optimized computation; and
associating the user account with the first i-vector.

### Claim 2 (depends on 1)

The method of claim 1, wherein the optimized computation comprises:
generating a feature matrix based on a feature vector;
generating a Gaussian Mixture Model (GMM) mean matrix based on a plurality of mean vectors associated with a plurality of GMM components; and
generating a delta matrix based on the feature matrix and the GMM mean matrix.

### Claim 3 (depends on 1)

The method of claim 1, wherein the optimized computation comprises:
generating a first multi-dimensional array comprising a plurality of duplicated matrices, each matrix comprised of a plurality of GMM mean vectors;
generating a multi-dimensional feature matrix, comprising a plurality of feature matrices, each feature matrix corresponding to a feature vector of a single audio frame; and
generating a multi-dimensional delta array based on the first multi-dimensional array and the multi-dimensional feature matrix.

### Claim 4 (depends on 1)

The method of claim 1, wherein the optimized computation comprises:
detecting diagonal matrices; and
performing only those computations that involve diagonal elements.

### Claim 5 (depends on 1)

The method of claim 1, wherein the optimized computation comprises:
detecting computations in an intermediate result that generate an off-diagonal element of a matrix which is diagonalized; and
eliminating the computation of the intermediate result.

### Claim 6 (depends on 1)

The method of claim 1, wherein the optimized computation comprises:
detecting a recurring computation;
precomputing the recurring computation; and
storing the precomputed result in a cache of the processor.

### Claim 7 (depends on 1)

The method of claim 1, wherein the optimized computation comprises:
detecting a computation between a first matrix and a second matrix; and
replacing the detected computation with an element by element computation between the first matrix and the second matrix in response to determining that the replacement will result in the same output.

### Claim 8 (depends on 1)

The method of claim 1, further comprising extracting channel features from the audio input.

### Claim 9 (depends on 8)

The method of claim 8, further comprising generating the first i-vector further based on the extracted channel features.

### Claim 10 (depends on 8)

The method of claim 8, further comprising: associating the extracted channel features with the generated user account.

### Claim 11 (depends on 1)

The method of claim 1, wherein the metadata elements are any of: phone number, ANI, personal identifier number, IMEI, IMSI, end device make, and end device model.

### Claim 12 (depends on 1)

The method of claim 1, wherein the first i-vector is generated by: the end device, the AIS, or any combination thereof.

### Claim 13 (depends on 1)

The method of claim 1, further comprising:
receiving a second i-vector generated from a second end device, and associated metadata; and
generating a match score between the second i-vector and the first i-vector, in response to matching at least one metadata element value between the metadata of the first i-vector and metadata of the second i-vector.

### Claim 14 (depends on 13)

The method of claim 13, further comprising:
generating a notification that the speaker is authenticated, in response to the match score exceeding a first threshold value.

### Claim 15 (depends on 13)

The method of claim 13, further comprising:
generating a notification that the speaker is not authenticated, in response to the match score being below a first threshold.

### Claim 16 (depends on 13)

The method of claim 13, wherein the second end device is the first end device.

### Claim 17 (depends on 1)

The method of claim 1, further comprising:
receiving a second i-vector generated from a second end device, and associated metadata; and
generating a match score between the second i-vector and each of a plurality of first i-vectors.

### Claim 18 (depends on 17)

The method of claim 17, further comprising:
generating a notification for each match score exceeding a second threshold value, as a possible identification.

### Claim 19 (depends on 18)

The method of claim 18, wherein the notification further includes metadata associated with each of the first i-vectors for which a match exceeded the second threshold.

### Claim 20 (depends on 17)

The method of claim 17, further comprising:
generating a notification based on the first i-vector of the plurality of i-vectors which has the highest match score with the second i-vector.

### Claim 21 (depends on 1)

The method of claim 1, wherein generating a user account is performed in response to determining that the first i-vector is not enrolled.

### Claim 22

A non-transitory computer readable medium having stored thereon instructions for causing a processing circuitry to perform a process, the process comprising:
generating a user account, the user account comprising: a user identifier based on one or more metadata elements associated with an audio input received from an end device;
generating a first i-vector from an audio frame of the audio input, a trained T-matrix, and a Universal Background Model (UBM), wherein the first i-vector generation comprises an optimized computation; and
associating the user account with the first i-vector.

### Claim 23

A system for enrolling a speaker in a speaker authentication and identification system (AIS), comprising:
a processing circuitry; and
a memory, the memory containing instructions that, when executed by the processing circuitry, configure the system to:
generate a user account, the user account comprising: a user identifier based on one or more metadata elements associated with an audio input received from an end device;
generate a first i-vector from an audio frame of the audio input, a trained T-matrix, and a Universal Background Model (UBM), wherein the first i-vector generation comprises an optimized computation; and
associate the user account with the first i-vector.
