# US 2017/0372706 A1 · Speaker recognition in multimedia system

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2017/0372706 A1
- Document ID: US20170372706A1
- Status: Published application
- Kind: A1
- Application number: 15/540,647
- Filed: 2016-02-10
- Published: 2017-12-28
- Earliest claimed: 2015-02-11
- Assignees: Bang & Olufsen A/S
- Applicants: Bang & Olufsen A/S
- Inventors: Sven Ewan Shepstone; Søren Borup Jensen
- Web page: https://patentgrep.com/patent/US20170372706A1

## CPC

- G10L 17/22: Interactive procedures; Man-machine interfaces
- G10L 17/00: Speaker identification or verification techniques
- G10L 17/02: Preprocessing operations, e.g. segment selection; Pattern representation or modelling, e.g. based on linear discriminant analysis [LDA] or principal components; Feature selection or extraction
- G10L 17/04: Training, enrolment or model building
- G10L 17/06: Decision making techniques; Pattern matching strategies
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING

## Abstract

A method for identifying a user among a plurality of users of a multimedia system comprising extracting an i-vector for the speech utterance using total variability modeling, comparing the extracted i-vector with a collection of i-vector sets in order to identify a target set most similar to the extracted i-vector, and granting access to the multimedia system in accordance with an access profile associated with the identified target set. Further, source variation is minimized by, for each speech utterance acquired using a specific data source, re-centering first-order statistics of the speech utterance around the mean of an informative prior associated with the source, and using the co-variance of the informative prior associated with the source when extracting the i-vector for the speech utterance.

## Claims

### Claim 1

A method for identifying a user among a plurality of users of a multimedia system including one or more devices for providing multimedia content from one or more sources of digital information, in order to provide individually adjusted access and control of multimedia content from the multimedia system, the method comprising the steps of:
providing a collection of i-vector sets, each i-vector set including i-vectors based on one or more words spoken by a user of the multimedia system and being associated with an access profile of this user,
acquiring a speech utterance from a current user, and extracting an i-vector for the speech utterance using total variability modeling,
comparing the extracted i-vector with each i-vector set in the collection, in order to identify a target set most similar to the extracted i-vector,
granting, to the current user, access to the multimedia system in accordance with the access profile associated with the identified target set,
wherein the speech utterance is acquired using one of a plurality of sources, and wherein the method further comprises minimizing source variation in the total variability modeling by:
for each data source, estimating a source-specific informative prior, which is defined by a mean and a covariance, and
for each speech utterance acquired using a specific data source, re-centering first-order statistics of the speech utterance around the mean of the informative prior associated with the source, and using the co-variance of the informative prior associated with the source when extracting the i-vector for the speech utterance.

### Claim 2 (depends on 1)

The method according to claim 1, wherein estimating a source-specific informative prior includes:
extracting a source specific set of i-vectors from data acquired from the data source, and
using the source specific set of i-vectors to estimate the source-specific informative prior.

### Claim 3 (depends on 2)

The method according to claim 2, wherein extracting a source specific set of i-vectors is done using a pre-trained total variability matrix and a non-informative prior.

### Claim 4 (depends on 2)

The method according to claim 2, wherein extracting a source specific set of i-vectors is done using an informative total variability matrix and a non-informative prior, and wherein the informative total variability matrix is computed by:
performing a plurality of training iterations, e.g. expectation maximization training iterations, each iteration including computing a preliminary source-specific informative prior and updating the informative total variability matrix using the preliminary source-specific informative prior.

### Claim 5 (depends on 1)

The method according to claim 1, further comprising storing the collection of i-vector sets and associated access profiles in a remote database and making them accessible to more than one multimedia system.

### Claim 6 (depends on 5)

The method according to claim 5, further comprising storing content consumption patterns of each user and providing the current user with recommendations based on choices of other users with similar choices as the current user.

### Claim 7 (depends on 1)

The method according to claim 1, further comprising:
providing a collection of i-vector classes, each i-vector class including a set of i-vectors based on speech from users having similar characteristics, and
comparing the extracted i-vector with each i-vector class to identify an i-vector class most similar to the extracted i-vector.

### Claim 8 (depends on 7)

The method according to claim 7, wherein the characteristics include at least one of age, gender, and mood.

### Claim 9 (depends on 1)

The method according to claim 1, further including identifying and registering a new user only if an i-vector extracted from a speech utterance of the new user is sufficiently different from all previously stored i-vectors according to a predefined condition.

### Claim 10 (depends on 9)

The method according claim 9, wherein the condition is based on a cosine distance between the extracted i-vector and all previously stored i-vectors.

### Claim 11 (depends on 1)

The method according to claim 1, wherein the collection of i-vector sets includes a first i-vector set based one or more words spoken by a first user and associated with a first access profile, and a second i-vector set based on one or more words spoken by a second user and associated with a second access profile, and further comprising:
allocating a first user identification to the first user;
allocating a second user identification to the second user;
identifying the first user as the current user;
receiving input from the first user indicating the second user identification; and
granting the first user access in accordance with the second access profile.

### Claim 12 (depends on 11)

The method according to claim 11, wherein each access profile defines user dependent access rights.

### Claim 13 (depends on 11)

The method according to claim 11, wherein each user identification is allocated to a function key, such as a button on a physical device or a graphical image/icon on a virtual device.

### Claim 14

A multimedia system comprising:
one or more sources of digital information,
one or more devices for providing multimedia content from the sources,
a database storing a collection of i-vector sets, each i-vector set including i-vectors based on one or more words spoken by a user of the multimedia system and being associated with an access profile of this user,
a plurality of speech recording data sources,
processing circuitry configured to:
extract an i-vector for a speech utterance acquired from one of said data sources using total variability modeling, while minimizing source variation by:
for each data source, estimating a source-specific informative prior, which is defined by a mean and a covariance, and
for each speech utterance acquired using a specific data source, re-centering first-order statistics of the speech utterance around the mean of the informative prior associated with the source, and using the co-variance of the informative prior associated with the source when extracting the i-vector for the speech utterance
compare the extracted i-vector with each i-vector set in the collection, in order to identify a target set most similar to the extracted i-vector, and
grant, to the current user, access to the multimedia system in accordance with the access profile associated with the identified target set.

### Claim 15 (depends on 13)

The method according to claim 13, wherein said database is remote to said multimedia system, and shared by several multimedia systems.
