Extremely fast utterances for measuring unintended memorization in automatic speech recognition models
AssigneeGoogle Inc.
InventorsLun Wang, Om Dipakbhai Thakkar, Rajiv Mathews
Life of this patent
Estimating the term…
Abstract
A method includes obtaining an automatic speech recognition (ASR) model pre-trained on an initial training dataset, creating a set of canary speech utterances, and speeding up each canary speech utterance in the set of canary speech utterances. The operations also include fine-tuning the ASR model on the set of sped-up canary speech utterances and measuring un-intended memorization of the fine-tuned ASR model based on speech recognition results performed by the fine-tuned ASR model on the sped-up canary speech utterances.
Claims26
A computer-implemented method executed on data processing hardware that causes the data processing hardware to perform operations comprising:
- obtaining an automatic speech recognition (ASR) model pre-trained on an initial training dataset;
- creating a set of canary speech utterances;
- speeding up each canary speech utterance in the set of canary speech utterances;
- fine-tuning the ASR model on the set of sped-up canary speech utterances;
- and
- measuring un-intended memorization of the fine-tuned ASR model based on speech recognition results performed by the fine-tuned ASR model on the sped-up canary speech utterances.
A system comprising:
- data processing hardware;
- and
- memory hardware in communication with the data processing hardware, the memory hardware storing instructions that when executed on the data processing hardware cause the data processing hardware to perform operations that include:
- obtaining an automatic speech recognition (ASR) model pre-trained on an initial training dataset;
- creating a set of canary speech utterances;
- speeding up each canary speech utterance in the set of canary speech utterances;
- fine-tuning the ASR model on the set of sped-up canary speech utterances;
- and
- measuring un-intended memorization of the fine-tuned ASR model based on speech recognition results performed by the fine-tuned ASR model on the sped-up canary speech utterances.
Dependencies are inferred from the claim text.