Speaker identity and content de-identification

A system for speaker identity and content de-identification under privacy guarantees, comprising:

• at least one processor;
• and
• a non-transitory processor-readable memory device storing instructions that when executed by the at least one processor causes the at least one processor to perform operations including:
• receiving a set of voice recordings of different speeches delivered by different speakers;
• for each of the different speakers, extracting features corresponding to the speaker from at least one of the different speeches, wherein the at least one speech is delivered by the speaker;
• clustering all extracted features into different clusters based on similarity;
• extracting textual content from a first speech of the different speeches, wherein the first speech is delivered by a first speaker of the different speakers;
• generating de-identified textual content by anonymizing privacy-sensitive personal information included in the textual content;
• generating a synthetic speaker identity corresponding to the first speaker based on extracted features included in a first cluster of the different clusters, wherein the first cluster is different from a second cluster of the different clusters, and the second cluster includes extracted features corresponding to the first speaker;
• and
• synthesizing a new speech waveform based on the synthetic speaker identity to deliver the de-identified textual content, wherein the new speech waveform is different from a speech waveform of the first speech.

A computer program product for speaker identity and content de-identification under privacy guarantees, the computer program product comprising a computer readable storage medium having program instructions embodied therewith, the program instructions executable by a processor to cause the processor to:

• receive a set of voice recordings of different speeches delivered by different speakers;
• for each of the different speakers, extract features corresponding to the speaker from at least one of the different speeches, wherein the at least one speech is delivered by the speaker;
• cluster all extracted features into different clusters based on similarity;
• extract textual content from a first speech of the different speeches, wherein the first speech is delivered by a first speaker of the different speakers;
• generate de-identified textual content by anonymizing privacy-sensitive personal information included in the textual content;
• generate a synthetic speaker identity corresponding to the first speaker based on extracted features included in a first cluster of the different clusters, wherein the first cluster is different from a second cluster of the different clusters, and the second cluster includes extracted features corresponding to the first speaker;
• and
• synthesize a new speech waveform based on the synthetic speaker identity to deliver the de-identified textual content, wherein the new speech waveform is different from a speech waveform of the first speech.