Back to results
US 2021/0342546 A1Published application
Systems and methods for a privacy preserving text representation learning framework
AssigneeArizona Board of Regents on behalf of Arizona State University
InventorsGhazaleh Beigi, Kai Shu, Ruocheng Guo, Suhang Wang, Huan Liu
Life of this patent
Estimating the term…
Abstract
Various embodiments of a computer-implemented system which learns textual representations while filtering out potentially personally identifying data and retaining semantic meaning within the textual representations are disclosed herein.
Claims20
A method of generating a modified latent text representation for a document, comprising:
- utilizing a processor in communication with a tangible storage medium storing instructions that are executed by the processor to perform operations comprising:
- generating an initial latent representation representative of text in a document;
- inferring an amount of noise to be added to the initial latent representation by finding a privacy budget value that minimizes a loss between a predicted semantic label and a ground truth semantic label for the initial latent representation and maximizes a loss between a predicted private attribute label and a ground truth private attribute label for the initial latent representation;
- and
- adding the amount of noise to the initial latent text representation to generate a modified latent text representation.
2 more elements
A computer system for generating a modified latent text representation for a document, comprising:
- at least one processor in communication with a memory and operable for execution of a plurality of modules, the plurality of modules including:
- an auto-encoder configured to generate an initial latent representation representative of text in a document;
- a noise adder module configured to receive the initial latent representation and add an amount of noise to the initial latent representation to generate a modified latent text representation based on a privacy budget value;
- a semantic meaning discriminator module configured to optimize a set of semantic discriminator classifier parameters and the privacy budget value such that a loss is minimized between the predicted semantic label and the ground truth semantic label for the initial latent representation;
- and
- a private attribute discriminator module configured to optimize a set of private attribute discriminator parameters and the privacy budget value such that a loss is maximized between the predicted private attribute label and the ground truth private attribute label for the initial latent representation.
3 more elements
Dependencies are inferred from the claim text.