Analysis and validation of language models

A non-transitory computer readable storage medium storing one or more programs, the one or more programs comprising instructions, which when executed by one or more processors of an electronic device, cause the electronic device to:

• obtain a first set of data corresponding to one or more tokens predicted based on one or more previous tokens;
• determine a probability that the first set of data corresponds to a prediction generated by a first language model trained using a user privacy preserving training process;
• and
• in accordance with a determination that the probability is within a predetermined range:
• determine that the one or more tokens correspond to a prediction associated with the user privacy preserving training process;
• and
• output a predicted token sequence including the one or more tokens and the one or more previous tokens.

A method for validating language models, the method comprising:

• at an electronic device with one or more processors and memory:
• obtaining a first set of data corresponding to one or more tokens predicted based on one or more previous tokens;
• determining a probability that the first set of data corresponds to a prediction generated by a first language model trained using a user privacy preserving training process;
• and
• in accordance with a determination that the probability is within a predetermined range:
• determining that the one or more tokens correspond to a prediction associated with the user privacy preserving training process;
• and
• outputting a predicted token sequence including the one or more tokens and the one or more previous tokens.