Entropy-based detection of the fluency of machine-generated text
AssigneeMicrosoft Technology Licensing, LLC
InventorsSAMER AAMAR, ABEDELKADER ASI, ROY EISENSTADT, SHAHAR KEREN, ALEXANDER TSVETKOV
Life of this patent
Estimating the term…
Loading patent…
AssigneeMicrosoft Technology Licensing, LLC
InventorsSAMER AAMAR, ABEDELKADER ASI, ROY EISENSTADT, SHAHAR KEREN, ALEXANDER TSVETKOV
Estimating the term…
An entropy-based technique is used to select a large language model capable of generating fluent natural language text. An entropy model, trained on fluent natural language samples, is used to determine the entropy of a large language model based on an output text generated by the large language model. The entropy of a machine-generated natural language text is used to quantify the amount of information that the large language model holds with respect to the tokens and context of an input text segment. The entropy score of a model is then used to select a large language model capable of generating fluent text or to select the most fluent machine-generated output text produced by a set of large language models.
A system, comprising:
A computer-implemented method, comprising:
A hardware storage device having stored thereon computer executable instructions that are structured to be executable by a processor of a computing device to thereby cause the computing device to perform actions that:
Dependencies are inferred from the claim text.