US 12,626,692 B2Granted

Generative language models

AssigneeAmazon Technologies, Inc.

InventorsRahul Gupta, Charith Peris, Palash Goyal, Lisa Bauer, Ninareh Mehrabi

Life of this patent

Estimating the term…

Loading patent…

Abstract

Systems and techniques for moderating responses of a generative language model are described herein. Some user inputs to a generative language model may include biases, misinformation, and other references to moderated content. To prevent the generative language model from generating responses that promote these forms of moderated content, the techniques described determine a policy corresponding to the determined moderated content category of the user input. The determined policy may correspond to a template of instructions for how the generative language model is to respond to such moderated content. The output of the generative language model may also be moderated before being presented to the user.

Claims20

Dependent claims

A computer-implemented method, comprising:

receiving first input data corresponding to a first spoken natural language input;
processing, using a first classifier model configured to classify user inputs to one or more moderated content categories, the first input data to determine that the first spoken natural language input corresponds to a first moderated content category;
determining, based in part on the first moderated content category, first data representing a first policy for processing user inputs corresponding to the first moderated content category;
receiving a first policy template for processing user inputs corresponding to the first moderated content category, the first policy template including at least a first portion to be populated based on the first policy;
generating, using the first policy template and the first data, policy data representing an instruction to a language model to generate a response in view of the first policy;
generating prompt data including the policy data and the first input data;
processing, using the language model, the prompt data to generate output data;
and
causing presentation of the output data in response to the first spoken natural language input.

6 more elements

A system, comprising:

at least one processor;
and
at least one memory comprising instructions that, when executed by the at least one processor, cause the system to:
receive first data representing a first input;
determine the first data corresponds to a first moderated content category;
determine, based on the first moderated content category, second data representing a policy for responding to inputs corresponding to the first moderated content category;
receive a policy template corresponding to the first moderated content category, the policy template including at least a first portion to be populated based on the second data;
determine prompt data based on the first data, the policy template, and the second data;
and
process the prompt data, using a language model, to determine first output data responsive to the first input.

7 more elements

Dependencies are inferred from the claim text.