Controlling offensive content in output

A computer-implemented method comprising:

• under control of one or more computing devices configured with specific computer-executable instructions,
• obtaining first input data regarding a first user utterance by a user;
• obtaining a characteristic of the user;
• performing speech processing on the first audio data to generate first speech processing results, the first speech processing results including contextual information indicating a context to which the first utterance relates;
• determining a first response using the first speech processing results, wherein the first response comprises a name of a content item;
• generating a profanity score for the name using an output filter model, the name, and the contextual information;
• identifying a sensitivity threshold for users having the characteristic;
• determining the profanity score for the name exceeds the sensitivity threshold;
• generating a first output using the first response, wherein (i) a portion of the first output corresponding to the name of the content item is modified or (ii) the name of the content item is modified before generating the first output;
• and
• transmitting the first output to a client device.

One or more non-transitory computer readable media comprising executable code that, when executed, cause one or more computing devices to perform a process comprising:

• obtaining first input data regarding a first user utterance;
• performing speech processing on the first input data to generate first speech processing results, the first speech processing results including contextual information indicating a context to which the first utterance relates;
• determining a first response to the first user utterance using the first speech processing results, wherein the first response comprises a name of a content item;
• generating a profanity score for the name using an output filter model, the name, and the contextual information;
• identifying a sensitivity threshold using the first input data;
• determining the profanity score for the name exceeds the sensitivity threshold;
• and
• generating a first output using the first response, wherein (i) a portion of the first output corresponding to the name of the content item is modified or (ii) the name of the content item is modified before generating the first output.