Text Editing Using Voice and Gesture Inputs for Assistant Systems

One or more computer-readable non-transitory storage media embodying software that is operable when executed to:

• present, via a user interface of the client system, a text message based on a user utterance received at the client system, wherein the text message comprises a plurality of n-grams;
• receive, at the client system, a first user request to edit the text message;
• present, via the user interface, the text message visually divided into a plurality of blocks, wherein each block comprises one or more of the n-grams of the text message, and wherein the n-grams in each block are contiguous with respect to each other and grouped within the block based on an analysis of the text message by a natural-language understanding (NLU) module;
• receive, at the client system, a second user request to edit one or more of the plurality of blocks;
• and
• present, via the user interface, an edited text message, wherein the edited text message is generated based on the second user request.

A system comprising:

• one or more processors;
• and a non-transitory memory coupled to the processors comprising instructions executable by the processors, the processors operable when executing the instructions to:
• present, via a user interface of the client system, a text message based on a user utterance received at the client system, wherein the text message comprises a plurality of n-grams;
• receive, at the client system, a first user request to edit the text message;
• present, via the user interface, the text message visually divided into a plurality of blocks, wherein each block comprises one or more of the n-grams of the text message, and wherein the n-grams in each block are contiguous with respect to each other and grouped within the block based on an analysis of the text message by a natural-language understanding (NLU) module;
• receive, at the client system, a second user request to edit one or more of the plurality of blocks;
• and
• present, via the user interface, an edited text message, wherein the edited text message is generated based on the second user request.