Machine-learned language models which generate intermediate textual analysis in service of contextual text generation

A computer-implemented method for operating a machine-learned language model to interact with a search engine to generate output text based on input text, the method comprising:

• obtaining, by a computing system comprising one or more computing devices, the input text;
• processing, by the computing system, the input text with the machine-learned language model to generate intermediate text as an intermediate output of the machine-learned language model, wherein the intermediate text invokes a query service to query results from the search engine;
• obtaining, by the computing system, the results from the search engine;
• processing, by the computing system, at least one of the results from the search engine with the machine-learned language model to generate the output text;
• and
• providing, by the computing system, the output text as an output.

One or more non-transitory computer-readable media that collectively store instructions that, when executed by one or more processors of a computing system, cause the computing system to perform operations, the operations comprising:

• obtaining, by the computing system, an input text;
• processing, by the computing system, the input text with a machine-learned language model to generate intermediate text as an intermediate output of the machine-learned language model, wherein the intermediate text invokes a query service to query results from the search engine;
• obtaining, by the computing system, the results from the search engine;
• processing, by the computing system, at least one of the results from the search engine with the machine-learned language model to generate an output text;
• and
• providing, by the computing system, the output text as an output.