Streaming of chat in serp

A computing device comprising:

• a processor;
• and
• memory storing instructions that, when executed by the processor, cause the processor to perform acts comprising:
• transmitting a user query to a search system;
• receiving conversational output from a generative language model, where the generative language model generated the conversational output based upon a prompt comprising the query;
• and
• streaming the conversational output on one of a search engine results page (SERP) or webpage to which the user has navigated from the SERP, such that the conversational output is presented to a user as though it is being typed in real time.

A method that facilitates providing conversational interaction on search engine results page presented on an interface of a computing device, the method comprising:

• receiving a query provided by a user;
• generating a prompt that is to be input to a generative language model, where the prompt includes an instruction for the generative language model to generate conversational output based upon the query;
• providing the prompt as input to the generative language model, wherein the generative language model generates conversational output based upon the prompt;
• streaming the conversational output to one of a search engine results page (SERP) or webpage to which the user has navigated from the SERP, such that the conversational output appears to the user as though it is being typed in real time.