Pre-fetching results from large language models

A computing system comprising:

• a processor;
• and
• a memory storing instructions that, when executed by the processor, configure the computing system to:
• acquire a context of an interaction between a user and an Artificial Intelligence (AI) character generated by an AI character model in a virtual environment;
• predict, based on the context, one or more anticipated words to be uttered by the user;
• generate, based on the one or more anticipated words, at least one query to a large language model (LLM);
• provide the at least one query to the LLM to obtain at least one response from the LLM;
• generate, based on the at least one response from the LLM, an anticipated reply of the AI character model to the one or more anticipated words to be pronounced by the user;
• receive one or more words uttered by the user;
• determine that a level of a discrepancy between the one or more words and the one or more anticipated words is below a predetermined threshold;
• and
• based on the determination, provide the anticipated reply to the user.

A non-transitory computer-readable storage medium, the computer-readable storage medium including instructions that, when executed by a computing system, cause the computing system to:

• acquire a context of an interaction between a user and an Artificial Intelligence (AI) character generated by an AI character model in a virtual environment;
• predict, based on the context, one or more anticipated words to be uttered by the user;
• generate, based on the one or more anticipated words, at least one query to a large language model (LLM);
• provide the at least one query to the LLM to obtain at least one response from the LLM;
• generate, based on the at least one response from the LLM, an anticipated reply of the AI character model to the one or more anticipated words to be pronounced by the user;
• receive one or more words uttered by the user;
• determine that a level of a discrepancy between the one or more words and the one or more anticipated words is below a predetermined threshold;
• and
• based on the determination, provide the anticipated reply to the user.