Generating content with generative artificial intelligence (ai) models by parallel decoding using disaggregated distributions

A computer-implemented method for generating suggestion items using one or more artificial intelligence (AI) models, comprising:

• based on receiving user input associated with a search query, generating multiple suggestion item prompts that include the user input and multiple embedding group identifiers, wherein each of the multiple embedding group identifiers differ;
• providing the multiple suggestion item prompts in parallel to a corresponding number of generative AI models to generate multiple suggestion items corresponding to the user input;
• receiving the multiple suggestion items from the generative AI models, wherein the multiple suggestion items generated based on the user input differ;
• and
• providing the multiple suggestion items in response to receiving the user input.

A system comprising:

• a processing system;
• and
• a computer memory comprising instructions that, when executed by the processing system, cause the system to perform operations of:
• generating a combined set of embedding groups with a first embedding group and a second embedding group based on partitioning a training dataset into training data subsets that pair a sample query with a different sample suggestion item corresponding to the sample query;
• based on receiving user input associated with a search query:
• generating a first suggestion item prompt that includes the user input and a first embedding group identifier;
• and
• generating a second suggestion item prompt that includes the user input and a second embedding group identifier, wherein the first embedding group identifier differs from the second embedding group identifier;
• providing the first suggestion item prompt to a first generative AI model to generate a first suggestion item corresponding to the user input based on the first embedding group;
• providing the second suggestion item prompt to a second generative AI model to generate a second suggestion item corresponding to the user input based on the second embedding group, wherein the first suggestion item prompt and the second suggestion item prompt are provided concurrently;
• receiving the first suggestion item and the second suggestion item, wherein the first suggestion item generated based on the user input differs from the second suggestion item generated based on the user input;
• and
• providing the first suggestion item and the second suggestion item in response to receiving the user input.