Generating multi-modal response(s) through utilization of large language model(s)

A system comprising:

• at least one processor;
• and
• memory storing instructions that, when executed, cause the at least one processor to be operable to:
• obtaining a plurality of training instances to be utilized in fine-tuning a large language model (LLM), wherein each training instance, of the plurality of training instance, includes:
• a corresponding natural language (NL) based input, and
• a corresponding multi-modal response that is responsive to the corresponding NL based input, the corresponding multi-modal response including corresponding textual content and a corresponding multimedia content tag that is indicative of corresponding multimedia content that is to be included in the corresponding multi-modal response;
• fine-tuning, based on the plurality of training instances, the LLM;
• and
• causing the LLM to be deployed for utilization in generating subsequent multi-modal responses that are responsive to subsequent NL based inputs that are associated with client devices of users.

A non-transitory computer-readable storage medium storing instructions that, when executed, cause at least one processor to perform operations, the operations comprising:

• obtaining a plurality of training instances to be utilized in fine-tuning a large language model (LLM), wherein each training instance, of the plurality of training instance, includes:
• a corresponding natural language (NL) based input, and
• a corresponding multi-modal response that is responsive to the corresponding NL based input, the corresponding multi-modal response including corresponding textual content and a corresponding multimedia content tag that is indicative of corresponding multimedia content that is to be included in the corresponding multi-modal response;
• fine-tuning, based on the plurality of training instances, the LLM;
• and
• causing the LLM to be deployed for utilization in generating subsequent multi-modal responses that are responsive to subsequent NL based inputs that are associated with client devices of users.