Detection and handling of errors in input and output to and from a large language model

A system comprising:

• one or more processors;
• and
• one or more computer-readable media storing instructions which, when executed by the one or more processors, cause the system to perform operations comprising:
• generating a request payload having a common request body specification based on an utterance, wherein the common request body specification is a standardized data input format used by a generative artificial intelligence (GenAI) interface for interacting with a plurality of GenAI model providers;
• converting the common request body specification into a custom request body specification having a data input format associated with a GenAI model provider selected from the plurality of GenAI model providers;
• communicating, by the GenAI interface, the request payload with the custom request body specification to the GenAI provider for processing by a GenAI model;
• receiving, at the GenAI interface from the GenAI model provider, a response payload associated with:
• (i) an error, (ii) processing the request payload, or (iii) both;
• generating a custom response body specification associated with the response payload, wherein the custom response body specification has a data output format associated with the GenAI model provider;
• converting the custom response body specification into a common response body specification, wherein the common response body specification is a standardized data output format used by the GenAI interface for interacting with the plurality of GenAI model providers;
• determining whether the response payload includes an error or invalid data based on an evaluation of the common response body specification;
• and
• responsive to determining whether the response payload includes an error or invalid data, (i) executing one or more actions for handling the error or invalid data when the response payload includes the error or invalid data, or (ii) executing one or more other actions for processing the response payload when the response payload does not include the error or invalid data.

One or more non-transitory computer-readable media storing instructions which, when executed by one or more processors, cause the one or more processors to perform operations comprising:

• generating a request payload having a common request body specification based on an utterance, wherein the common request body specification is a standardized data input format used by a generative artificial intelligence (GenAI) interface for interacting with a plurality of GenAI model providers;
• converting the common request body specification into a custom request body specification having a data input format associated with a GenAI model provider selected from the plurality of GenAI model providers;
• communicating, by the GenAI interface, the request payload with the custom request body specification to the GenAI provider for processing by a GenAI model;
• receiving, at the GenAI interface from the GenAI model provider, a response payload associated with:
• (i) an error, (ii) processing the request payload, or (iii) both;
• generating a custom response body specification associated with the response payload, wherein the custom response body specification has a data output format associated with the GenAI model provider;
• converting the custom response body specification into a common response body specification, wherein the common response body specification is a standardized data output format used by the GenAI interface for interacting with the plurality of GenAI model providers;
• determining whether the response payload includes an error or invalid data based on an evaluation of the common response body specification;
• and
• responsive to determining whether the response payload includes an error or invalid data, (i) executing one or more actions for handling the error or invalid data when the response payload includes the error or invalid data, or (ii) executing one or more other actions for processing the response payload when the response payload does not include the error or invalid data.