Language detection and language translation evaluation for llms using raiops integrated llmops metrics

A system for improving a language detection task and a language translation task of a Large Language Model (LLM), the system comprising:

• at least one memory storing machine-executable instructions;
• and
• at least one processor communicatively coupled with the at least one memory, wherein the at least one processor is configured to execute the machine-executable instructions to perform operations comprising:
• generating, in response to receiving data associated with a prompt, a plurality of chunks, each chunk of the plurality of chunks includes a subset of the data;
• identifying a language, of each chunk, using a plurality of language detection libraries;
• generating, using the LLM, a translation output in a preferred target translation language;
• evaluating the translation output using a plurality of metrics, each metric of the plurality of metrics evaluates the translation output for one or more translation quality aspects;
• generating a score value for each numerical metric of the plurality of metrics;
• generating, based upon the score value for each numerical metric of the plurality of metrics, a SAFE score value;
• and
• causing, based upon the SAFE score value that meets a predetermined threshold condition, the translation output to be transmitted or presented.

A non-transitory computer-readable media comprising instructions stored thereon for improving a language detection task and a language translation task of a Large Language Model (LLM), wherein the instructions, when executed by at least one processor of a computing device, cause the computing device to perform operations comprising:

• generating, in response to receiving data associated with a prompt, a plurality of chunks, each chunk of the plurality of chunks includes a subset of the data;
• identifying a language, of each chunk, using a plurality of language detection libraries;
• generating, using the LLM, a translation output in a preferred target translation language;
• evaluating the translation output using a plurality of metrics, each metric of the plurality of metrics evaluates the translation output for one or more translation quality aspects;
• generating a score value for each numerical metric of the plurality of metrics;
• generating, based upon the score value for each numerical metric of the plurality of metrics, a SAFE score value;
• and
• causing, based upon the SAFE score value that meets a predetermined threshold condition, the translation output to be transmitted or presented.