Systems and methods for generative AI-enhanced localized small language model data processing

A computer program product for generative AI-enhanced localized small language model data processing, the computer program product comprising a non-transitory computer-readable medium comprising code causing an apparatus to:

• receive, via a network interface, a plurality of small language models, wherein each small language model of the plurality of small language models is configured to process a file type of a plurality of file types;
• receive a datafile comprising one or more data entries, wherein each data entry of the one or more data entries has a data type of one or more data types;
• classify the datafile as being a file type of the plurality of file types;
• ingest, based on classifying the datafile as being the file type, the datafile in a small language model of the plurality of small language models, wherein the small language model is configured to process the file type of the datafile;
• generate, via the small language model, a data summarization of the one or more data entries and an adjusted datafile, wherein the adjusted datafile comprises adjusted image resolutions or clarity enhancements of the datafile;
• ingest, based on the data summarization being generated, the data summarization in one or more additional small language models of the plurality of small language models configured to process other file types of the plurality of file types, wherein the other file types are different from the file type of the datafile;
• generate an accuracy measurement for the data summarization via each small language model of the one or more additional small language models to generate accuracy measurements;
• calculate an average accuracy using each accuracy measurement of the generated accuracy measurements;
• compare the average accuracy against a threshold to determine whether the data summarization is valid;
• and
• output, based on determining the data summarization is valid, the data summarization and the adjusted datafile via the network interface.

A computer-implemented method for generative AI-enhanced localized small language model data processing, the method comprising:

• receiving, via a network interface, a plurality of small language models, wherein each small language model of the plurality of small language models is configured to process a file type of a plurality of file types;
• receiving a datafile comprising one or more data entries, wherein each data entry of the one or more data entries has a data type of one or more data types;
• classifying the datafile as being a file type of the plurality of file types;
• ingesting, based on classifying the datafile as being the file type, the datafile in a small language model of the plurality of small language models, wherein the small language model is configured to process the file type of the datafile;
• generating, via the small language model, a data summarization of the one or more data entries and an adjusted datafile, wherein the adjusted datafile comprises adjusted image resolutions or clarity enhancements of the datafile;
• ingesting, based on the data summarization being generated, the data summarization in one or more additional small language models of the plurality of small language models configured to process other file types of the plurality of file types, wherein the other file types are different from the file type of the datafile;
• generating an accuracy measurement for the data summarization via each small language model of the one or more additional small language models to generate accuracy measurements;
• calculating an average accuracy using each accuracy measurement of the generated accuracy measurements;
• comparing the average accuracy against a threshold to determine whether the data summarization is valid;
• and
• outputting, based on determining the data summarization is valid, the data summarization and the adjusted datafile via the network interface.