Facilitating large scale summarization, labelling, and categorization using large language models

A system, comprising:

• at least one processor;
• and
• at least one memory that stores executable instructions that, when executed by the at least one processor, facilitate performance of operations, comprising:
• dividing a group of received inputs into batches, wherein respective sizes of the batches are selected based on a context size of a large language model;
• generating a first temporary summary for a first batch of the batches, wherein the generating of the first temporary summary comprises sending a first prompt to the large language model, and wherein the first prompt comprises a summarization instruction and a first data structure comprising first information indicative of first contents of the first batch;
• generating a second temporary summary for a second batch of the batches, wherein the generating of the second temporary summary comprises sending a second prompt to the large language model, and wherein the second prompt comprises a combination of an update instruction, the first temporary summary, and a second data structure comprising second information indicative of second contents of the second batch;
• replacing the first temporary summary with the second temporary summary, wherein the second temporary summary is an output of the large language model;
• generating content summaries for respective inputs of the group of received inputs;
• based on the content summaries, grouping, via parallel processing, first inputs of the group of received inputs as a first group and second inputs of the group of received inputs as a second group;
• assigning a first category to the first group and a second category to the second group, wherein the assigning comprises, using key-value mapping to create the first category and the second category;
• generating a summary that comprises first information indicative of the first category and second information indicative of the second category;
• and
• outputting the summary as an interactive and configurable hierarchical structure representation to be rendered via another system other than the system.

A non-transitory machine-readable medium, comprising executable instructions that, when executed by at least one processor of network equipment, facilitate performance of operations, the operations comprising:

• transforming files into a hierarchical structure representation, the transforming comprises performing an iterative process of repeated calls to a sorting pipeline, and the iterative process comprising:
• prior to the summarizing of the respective content, splitting the files into batch sets, wherein respective sizes of the batch sets are determined based on a size of a context of a large language model;
• generating a first temporary summary for a first batch set of the batch sets, wherein the generating of the first temporary summary comprises sending a first prompt to the large language model, and wherein the first prompt comprises a summarization instruction and a first list of contents contained in the first batch set;
• generating a second temporary summary for a second batch set of the batch sets, wherein the generating of the second temporary summary comprises sending a second prompt to the large language model, and wherein the second prompt comprises a combination of an update instruction, the first temporary summary, and a second list of contents contained in the second batch set;
• and
• replacing the first temporary summary with the second temporary summary, wherein the second temporary summary is an output of the large language model;
• summarizing respective content for the files, resulting in individual content summations,
• grouping, via parallel processing, the individual content summations into respective groups,
• categorizing the respective groups using existing categories and, based on a group of the respective groups being an uncategorized group that does not matching the existing categories, using key-value mapping that creates a category for the uncategorized group, resulting in generated collections,
• summarizing the generated collections, resulting in a summarized collection;
• and
• outputting the summarized collection as the hierarchical structure representation at a user device, wherein the outputting facilitates an interactive navigation of the hierarchical structure representation based on different visualization strategies that allow navigation of the summarized collection in an interactive and progressive manner.