AI platform for processing and querying specified objects

A method of processing files for an artificial intelligence (AI) querying service, the method comprising:

• hierarchically parsing the files into a set of hierarchically connected data chunks;
• generating metadata for each of the hierarchically connected data chunks, wherein the metadata includes hierarchical information;
• processing the hierarchically connected data chunks and metadata with an embedding model to generate vector embeddings that include the hierarchical information;
• generating textual summaries from the hierarchically connected data chunks;
• and
• storing the vector embeddings, textual summaries, and hierarchically connected data chunks for the AI querying service.

An artificial intelligence platform, comprising:

• a memory;
• and
• a processor coupled to the memory and configured to process a specified set of data objects for an AI querying service according to process that includes:
• hierarchically parsing the specified set of objects into a set of hierarchically connected data chunks;
• generating metadata for each of the hierarchically connected data chunks, wherein the metadata includes hierarchical information;
• processing the hierarchically connected data chunks and metadata with an embedding model to generate vector embeddings that include the hierarchical information;
• and
• storing the vector embeddings and hierarchically connected data chunks for the AI querying service;
• wherein the AI querying service processes a query according to a process that includes:
• generating a query embedding from the query using the embedding model;
• retrieving a subset of hierarchically connected data chunks based on the query embedding;
• submitting the query and subset of hierarchically connected data chunks to a large language model (LLM);
• and
• receiving a response from the LLM.