Providing image context for information retrieval

A method, comprising:

• extracting text from a document;
• vectorizing the extracted text to obtain at least one vector;
• extracting image data from the document;
• storing, in an object storage, at least one image in the image data;
• adding, to metadata of the at least one vector, a link to the stored at least one image;
• and
• storing, in a vector database,
• the at least one vector, and
• the metadata of the at least one vector with the added link to the stored at least one image in the object storage,
• wherein the method further comprises, in response to a user query,
• retrieving, from the vector database,
• one or more vectors corresponding to the user query, and
• one or more links to one or more images stored in the object storage, wherein the one or more links are included in metadata of the one or more vectors;
• generating, using a Large Language Model (LLM), a response to the user query based on the one or more vectors;
• and
• returning the generated response together with the one or more links to the one or more images stored in the object storage,
• the retrieving the one or more vectors comprises:
• vectorizing the user query to obtain at least one inquiry vector;
• and
• searching the vector database for the one or more vectors that match the at least one inquiry vector, and
• the method further comprises:
• extracting the one or more links to the one or more images from the metadata of the one or more vectors that match the at least one inquiry vector;
• and
• removing duplicated links in the extracted one or more links, before returning together with the generated response.

A non-transitory computer-readable medium having executable instructions recorded thereon that, in response to execution by at least one processor, cause performance of operations comprising:

• extracting text from a document;
• vectorizing the extracted text to obtain at least one vector;
• extracting image data from the document;
• storing, in an object storage, at least one image in the image data;
• adding, to metadata of the at least one vector, a link to the stored at least one image;
• and
• storing, in a vector database,
• the at least one vector, and
• the metadata of the at least one vector with the added link to the stored at least one image in the object storage,
• wherein the operations further comprise, in response to a user query,
• retrieving, from the vector database,
• one or more vectors corresponding to the user query, and
• one or more links to one or more images stored in the object storage, wherein the one or more links are included in metadata of the one or more vectors;
• generating, using a Large Language Model (LLM), a response to the user query based on the one or more vectors;
• and
• returning the generated response together with the one or more links to the one or more images stored in the object storage,
• the retrieving the one or more vectors comprises:
• vectorizing the user query to obtain at least one inquiry vector;
• and
• searching the vector database for the one or more vectors that match the at least one inquiry vector, and
• he operations further comprise:
• extracting the one or more links to the one or more images from the metadata of the one or more vectors that match the at least one inquiry vector;
• and
• removing duplicated links in the extracted one or more links, before returning together with the generated response.