Unified rdbms framework for hybrid vector search on different data types via sql and nosql

A method performed by a database system, comprising:

• accessing a plurality of documents that comprises documents of different types;
• for each document of the plurality of documents:
• identifying a type of said each document;
• selecting a conversion operation that corresponds to the type;
• using the conversion operation to convert data within said each document to plaintext;
• generating a vector index based on the plaintext;
• generating a text index based on the plaintext;
• wherein the method is performed by one or more computing devices.

One or more non-transitory storage media storing instructions which, when executed by one or more computing devices of a database system, cause:

• accessing a plurality of documents;
• generating a vector table and a text table;
• for each document of the plurality of documents:
• converting data within said each document to plaintext;
• generating a plurality of chunks based on the plaintext;
• generating, by an embedding model, a plurality of vectors based on the plurality of chunks;
• storing the plurality of vectors in the vector table;
• storing, in the vector table, a document identifier, that identifies said each document, in association with each vector of the plurality of vectors;
• generating a plurality of tokens based on the plaintext;
• storing the plurality of tokens in the text table;
• storing, in the text table, the document identifier in association with each token of the plurality of tokens.