Text embedding generation and applications

A system comprising:

• data processing hardware;
• and
• memory hardware in communication with the data processing hardware, the memory hardware storing instructions that when executed on the data processing hardware cause the data processing hardware to:
• receive, from a client device, a text embedding generation query requesting the data processing hardware:
• generate, based on a computational cost threshold, a text embedding for each data element of a plurality of data elements stored at a data warehouse;
• and
• train a machine learning model using the text embeddings;
• responsive to receiving the text embedding generation query, select, using the computational cost threshold, a text embedding model from a plurality of different text embedding models integrated in the data warehouse;
• generate, using the text embedding model, the text embedding for each data element of the plurality of data elements, wherein the text embedding model executes within the data warehouse without migrating the plurality of data elements out of the data warehouse;
• train, by the data processing hardware and using the text embeddings, the machine learning model;
• and
• after training the machine learning model, store the machine learning model at the data warehouse.