Systems and methods for generating contextual table embeddings for tabular data

A system, comprising:

• a data repository comprising a plurality of tables each comprising a plurality of cells;
• an electronic device executing a table embedding computer program that is configured to receive an input table out of the plurality of tables from the data repository, separate the plurality of cells in the input table by data type of each cell, wherein the plurality of cells are separated into cells of a text data type and cells of a numeric data type, embed, for each cell of the input table, the data type for the cell, embed, for each cell having the numeric data type, an embedding vector for a numeric value in the cell using linear projection, enhance the cells of the input table based on a position by embedding a vector representing the position of each cell in the input table, generate contextual embeddings for the input table using an encoder of a table transformer, and generate a table summary for the contextual embeddings using a decoder for the table transformer;
• and
• a downstream system that is configured to receive the contextual embeddings from the table embedding computer program.

A non-transitory computer readable storage medium, including instructions stored thereon, which when read and executed by one or more computer processors, cause the one or more computer processors to perform steps comprising:

• receiving an input table comprising a plurality of cells;
• separating the plurality of cells in the input table by data type of each cell, wherein the plurality of cells are separated into cells of a text data type and cells of a numeric data type;
• embedding, for each cell of the input table, the data type for the cell;
• embedding, for each cell having the numeric data type, an embedding vector for a numeric value in the cell using linear projection;
• enhancing the cells of the input table based on a by embedding a vector representing a position of each cell in the input table;
• generating contextual embeddings for the input table using an encoder of a table transformer;
• and
• generating a table summary for the contextual embeddings using a decoder for the table transformer.