Data cell cluster identification and table transformation

A system, comprising:

• a first processing node, implemented by one or more hardware processors, comprising a data reception module to sequentially access individual lines of information included in a file stored in an electronic storage medium;
• and
• a second processing node comprising a transformation module implemented by the one or more hardware processors to couple to the data reception module in the first processing node, the transformation module
• to detect existence of data clusters in the file, the detecting comprising associating a cell with a new data cluster or an existing data cluster, based on comparing the cell with adjacent cells in a horizontal direction corresponding to the individual lines,
• to generate metadata including characteristics associated with each of the data clusters,
• to identify at least some of the data clusters as being associated with predefined table types comprising vertical tables, horizontal tables, or cross tables,
• to merge one or more of the data clusters having common cluster table schemas into section tables, based on the metadata, and
• to transform the vertical tables, the horizontal tables, the cross tables, the section tables, and remaining un-merged data clusters into a single flat table having a vertical or horizontal orientation, based on the metadata.

A processor-implemented method to execute on one or more processors that perform the method, comprising:

• accessing, sequentially, individual lines of information included in a file stored in an electronic storage medium;
• detecting existence of data clusters in the file, the detecting comprising associating a cell with a new data cluster or an existing data cluster, based on comparing the cell with adjacent cells in a horizontal direction corresponding to the individual lines,
• generating metadata including characteristics associated with each of the data clusters,
• identifying at least some of the data clusters as being associated with predefined table types comprising vertical tables, horizontal tables, or cross tables,
• merging one or more of the data clusters having common cluster table schemas into section tables, based on the metadata, and
• transforming the vertical tables, the horizontal tables, the cross tables, the section tables, and remaining un-merged data clusters into a single flat table having a vertical or horizontal orientation, based on the metadata.

A non-transitory computer-readable storage medium containing executable instructions stored thereon which, when executed, result in a processor performing:

• accessing, sequentially, individual lines of information included in a file stored in an electronic storage medium;
• detecting existence of data clusters in the file, the detecting comprising associating a cell with a new data cluster or an existing data cluster, based on comparing the cell with adjacent cells in a horizontal direction corresponding to the individual lines,
• generating metadata including characteristics associated with each of the data clusters,
• identifying at least some of the data clusters as being associated with predefined table types comprising vertical tables, horizontal tables, or cross tables,
• merging one or more of the data clusters having common cluster table schemas into section tables, based on the metadata, and
• transforming the vertical tables, the horizontal tables, the cross tables, the section tables, and remaining un-merged data clusters into a single flat table having a vertical or horizontal orientation, based on the metadata.