Generating machine renderable representations of forms using machine learning

A system, comprising:

• a computer processor;
• a data repository configured to store a structured representation comprising a plurality of line objects and a plurality of columns of a table;
• and
• a structured representation generator, executing on the computer processor and configured to:
• cluster a plurality of form elements into the plurality of line objects and the plurality of columns of the table by applying a trained multi-dimensional clustering model to a plurality of spatial coordinates of the plurality of form elements,
• assign a table header line type to a table header line object of the plurality of line objects based on:
• a spatial coordinate of the table header line object relative to a spatial coordinate of a topmost table data line object of the plurality of line objects, wherein the topmost table data line object is assigned a table data line type, and
• a determination that a number of columns of the table header line object is within a threshold of a number of columns of the topmost table data line object, and
• present the structured representation to a user.

A method comprising:

• clustering an initial plurality of form elements into an initial plurality of line objects and an initial plurality of columns of an initial table of an initial structured representation by applying a trained multi-dimensional clustering model to an initial plurality of spatial coordinates of the initial plurality of form elements, the initial structured representation having a structured representation type;
• assigning a table header line type to an initial table header line object of the initial plurality of line objects based on:
• a spatial coordinate of the initial table header line object relative to a spatial coordinate of an initial topmost table data line object of the initial plurality of line objects, wherein the initial topmost table data line object is assigned a table data line type, and
• a determination that a number of columns of the initial table header line object is within a threshold of a number of columns of the initial topmost table data line object;
• adding the initial structured representation to a data repository;
• clustering a next plurality of form elements into a next plurality of line objects and a next plurality of columns of a next table of a next structured representation by applying the trained multi-dimensional clustering model to a next plurality of spatial coordinates of the next plurality of form elements, the next structured representation having the structured representation type;
• assigning the table header line type to a next table header line object of the next plurality of line objects based on:
• a spatial coordinate of the next table header line object relative to a spatial coordinate of a next topmost table data line object of the next plurality of line objects, wherein the next topmost table data line object is assigned the table data line type, and
• a determination that a number of columns of the next table header line object is within a threshold of a number of columns of the next topmost table data line object;
• determining that the initial structured representation and the next structured representation are different;
• and
• in response to determining that the initial structured representation and the next structured representation are different, replacing, in the data repository, the initial structured representation with the next structured representation.