Performing semantic segmentation of form images using deep learning

A non-transitory computer readable storage medium including a set of instructions that, when executed by at least one processor, cause a computing device to:

• use a form conversion neural network trained to determine semantic structures of digitized paper forms by:
• generating a feature map by processing a digitized paper form comprising a plurality of pixels using a neural network encoder;
• determining one or more low-level semantic characteristics for the plurality of pixels by processing the feature map using a neural network low-level semantic decoder;
• and
• determining one or more high-level semantic characteristics for the plurality of pixels by processing the feature map using one or more neural network high-level semantic decoders;
• and
• generate a Tillable digital form based on the determined one or more low-level semantic characteristics and the determined one or more high-level semantic characteristics.

A system for converting paper forms into corresponding Tillable digital forms, comprising:

• a memory component comprising:
• analytics training data associated with a plurality of pixels of training digitized paper forms;
• and
• a neural network encoder that outputs feature maps to a form conversion neural network reconstruction decoder, a neural network low-level semantic decoder, and one or more neural network high-level semantic decoders;
• at least one server;
• and
• at least one non-transitory computer readable storage medium storing instructions thereon that, when executed by the at least one server, cause the system to:
• generate a feature map by processing a digitized paper form comprising a plurality of pixels using the neural network encoder;
• determine one or more low-level semantic characteristics for the plurality of pixels by processing the feature map using the neural network low-level semantic decoder;
• and
• determine one or more high-level semantic characteristics for the plurality of pixels by processing the feature map using the one or more neural network high-level semantic decoders.