Text-based information extraction from images

A system for extracting text information from images comprises:

• persistent storage for storing:
• raw training data, and
• processed training data;
• and
• an extraction system, comprising a processor and memory, programmed to:
• obtain an extraction request associated with live data comprising an image;
• generate, using a prediction model, rotational variant features and rotational invariant features associated with the live data;
• generate, using the prediction model, text embeddings associated with the rotational variant features using overlapping kernel-based embedding on the live data;
• generate, using the prediction model, attention values for each pixel in the live data using context attention;
• apply a trained language model to the text embeddings, attention values, and the live data to generate predictions;
• and
• perform extraction actions based on the predictions.

A non-transitory computer readable medium comprising computer readable program code, which when executed by a computer processor enables the computer processor to perform a method for extracting text information from images, the method comprising:

• obtaining an extraction request associated with live data comprising an image;
• generating, using a prediction model, rotational variant features and rotational invariant features associated with the live data;
• generating, using the prediction model, text embeddings associated with the rotational variant features using overlapping kernel-based embedding on the live data;
• generating, using the prediction model, attention values for each pixel in the live data using context attention;
• applying a trained language model to the text embeddings, attention values, and the live data to generate predictions;
• and
• performing extraction actions based on the predictions.