Method and system for data identification and extraction using pictorial representations in a source document

A system for data identification and extraction using pictorial representations in a source document comprising:

• at least one processor;
• and
• at least one memory coupled to the at least one processor, the at least one memory having stored therein instructions which when executed by any set of the one or more processors, perform a process for data identification and extraction using pictorial representations in a source document, the process for data identification and extraction using pictorial representations in a source document including:
• creating a template database, the template database including one or more data extraction templates for identifying and extracting data from one or more source documents, each data extraction template being associated with source documents from a specific source document source;
• generate pictorial representation data, the pictorial representation data including key data associated with one or more known pictorial representations, the one or more known pictorial representations each being associated with one or more source document sources;
• obtaining source document data;
• analyzing the source document data to identify potential pictorial representation data;
• analyzing the potential pictorial representation data and generating key data associated with the potential pictorial representation data;
• comparing the key data associated with the potential pictorial representation data with the key data associated with one or more known pictorial representations;
• and
• if the key data associated with the potential pictorial representation data matches the key data associated with a matched one of the known pictorial representations, using the data extraction template associated with the matched one of the pictorial representations in the pictorial representation database for identifying and extracting data from the source document data.

A system for data identification and extraction using pictorial representations in a source document comprising:

• a template database, the template database including one or more data extraction templates for identifying and extracting data from one or more source documents, each data extraction template being associated with source documents from a specific source document source;
• a pictorial representation database, the pictorial representation database including key data associated with one or more known pictorial representations, the one or more known pictorial representations each being associated with one or more source document sources;
• source document data;
• at least one processor;
• and
• at least one memory coupled to the at least one processor, the at least one memory having stored therein instructions which when executed by any set of the one or more processors, perform a process for data identification and extraction using pictorial representations in a source document, the process for data identification and extraction using pictorial representations in a source document including:
• analyzing the source document data to identify potential pictorial representation data;
• analyzing the potential pictorial representation data and generating key data associated with the potential pictorial representation data;
• comparing the key data associated with the potential pictorial representation data with the key data associated with one or more known pictorial representations in the pictorial representation database;
• and
• if the key data associated with the potential pictorial representation data matches the key data associated with a matched one of the known pictorial representations in the pictorial representation database, using the data extraction template associated with the matched one of the known pictorial representations in the pictorial representation database for identifying and extracting data from the source document data.

A computing system implemented method for identifying potential pictorial representation data in a source document comprising the following, which when executed individually or collectively by any set of one or more processors perform a process including:

• processing source document data using an Optical Character Recognition (OCR) system and identifying all regions containing textual data;
• for all regions not determined by the OCR system to contain textual data, determining the luminosity of each pixel in the non-textual regions of source document data by applying weights to Red (R), Green (G), and Blue (B) channels to transform the pixel into a greyscale pixel and designating the greyscale strength the luminosity of the pixel;
• defining a threshold change in luminosity value such that a change in luminosity value greater than the threshold change in luminosity is identified as the start or end of an non-textual region of source document including a pictorial representation;
• detecting a first change in luminosity value greater than the threshold change in luminosity and designating the area of the first change in luminosity value as the start of a non-textual region of source document including a pictorial representation;
• looping over the non-textual region of source document until a second change in luminosity value greater than the threshold change is detected;
• designating the area of the second change in luminosity value as the end of the non-textual region of source document including a pictorial representation;
• and
• designating the non-textual region of source document including a pictorial representation as potential pictorial representation data.

A system for identifying potential pictorial representation data in a source document comprising:

• at least one processor;
• and
• at least one memory coupled to the at least one processor, the at least one memory having stored therein instructions which when executed by any set of the one or more processors, perform a process for data identification and extraction using pictorial representations in a source document, the process for data identification and extraction using pictorial representations in a source document including:
• processing source document data using an Optical Character Recognition (OCR) system and identifying all regions containing textual data;
• for all regions not determined by the OCR system to contain textual data, determining the luminosity of each pixel in the non-textual regions of source document data by applying weights to Red (R), Green (G), and Blue (B) channels to transform the pixel into a greyscale pixel and designating the greyscale strength the luminosity of the pixel;
• defining a threshold change in luminosity value such that a change in luminosity value greater than the threshold change in luminosity is identified as the start or end of an non-textual region of source document including a pictorial representation;
• detecting a first change in luminosity value greater than the threshold change in luminosity and designating the area of the first change in luminosity value as the start of a non-textual region of source document including a pictorial representation;
• looping over the non-textual region of source document until a second change in luminosity value greater than the threshold change is detected;
• designating the area of the second change in luminosity value as the end of the non-textual region of source document including a pictorial representation;
• and
• designating the non-textual region of source document including a pictorial representation as potential pictorial representation data.