Back to results
US 7,013,310 B2Granted
Method and apparatus for retrieving and processing data
AssigneeCashEdge, Inc.
InventorsRoy Messing, Jeremy N. Sokolic, Sanjeev Dheer, Venkatachari Dilip
Life of this patent
Estimating the term…
Abstract
Data is captured from a web site or other data source. Data is extracted from the web page using a data harvesting script or other data acquisition routine. The extracted data is then normalized and stored in a database. If data cannot be extracted from the web page, a copy of the captured web page is stored without personal information contained in the web page. The data harvesting script is then edited based on an analysis of the captured web page.
Claims29
A method comprising:
- capturing a web page from a web site;
- comprising:
- extracting data from the web page using a data harvesting script;
- normalizing the extracted data with data extracted from other web pages;
- generating a context-specific error code if the data harvesting script fails to successfully extract data from the web page;
- adapting the data harvesting script based on identified changes to the web page;
- and
- storing the normalized data in a database.
5 more elements
A method comprising:
- retrieving financial data associated with a user's financial account from a data source;
- identifying data of interest retrieved from the data source;
- generating a context-sensitive error code if the data of interest is not successflly retrieved from the data source, wherein the context-sensitive error code is used to modify the manner in which data is retrieved from the data source;
- normalizing the identified data;
- and
- storing the normalized data in a database.
3 more elements
A method comprising:
- capturing a web page from a web site;
- attempting to extract data from the web page using a data harvesting script;
- if data cannot be extracted from the web page;
- removing pre-determined personal information from the captured web page;
- storing the captured web page without the personal information;
- analyzing the web page and the data harvesting script to determine why data could not be extracted from the web page;
- and
- adapting the data harvesting script based on the determination why data could not be extracted from the web page.
5 more elements
A method comprising:
- capturing a first web page from a first financial institution web site;
- capturing a second web page from a second financial institution web site;
- extracting data from the first web page using a first data harvesting script;
- extracting data from the second web page using a second data harvesting script;
- normalizing the data extracted from the first web page and the second web page;
- generating a context-specific error code if the first data harvesting script fails to successfully extract data from the first web page;
- and
- storing the normalized data in a database.
5 more elements
An apparatus comprising:
- a data capture module configured to capture a first web page from a first web site associated with a first financial institution and further configured to capture a second web page from a second web site associated with a second financial institution;
- a personal information filter module coupled to the data capture module configured to remove personal information from one or more web pages, wherein the personal information filter module generates a specific error code if the personal information filter module is not able to identify personal information on a particular web page;
- a data extraction module coupled to the data capture module and configured to extract data from the first and second web pages using a data harvesting script, the data extraction module further configured to normalize the data extracted from the first and second web pages, and wherein the data extraction module is adaptable based on changes to web pages that occur over time;
- and
- a database control module coupled to the data extraction module and configured to store the normalized data in a common database.
2 more elements
One or more computer readable media having stored thereon a plurality of instructions that, when executed by one or more processors, cause the one or more processors to:
- capture a web page from a financial institution web site;
- attempt to extract data from the captured web page using a data harvesting script;
- remove personal information from the captured web page;
- store the captured web page without the personal information;
- and
- if data cannot be extracted from the web page, generate a context-specific error code and analyze the web page to determine why data could not be extracted from the web page.
3 more elements
Dependencies are inferred from the claim text.