US 2015/0310562 A1 · AUTOMATED FINANCIAL DATA AGGREGATION

Abstract

Methods, systems, and apparatus, including computer programs encoded on computer storage media, for data aggregation. The methods, systems, and apparatus include determining whether a site-specific script for extracting financial data from a particular financial institution website is available; in response to determining that a site-specific script for extracting financial data from the particular financial institution website is not available, generating a site map of web pages and web page segments in the financial institution website, wherein the site map is generated based on at least in part on a statistical analysis of web pages and web page segments that are not in the financial institution website; generating, based on the site map of the financial institution website, a site-specific script for extracting financial data from the financial institution website; and extracting, for one or more users, financial data from the particular financial institution website using the generated site-specific script.

Claims43

Dependent claims

1-24. (canceled)

A computer-implemented method, comprising:

analyzing, in a computer, data for each webpage of a plurality of webpages that are not in a financial institution website;
generating, in the computer, a site map of a financial institution website based on the analyzed data, wherein generating the site map includes (i) crawling the financial institution website to identify one or more web pages in the financial institution website and (ii) determining respective categorizations for the one or more identified web pages based on (a) document structure of each webpage of the one or more identified web pages and (b) the analyzed data;
generating, automatically and in the computer, a site-specific script for extracting financial data from the financial institution website based on the site map of the financial institution website;
and
extracting, in the computer, for one or more users, financial data from the financial institution website using the generated site-specific script.

2 more elements

A computer-implemented method, comprising:

analyzing, in a computer, data for each web page portion in each webpage of a plurality of webpages that are not in a financial institution website;
generating, in the computer, a site map of a financial institution website based on the analyzed data, wherein generating the site map includes (i) crawling the financial institution website to identify one or more web page portions in one or more web pages in the financial institution website and (ii) determining respective categorizations for the one or more identified web page portions based on (a) document structure of each web page portion of the one or more identified web page portions and (b) the analyzed data;
generating, automatically and in the computer, a site-specific script for extracting financial data from the financial institution website based on the site map of the financial institution website;
and
extracting, in the computer, for one or more users, financial data from the financial institution website using the generated site-specific script.

2 more elements

A computer storage medium encoded with a computer program, the program comprising instructions that when executed by data processing apparatus cause the data processing apparatus to perform operations comprising:

analyzing, in a computer, data for each webpage of a plurality of webpages that are not in a financial institution website;
generating, in the computer, a site map of a financial institution website based on the analyzed data, wherein generating the site map includes (i) crawling the financial institution website to identify one or more web pages in the financial institution website and (ii) determining respective categorizations for the one or more identified web pages based on (a) document structure of each webpage of the one or more identified web pages and (b) the analyzed data;
generating, automatically and in the computer, a site-specific script for extracting financial data from the financial institution website based on the site map of the financial institution website;
and
extracting, in the computer, for one or more users, financial data from the financial institution website using the generated site-specific script.

2 more elements

analyzing, in a computer, data for each web page portion in each webpage of a plurality of webpages that are not in a financial institution website;
generating, in the computer, a site map of a financial institution website based on the analyzed data, wherein generating the site map includes (i) crawling the financial institution website to identify one or more web page portions in one or more web pages in the financial institution website and (ii) determining respective categorizations for the one or more identified web page portions based on (a) document structure of each web page portion of the one or more identified web page portions and (b) the analyzed data;
generating, automatically and in the computer, a site-specific script for extracting financial data from the financial institution website based on the site map of the financial institution website;
and
extracting, in the computer, for one or more users, financial data from the financial institution website using the generated site-specific script.

2 more elements

A system comprising one or more computers programmed to perform operations comprising:

analyzing, in a computer, data for each webpage of a plurality of webpages that are not in a financial institution website;
generating, in the computer, a site map of a financial institution website based on the analyzed data, wherein generating the site map includes (i) crawling the financial institution website to identify one or more web pages in the financial institution website and (ii) determining respective categorizations for the one or more identified web pages based on (a) document structure of each webpage of the one or more identified web pages and (b) the analyzed data;
generating, automatically and in the computer, a site-specific script for extracting financial data from the financial institution website based on the site map of the financial institution website;
and
extracting, in the computer, for one or more users, financial data from the financial institution website using the generated site-specific script.

2 more elements

A system comprising one or more computers programmed to perform operations comprising:

analyzing, in a computer, data for each web page portion in each webpage of a plurality of webpages that are not in a financial institution website;
generating, in the computer, a site map of a financial institution website based on the analyzed data, wherein generating the site map includes (i) crawling the financial institution website to identify one or more web page portions in one or more web pages in the financial institution website and (ii) determining respective categorizations for the one or more identified web page portions based on (a) document structure of each web page portion of the one or more identified web page portions and (b) the analyzed data;
generating, automatically and in the computer, a site-specific script for extracting financial data from the financial institution website based on the site map of the financial institution website;
and
extracting, in the computer, for one or more users, financial data from the financial institution website using the generated site-specific script.

2 more elements

Dependencies are inferred from the claim text.

Automated financial data aggregation

Life of this patent

Automated financial data aggregation

Life of this patent

Abstract

Claims43