Automated extraction of data from web pages
AssigneeCapital One Services, LLC
InventorsSamuel Alison, Ryan Engle, Jacob Riesterer, Jonathan Coon
Life of this patent
Estimating the term…
Abstract
Various embodiments provide techniques for automatically extracting data from web pages. Such extraction can take place without the use of a browser, and without necessarily rendering the entire web page. Thus, data extraction can be performed more efficiently and more quickly, while reducing the computing resources needed to perform such operations. In at least one embodiment, data extraction and translation are performed by automatically parsing structured data from visible and hidden elements of a web page.
Claims21
1-48. (canceled)
A computer-implemented method for extracting data from a web page, comprising:
- requesting and retrieving, by transmitting requests and receiving replies, respectively, at least one web page from a web server;
- extracting structured data from the at least one web page;
- based on the extracted structured data, determining one or more requests, of the requests, contain parameters for displaying information;
- based on the determination, performing at least one of an extraction operation or a transform operation to obtain the information;
- and
- generating and transmitting at least one request based on the determined one or more requests to obtain other information.
A non-transitory computer-readable medium for extracting data from a web page, comprising instructions stored thereon, that when executed by a processor on a client device, perform the steps of:
- requesting and retrieving, by transmitting requests and receiving replies, respectively, at least one web page from a web server;
- extracting structured data from the at least one web page;
- based on the extracted structured data, determining one or more requests, of the requests, contain parameters for displaying information;
- based on the determination, performing at least one of an extraction operation or a transform operation to obtain the information;
- and
- generating and transmitting at least one request to obtain other information based on the determined one or more requests.
A system for extracting data from a web page, comprising:
- a processor, on a client device, configured to perform a process including:
- requesting and retrieving, by transmitting requests and receiving replies, respectively, at least one web page from a web server;
- extracting structured data from the at least one web page;
- based on the extracted structured data, determining one or more requests, of the requests, contain parameters for displaying information;
- based on the determination, performing at least one of an extraction operation or a transform operation to obtain the information;
- and
- generating and transmitting at least one request to obtain other information based on the determined one or more requests.
Dependencies are inferred from the claim text.