Method and system for removing chrome from a web page
AssigneePaypal, Inc.
InventorsJohn Roper, Dane Glasgow
Life of this patent
Estimating the term…
Abstract
A method and system for removing chrome from a web page is provided. An example system includes a parsing module, a text density analyzer, a content node selector 206, and a text extractor. The parsing module may be configured to parse a web page into a tree structure. The text density analyzer may be configured to determine a text density score value for each node from the tree structure. The content node selector may be configured to identify one or more nodes from the tree structure as content nodes based on their respective text density score values. The text extractor may be configured to extract text from the content nodes only.
Claims20
A method comprising:
- accessing a web page, the web page represented by a hierarchical mark-up language;
- parsing the web page into a tree structure based on hierarchy associated with the web page;
- for each node from the tree structure, determine a text density score value;
- identifying one or more nodes from the tree structure as content nodes based on their respective text density score values;
- and
- extracting text from the content nodes associated with the second version of the web page and ignoring nodes that were not identified as content nodes.
A computer system comprising:
- a parsing module to parse a web page into a tree structure based on hierarchy of a hierarchical mark-up language associated with the web page;
- a text density analyzer to determine a text density score value for each node from the tree structure;
- a content node selector to identify one or more nodes from the tree structure as content nodes based on their respective text density score values;
- and
- a text extractor to extract text from the content nodes associated with the second version of the web page and ignoring nodes that were not identified as content nodes.
A machine-readable storage medium having instruction data to cause a machine to:
- parse a web page into a tree structure based on a hierarchy of a mark-up language associated with the web page;
- determine a text density score value for each node from the tree structure;
- identify one or more nodes from the tree structure as content nodes based on their respective text density score values;
- and
- extract text from the content nodes associated with the second version of the web page and ignoring nodes that were not identified as content nodes, the extracted text associated with the web page.
Dependencies are inferred from the claim text.