# US 2012/0254726 A1 · System and Method for Automatically Detecting and Extracting Semantically Significant Text From a HTML Document Associated with a Plurality of HTML Documents

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2012/0254726 A1
- Document ID: US20120254726A1
- Status: Published application
- Kind: A1
- Application number: 13/242,337
- Filed: 2011-09-23
- Published: 2012-10-04
- Earliest claimed: 2007-04-12
- Assignees: The New York Times Company
- Inventors: Evan Stapleton Sandhaus
- Web page: https://patentgrep.com/patent/US20120254726A1

## CPC

- G06F 16/81: Indexing, e.g. XML tags; Data structures therefor; Storage structures
- Y10S 707/99945: Object-oriented database structure processing
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- Y10S: TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS

## Abstract

A system and method for automatically detecting and extracting semantically significant text from a HTML document associated with a plurality of HTML documents is disclosed. The method may include receiving a HTML document, parsing the HTML document into a parse tree, segmenting the parse tree into one or more segments of one or more unique paths, processing the one or more segments based at least the HTML document, and extracting one or more processed segments from the at least the HTML document based on a predetermined number.

## Claims

### Claim 1

A computer-implemented method for automatically detecting and extracting semantically significant text from a hypertext markup language (HTML) document comprising:
receiving a HTML document;
parsing the HTML document into a parse tree;
segmenting the parse tree into one or more segments of one or more unique paths;
processing the one or more segments based on at least the HTML document; and
extracting one or more processed segments from at least the HTML document based on a predetermined number.

### Claim 2 (depends on 1)

The method according to claim 1, wherein the HTML document comprises a web page.

### Claim 3 (depends on 1)

The method according to claim 1, wherein the parsing the HTML document into the parse tree comprises parsing source text associated with the HTML document.

### Claim 4 (depends on 3)

The method according to claim 3, wherein source text comprises HTML tags.

### Claim 5 (depends on 1)

The method according to claim 1, wherein the parse tree comprises one or more root nodes, one or more branch nodes, and one or more leaf nodes.

### Claim 6 (depends on 1)

The method according to claim 1, wherein the parsing the HTML document into the parse tree further comprises removing one or more HTML tags.

### Claim 7 (depends on 6)

The method according to claim 6, wherein removed HTML tags comprise one of a division HTML tag or a table HTML tag.

### Claim 8 (depends on 5)

The method according to claim 5, wherein one or more segments of one or more unique paths further comprises unique paths from a root node to a text node of the parse tree.

### Claim 9 (depends on 1)

The method according to claim 1, wherein the extracting one or more processed segments comprises extracting template text.

### Claim 10 (depends on 9)

The method according to claim 9, wherein template text comprises one or more headers, one or more footers, one or more navigations, or one or more advertisements.

### Claim 11 (depends on 1)

The method according to claim 1, wherein the predetermined number comprises a specified minimum frequency occurrence of the respective processed segments.

### Claim 12

A system for automatically detecting and extracting semantically significant text from a hypertext markup language (HTML) document comprising:
a parser module to receive a HTML document and parse the HTML document into a parse tree;
a segmenter module to segment the parse tree into one or more segments of one or more unique paths;
a processor module to process the one or more segments based on at least the HTML document; and
an extractor module to extract one or more processed segments from at least the HTML document based on a predetermined number.

### Claim 13 (depends on 12)

The system according to claim 12, wherein to parse the HTML document into the parse tree, the parse module parses source text associated with the HTML document.

### Claim 14 (depends on 12)

The system according to claim 12, wherein the parse tree comprises one or more root nodes, one or more branch nodes, and one or more leaf nodes.

### Claim 15 (depends on 12)

The system according to claim 12, wherein to parse the HTML document into the parse tree, the parse module removes one or more HTML tags.

### Claim 16 (depends on 15)

The system according to claim 15, wherein the removed HTML tags comprise one of a division HTML tag or a table HTML tag.

### Claim 17 (depends on 12)

The system according to claim 12, wherein one or more segments of one or more unique paths further comprises unique paths from a root node to a text node of the parse tree.

### Claim 18 (depends on 12)

The system according to claim 12, wherein to extract one or more processed segments from the HTML document, the extractor module extracts template text.

### Claim 19 (depends on 12)

The system according to claim 12, wherein the predetermined number comprises a specified minimum frequency occurrence of the respective processed segments.

### Claim 20

A computer-accessible medium encoded with computer program code effective to perform the following:
receive a HTML document and parse the HTML document into a parse tree;
segment the parse tree into one or more segments of one or more unique paths;
process the one or more segments based on at least the HTML document; and
extract one or more processed segments from at least the HTML document based on a predetermined number.
