# US 2014/0156799 A1 · Method and System for Extracting Post Contents From Forum Web Page > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2014/0156799 A1 - Document ID: US20140156799A1 - Status: Published application - Kind: A1 - Application number: 14/093,157 - Filed: 2013-11-29 - Published: 2014-06-05 - Earliest claimed: 2012-12-03 - Assignees: Peking University Founder Group Co., Ltd.; Beijing Founder Electronics Co., Ltd.; Peking University - Applicants: Peking University Founder Group Co., Ltd.; Beijing Founder Electronics Co., Ltd.; Peking University - Inventors: Tao Zhang; Jianwu Yang; Xiaoming Yu - Web page: https://patentgrep.com/patent/US20140156799A1 ## CPC - H04L 67/02: based on web technology, e.g. hypertext transfer protocol [HTTP] - G06F 40/14: Tree-structured documents (parsing G06F40/205; validation G06F40/226) - H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M) - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) ## Abstract The present application discloses a method and a system for extracting post contents from a forum web page. The method includes: acquiring a forum web page; converting the forum web page into a DOM tree, wherein the DOM tree at least includes a root node and at least one child node attached to the root node; generating frequent patterns for the root node and the at least one child node in a one-to-one correspondence mode; determining a node corresponding to information contents in the forum web page according to a frequent pattern, satisfying a preset condition, in the frequent patterns; and extracting the information contents in the forum web page from the node corresponding to the information contents in the forum web page based on a preset common sub-tree algorithm. ## Claims ### Claim 1 A method for extracting post contents from a forum web page, comprising: acquiring a forum web page; converting the forum web page into a DOM (Document Object Model) tree, wherein the DOM tree at least comprises a root node and at least one child node attached to the root node; generating frequent patterns for the root node and the at least one child node in a one-to-one correspondence mode; determining a node corresponding to information contents in the forum web page according to a frequent pattern, satisfying a preset condition, in the frequent patterns; and extracting the information contents in the forum web page from the node corresponding to the information contents in the forum web page based on a preset common sub-tree algorithm. ### Claim 2 (depends on 1) The method according to claim 1, wherein the frequent pattern satisfying the preset condition is a maximum frequent pattern; and the preset common sub-tree algorithm is a maximum common sub-tree algorithm. ### Claim 3 (depends on 1) The method according to claim 1, wherein the converting the forum web page into the DOM tree comprises: deleting useless web page labels from the forum web page; and converting the forum web page from which the useless web page labels are deleted into the DOM tree. ### Claim 4 (depends on 2) The method according to claim 2, wherein the extracting the information contents in the forum web page from the node corresponding to the information contents in the forum web page based on the preset common sub-tree algorithm comprises: filtering out same parts among posts in the forum web page; and extracting the information contents in the forum web page from the node corresponding to the information contents in the forum web page based on the maximum common sub-tree algorithm. ### Claim 5 (depends on 2) The method according to claim 2, further comprising, before determining the node corresponding to the information contents in the forum web page according to the frequent pattern, satisfying the preset condition, in the frequent patterns: judging whether frequency and support of each frequent pattern in the frequent patterns are greater than or equal to a preset frequency and support; and when the frequency and support of a frequent pattern are smaller than the preset frequency and support, pruning the frequent pattern. ### Claim 6 (depends on 5) The method according to claim 5, wherein the preset frequency and support are a minimum frequency and a minimum support. ### Claim 7 A system for extracting post contents from a forum web page, comprising: an acquiring module, configured to acquire a forum web page; a converting module, configured to convert the forum web page into a DOM (Document Object Model) tree, wherein the DOM tree at least comprises a root node and at least one child node attached to the root node; a generating module, configured to generate frequent patterns for the root node and the at least one child node in a one-to-one correspondence mode; a determining module, configured to determine a node corresponding to information contents in the forum web page according to a frequent pattern, satisfying a preset condition, in the frequent patterns; and an extracting module, configured to extract the information contents in the forum web page from the node corresponding to the information contents in the forum web page based on a preset common sub-tree algorithm. ### Claim 8 (depends on 7) The system according to claim 7, wherein the frequent pattern satisfying the preset condition is a maximum frequent pattern; and the preset common sub-tree algorithm is a maximum common sub-tree algorithm. ### Claim 9 (depends on 7) The system according to claim 7, wherein the converting module comprises: a deleting unit, configured to delete useless web page labels from the forum web page; and a converting unit, configured to convert the forum web page from which the useless web page labels are deleted into the DOM tree. ### Claim 10 (depends on 7) The system according to claim 7, wherein the extracting module comprises: a filtering unit, configured to filter out same parts among posts in the forum web page; and an extracting unit, configured to extract the information contents in the forum web page from the node corresponding to the information contents in the forum web page based on the maximum common sub-tree algorithm. ### Claim 11 (depends on 7) The system according to claim 7, further comprising: a judging module, configured to judge whether frequency and support of each frequent pattern in the frequent patterns are greater than or equal to a preset frequency and support; and a pruning module, configured to, when the frequency and support of a frequent pattern are smaller than the preset frequency and support, prune the frequent pattern. ### Claim 12 (depends on 11) The system according to claim 11, wherein the preset frequency and support are a minimum frequency and a minimum support.