Adaptive pattern learning for bilingual data mining

A method, comprising:

• processing a bilingual web page into a Document Object Model (DOM) tree that includes at least one node;
• linking bilingual snippet pairs of the at least one node into a plurality of translation snippet pairs using an alignment model, the alignment model including a bilingual dictionary or a transliteration model;
• determining one or more best fit candidate patterns based on the plurality of translation snippet pairs via a Support Vector Machine (SVM) classifier;
• mining one or more translation pairs from the bilingual web page using the one or more best fit candidate patterns;
• and
• storing the one or more translation pairs into the alignment model, wherein the one or more translation pairs including at least one of a term pair, a phrase pair, or a sentence pair.

A computer readable storage device storing computer-executable instructions that, when executed, cause one or more processors to perform acts comprising:

• processing a bilingual web page into a Document Object Model (DOM) tree that includes and at least one attribute node and at least one content node that is a child of the at least one attribute node;
• removing the at least one attribute node from the DOM tree and linking the at least one content node to a root node of the DOM tree;
• linking bilingual snippet pairs of the at least one content node into a plurality of translation snippet pairs using an alignment model;
• determining one or more best fit candidate patterns based on the plurality of translation snippet pairs via a Support Vector Machine (SVM) classifier;
• mining one or more translation pairs from the bilingual web page using the one or more best fit candidate patterns;
• storing the one or more translation pairs into the alignment model, wherein the one or more translation pairs including at least one of a term pair, a phrase pair, or a sentence pair;
• and
• re-linking the bilingual snippet pairs of the at least one node into the plurality of translation snippet pairs using the alignment model that includes the one or more mined translation pairs.