US 2014/0207440 A1 · LANGUAGE RECOGNITION BASED ON VOCABULARY LISTS

Abstract

A method is implemented at a computer to determine that certain information content is composed or compiled in a specific language selected among two or more similar languages. The computer integrates a first vocabulary list of a first language and a second vocabulary list of a second language into a comprehensive vocabulary list. The integrating includes analyzing the first vocabulary list in view of the second vocabulary list to identify a first vocabulary sub-list that is used in the first language, but not in the second language. The computer then identifies, in the information content, a plurality of expressions that are included in the comprehensive vocabulary list, and a subset of expressions that are included in the first vocabulary sub-list. Upon a determination that a total frequency of occurrence of the subset of expressions meets predetermined occurrence criteria, the computer determines that the information content is composed in the first language.

Claims20

Dependent claims

A computer-implemented method of recognizing a first language used in information content, comprising:

at a computer having one or more processors and memory for storing programs to be executed by the one or more processors:
integrating a first vocabulary list and a second vocabulary list that are built based on a first language and a second language, respectively, into a comprehensive vocabulary list, wherein the integrating includes analyzing the first vocabulary list in view of the second vocabulary list to at least identify a first vocabulary sub-list, in the comprehensive vocabulary list, that is used in the first language, but not in the second language;
identifying, within the information content, a plurality of expressions that are included in the comprehensive vocabulary list;
identifying, within the plurality of expressions, a subset of expressions that are included in the first vocabulary sub-list;
determining that a total frequency of occurrence of the subset of expressions within the information content meets predetermined occurrence criteria;
and
in accordance with the determination, determining that the information content is composed in the first language.

4 more elements

A computer system, comprising:

one or more processors;
and
memory having instructions stored thereon, which when executed by the one or more processors cause the processors to perform operations, the operations including:
integrating a first vocabulary list and a second vocabulary list that are built based on a first language and a second language, respectively, into a comprehensive vocabulary list, wherein the integrating includes analyzing the first vocabulary list in view of the second vocabulary list to at least identify a first vocabulary sub-list, in the comprehensive vocabulary list, that is used in the first language, but not in the second language;
identifying, within the information content, a plurality of expressions that are included in the comprehensive vocabulary list;
identifying, within the plurality of expressions, a subset of expressions that are included in the first vocabulary sub-list;
determining that a total frequency of occurrence of the subset of expressions within the information content meets predetermined occurrence criteria;
and
in accordance with the determination, determining that the information content is composed in the first language.

6 more elements

Dependencies are inferred from the claim text.

Language recognition based on vocabulary lists

Life of this patent

Language recognition based on vocabulary lists

Life of this patent

Abstract

Claims20