Method and system for hybrid text classification
AssigneeKibboko, Inc.
InventorsJiang Su, Keith Bates, Biao Wang, Bo Xu
Life of this patent
Estimating the term…
Abstract
A computer-implemented system and method for text classification is provided that applies a hybrid approach for text classification. The system and method includes a text pre-processor which prepares unclassified articles in a format which can be read by a two-stage classifier. The classifier employs a hybrid approach. A keyword-based model achieves machine-labelling of the articles. The machine-labelled articles are used to train a machine learning model. New articles can be applied against the trained model, and classified.
Claims22
A computer implemented method of text classification comprising the steps of:
- a. receiving a set of unlabelled and a set of initially labelled documents;
- b. applying a keyword model to machine label the set of unlabelled documents, to produce a set of labelled (keyword) documents;
- c. training a machine learning model using the set of labelled (keyword) documents and the set of initially labelled documents;
- d. labelling a selected document using the machine learning model to produce an associated label;
- and
- e. storing the selected document and the associated label.
A computer implemented method of text classification comprising the steps of:
- a. receiving a set of unlabelled and a set of initially labelled documents;
- b. applying a keyword model to machine label the set of unlabelled documents, to produce a set of labelled (keyword) documents;
- c. scoring the set of labelled (keyword) documents;
- d. if the score is less than a pre-defined threshold, then:
- i. training a machine learning model using the set of labelled (keyword) documents and the set of initially labelled documents;
- ii. labelling a selected document using the machine learning model to produce an associated label;
- and
- iii. storing the selected document and the associated label.
A computer implemented method of text classification comprising the steps of:
- a. applying a keyword model to create a label for each document in a set of documents;
- and
- b. applying a machine learning model to refine the label.
An apparatus for text classification comprising:
- a. means for storing a set of unlabelled articles;
- b. means for pre-processing each article;
- c. means for applying a keyword model to machine label each article according to a keyword;
- d. means for scoring the accuracy of the machine label;
- and
- e. means for applying a machine learning model to refine the machine label for each article.
A memory for storing data for access by an application program being executed on a data processing system, comprising:
- a database stored in said memory, said data structure including information resident in a database used by said application program and including:
- a table stored in said memory serializing a set of documents and associated labels such that each label may be updated by applying a keyword model to create an initial machine label each document and a machine learning model to refine the initial machine label.
Dependencies are inferred from the claim text.