Keyword index pruning
AssigneeCertona Corporation
InventorsGeoffrey J. Hueter, Benjamin S. Farber
Life of this patent
Estimating the term…
Abstract
A system and method is disclosed for profiling a subject's search engine keywords and results based on relevancy feedback. Because the system is based on the search behavior of the user, the profiling is language independent and balances the specificity of search terms against the profiled interests of the user. The system can also score keywords on their search effectiveness and eliminate ineffective keywords from the keyword index. The system can also synthesize new keyword combinations to assist the user in refining the search or acquiring related content. The system has application in text mining, personalization, behavioral search, search engine optimization, and content acquisition, to name but a few applications.
Claims18
A computer implemented web-based system for personalized search using keyword index pruning, comprising:
- a computer implemented web-based service system, including a memory component and a processor component, for searching, collecting relevancy feedback, and acquiring content by keywords;
- wherein profiles of subjects, including search users, are stored in a subject profile database and profiles of objects, including keyword and target content items, are stored in an object catalog databases;
- said subject and keyword profiles are matched against target profiles and ranked to be optimal to keywords;
- wherein optimal subject and object profiles are derived from said subject's relevancy ratings of search result objects against inputted keywords;
- and
- further wherein said web-based service system processes, identifies and eliminates ineffective keywords by performing a token score check by operation of a behavioral engine wherein the input to the token score check is a set of behavioral scores corresponding to target objects and the behavioral scores are quantized into a discrete set of score bins xi, where xi denotes a contiguous set of behavioral scores, and further wherein the effectiveness of the keyword is measured by the entropy H of the distribution of behavioral scores;
- whereby said entropy is defined as
- H
- =
- -
- ∑
- i
- =
- 1
- n
-
- p
-
- (
- x
- i
- )
-
- log
-
-
- p
-
- (
- x
- i
- )
- where p(xi) denotes the probability that the behavioral score of a particular target object is in the set xi.
Dependencies are inferred from the claim text.