Back to results
US 12,591,601 B2Granted
System and method for hybrid multilingual search indexing
AssigneeOpen Text Corporation
InventorGeoffrey Michael Obbard
Life of this patent
Estimating the term…
Abstract
System and method for the indexing and searching of multilingual documents are disclosed.
Claims21
A system, comprising:
- a processor;
- and
- a computer readable medium storing instructions translatable by the processor to implement a multilingual search engine, comprising instructions for:
- receiving a multilingual object, the multilingual object comprising a search query;
- determining a set of fragments of the text of the multilingual object, where each of the set of fragments comprises a portion of the text of the multilingual object determined based on a multilingual sentence boundary detection model;
- determining a language associated with each fragment of the determined set of fragments of the multilingual object;
- determining a set of tokens for each fragment of the determined set of fragments, where determining the set of tokens for a fragment comprises analyzing the portion of the text of that fragment based on the language associated with that fragment;
- indexing the set of tokens determined for each fragment in an index in association with the multilingual object, such that the index is a multilingual index including tokens from the multilingual object in multiple languages determined according to the language associated with each fragment;
- and
- performing a search of a search index using the determined set of tokens.
7 more elements
A method, comprising:
- receiving a multilingual object, the multilingual object comprising a search query;
- determining a set of fragments of the text of the multilingual object, where each of the set of fragments comprises a portion of the text of the multilingual object determined based on a multilingual sentence boundary detection model;
- determining a language associated with each fragment of the determined set of fragments of the multilingual object;
- determining a set of tokens for each fragment of the determined set of fragments, where determining the set of tokens for a fragment comprises analyzing the portion of the text of that fragment based on the language associated with that fragment;
- indexing the set of tokens determined for each fragment in an index in association with the multilingual object such that the index is a multilingual index including tokens from the multilingual object in multiple languages determined according to the language associated with each fragment;
- and
- performing a search of a search index using the determined set of tokens.
4 more elements
A non-transitory computer readable medium, comprising instructions for:
- receiving a multilingual object, the multilingual object comprising a search query;
- determining a set of fragments of the text of the multilingual object, where each of the set of fragments comprises a portion of the text of the multilingual object determined based on a multilingual sentence boundary detection model;
- determining a language associated with each fragment of the determined set of fragments of the multilingual object;
- determining a set of tokens for each fragment of the determined set of fragments, where determining the set of tokens for a fragment comprises analyzing the portion of the text of that fragment based on the language associated with that fragment;
- indexing the set of tokens determined for each fragment in an index in association with the multilingual object such that the index is a multilingual index including tokens from the multilingual object in multiple languages determined according to the language associated with each fragment;
- and
- performing a search of a search index using the determined set of tokens.
4 more elements
Dependencies are inferred from the claim text.