Back to results
US 2024/0403561 A1Published application
Deep concept search systems and methods
OwnerGeorge Cernile, James Shu Hen Cheninventors
Life of this patent
Estimating the term…
Abstract
A tokenization operation is performed on a document to divide the document into word tokens and to assign a heuristic segmentation index to the word tokens forming a tokenized text. An input text is received. The tokenized text or the input text is searched to find search parameters. When the search parameters are matched, a partial concept record is either created or updated. Input and searching continues until all search parameters are found, so that output can generated indicating that a concept match has occurred.
Claims20
A method performed by one or more processors of a system, the method comprising:
- receiving a document in memory;
- performing a tokenization operation on the document to divide the document into a plurality of word tokens, to assign at least one heuristic segmentation index to each of the plurality of word tokens, and to form a tokenized text;
- receiving, through input into the system, an input text having an expression with at least one search parameter therein with the at least one search parameter being one of a plurality of partial concept search parameters;
- searching at least one of the tokenized text and the input text for a parameter match when the at least one search parameter is located in the input text;
- identifying at least one of the plurality of word tokens and the assigned at least one heuristic segmentation index that corresponds to the parameter match;
- searching, on a partial concept list, for a partial concept record for the expression;
- creating a partial concept record on the partial concept list for the parameter match, the at least one of the plurality of word tokens, and the associated at least one heuristic segmentation index when there is no existing partial concept for the expression;
- updating the partial concept record on the partial concept list for the parameter match, the at least one of the plurality of word tokens, and the associated at least one heuristic segmentation index when an existing partial concept record is found;
- and
- generating output indicating that a concept match has occurred when the partial concept list has a partial concept record for each of the plurality of partial concept search parameters;
- whereby the concept match corresponds to a completed concept.
8 more elements
A system, comprising:
- one or more processors;
- and
- at least one memory coupled to the one or more processors and storing instructions that, when executed by the one or more processors, cause the system to perform operations comprising:
- receiving a document in memory;
- performing a tokenization operation on the document to divide the document into a plurality of word tokens, to assign at least one heuristic segmentation index to each of the plurality of word tokens, and to form a tokenized text;
- receiving, through input into the system, an input text having an expression with at least one search parameter therein with the at least one search parameter being one of a plurality of partial concept search parameters;
- searching at least one of the tokenized text and the input text for a parameter match when the at least one search parameter is located in the input text;
- identifying at least one of the plurality of word tokens and the assigned at least one heuristic segmentation index that corresponds to the parameter match;
- searching, on a partial concept list, for a partial concept record for the expression;
- creating a partial concept record on the partial concept list for the parameter match, the at least one of the plurality of word tokens, and the associated at least one heuristic segmentation index when there is no existing partial concept for the expression;
- updating the partial concept record on the partial concept list for the parameter match, the at least one of the plurality of word tokens, and the associated at least one heuristic segmentation index when an existing partial concept record is found;
- and
- generating output indicating that a concept match has occurred when the partial concept list has a partial concept record for each of the plurality of partial concept search parameters;
- whereby the concept match corresponds to a completed concept.
11 more elements
Dependencies are inferred from the claim text.