# US 2021/0279238 A1 · Two Step Algorithm for Non-exact Matching of Large Datasets

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0279238 A1
- Document ID: US20210279238A1
- Status: Published application
- Kind: A1
- Application number: 17/325,911
- Filed: 2021-05-20
- Published: 2021-09-09
- Earliest claimed: 2019-06-28
- Assignees: Bottomline Technologies, Inc.
- Applicants: Bottomline Technologies, Inc.
- Inventors: Mark G. Kane; Richard J. Diekema, JR.; Kaiyu Pan
- Web page: https://patentgrep.com/patent/US20210279238A1

## CPC

- G06F 16/2468: {Fuzzy queries}
- G06F 16/90348: {by searching ordered data, e.g. alpha-numerically ordered data}
- G06F 17/18: for evaluating statistical data {, e.g. average values, frequency distributions, probability functions, regression analysis (forecasting specially adapted for a specific administrative, business or logistic context G06Q10/04)}
- G06F 18/22: Matching criteria, e.g. proximity measures
- G06F 40/109: Font handling; Temporal or kinetic typography
- G06F 40/166: Editing, e.g. inserting or deleting
- G06F 40/268: Morphological analysis
- G06F 40/279: Recognition of textual entities
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

A two-step algorithm for conducting near real-time fuzzy searches of a target on one or more large data sets is described. This algorithm includes the simplification of the data by removing grammatical constructs to bring the target search term (and the stored database) to their base elements and then perform a Levenstein comparison to create a subset of the data set that may be a match. Then performing a scoring algorithm while comparing the target to the subset of the data set to identify any matches.

## Claims

### Claim 1

A non-transitory machine-readable media programmed to:
search for a subset of records in a list that most closely matches a target, wherein the search comprises software programmed to:
read a record from the list;
perform a search Levenstein distance calculation on the target and the record; and
store the record in a subset list if the search Levenstein distance calculation is greater than a search threshold;
score the records in the subset list, wherein the score comprises software programmed to:
loop through fields of the records in the subset list;
calculate a score Levenstein distance between the field in the record in the subset list and the field in the target;
check that the score Levenstein distance is greater than a field-level threshold, and to go to a next record in the loop if the score Levenstein distance is greater than the field-level threshold;
sum a product of the score Levenstein distance multiplied by a weight factor for the field; and
divide the product by a sum of the weight factor for the fields to derive a weighted mean score for the record;
indicate that the target is located in the list if at least one weighted mean score is calculated.

### Claim 2 (depends on 1)

The non-transitory machine-readable media of claim 1 further programmed to:
create the list from one or more source lists with software programmed to:
read an entry from the one or more source lists;
simplify the entry in the one or more source lists;
split the entry into the one or more source lists; and
store the entry in the list as a new record.

### Claim 3 (depends on 2)

The non-transitory machine-readable media of claim 2 wherein the software to simplify is programmed to convert all capital letters to lower case.

### Claim 4 (depends on 2)

The non-transitory machine-readable media of claim 2 wherein the software to simplify is programmed to remove repeated letters.

### Claim 5 (depends on 2)

The non-transitory machine-readable media of claim 2 is further programmed to transform one or more portions of the record to enhance the performance of searches using Levenstein distance calculations, during the creating of the list.

### Claim 6 (depends on 1)

The non-transitory machine-readable media of claim 1 is further programmed to simplify the target.

### Claim 7 (depends on 6)

The non-transitory machine-readable media of claim 6 wherein the software to simplify the target is programmed to remove punctuation.

### Claim 8 (depends on 6)

The non-transitory machine-readable media of claim 6 wherein the software to simplify the target is programmed to consolidate all geographic terms into a selected geographic term.

### Claim 9 (depends on 1)

The non-transitory machine-readable media of claim 1 is further programmed to sort the weighted mean score for the records.

### Claim 10 (depends on 1)

The non-transitory machine-readable media of claim 1 wherein the software to score is programmed to select the fields configured to boost the weighted mean score for the record, and to incorporate the field score in the weighted mean score for the field configured to boost if the field score increases the weighted mean score.

### Claim 11

A method comprising:
searching for a subset of records in a list that most closely matches a target, wherein the searching comprises:
performing a search Levenstein distance calculation on the target and a record from the list; and
storing the record in a subset list if the search Levenstein distance calculation is greater than a search threshold;
scoring the records in the subset list, wherein the scoring comprises:
looping through fields of the records in the subset list;
calculating a score Levenstein distance between the field in the record in the subset list and the field in the target;
checking that the score Levenstein distance is greater than a field-level threshold, and going to a next record in the loop if the score Levenstein distance is greater than the field-level threshold;
summing a product of the score Levenstein distance multiplied by a weight factor for the field; and
dividing the product by a sum of the weight factor for the fields to derive a weighted mean score for the record;
indicating that the target is located in the list if at least one weighted mean score is calculated.

### Claim 12 (depends on 11)

The method of claim 11 further comprising:
creating the list from one or more source lists, wherein the creating comprises:
reading an entry from the one or more source lists;
simplifying the entry in the one or more source lists;
splitting the entry into the one or more source lists; and
storing the entry in the list as a new record.

### Claim 13 (depends on 12)

The method of claim 12 wherein the simplifying includes converting all capital letters to lower case.

### Claim 14 (depends on 12)

The method of claim 12 wherein the simplifying includes removing repeated letters.

### Claim 15 (depends on 12)

The method of claim 12 further comprising transforming one or more portions of the record to enhance the performance of searches using Levenstein distance calculations, during the creating of the list.

### Claim 16 (depends on 11)

The method of claim 11 further comprising simplifying the target.

### Claim 17 (depends on 16)

The method of claim 16 wherein the simplifying includes removing punctuation.

### Claim 18 (depends on 16)

The method of claim 16 wherein the simplifying includes consolidating all geographic terms into a selected geographic term.

### Claim 19 (depends on 11)

The method of claim 11 further comprising sorting the weighted mean score for the records.

### Claim 20 (depends on 11)

The method of claim 11 wherein the scoring further comprises selecting fields configured for boosting the weighted mean score for the record, and incorporating the field score in the weighted mean score for the field configured for boosting if the field score increases the weighted mean score.
