# US 2025/0061100 A1 · Systems and methods for generating and using a universal dataset

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0061100 A1
- Document ID: US20250061100A1
- Status: Published application
- Kind: A1
- Application number: 18/807,531
- Filed: 2024-08-16
- Published: 2025-02-20
- Earliest claimed: 2023-08-18
- Applicants: Jpmorgan Chase Bank, N.A.
- Inventors: Hardik DARJI; Ross DEMARCO; Jiemin YU; Rosa M. RITA; Jeremy R. GELLER; David V. SAPUPPO; Erin E. SCHULER
- Web page: https://patentgrep.com/patent/US20250061100A1

## CPC

- G06F 16/215: Improving data quality; Data cleansing, e.g. de-duplication, removing invalid entries or correcting typographical errors
- G06F 16/2228: {Indexing structures}
- G06F 16/2365: {Ensuring data consistency and integrity}
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

The techniques described herein relate to a method including: executing a self-deduplication process on a first dataset and a second dataset; standardizing the first dataset and the second dataset using a common data model; indexing records from the first dataset and the second dataset in a common index; scoring records in the common index; deduplicating the records in the common index; and storing the records in the common index as a master dataset.

## Claims

### Claim 1

A method executed by a processor of one or more computers, the method comprising:
executing a self-deduplication process on a first dataset and a second dataset;
standardizing the first dataset and the second dataset using a common data model;
indexing records from the first dataset and the second dataset in a common index;
scoring records in the common index;
deduplicating the records in the common index; and
storing the records in the common index as a master dataset.

### Claim 2 (depends on 1)

The method of claim 1, further comprising pairing partial matches from the first dataset and the second dataset.

### Claim 3 (depends on 1)

The method of claim 1, further comprising calculating a frequency for one or more of a phone number, an address, and a company name for each dataset, and retaining matching pairs based on the frequency being less than a threshold.

### Claim 4 (depends on 1)

The method of claim 1, further comprising appending each potential matching pair to the master dataset based on a frequency less than a threshold of a type of information.

### Claim 5 (depends on 1)

The method of claim 1, wherein scoring records comprises generating a score with a point value for a matched pair from each dataset, and retaining matching pairs based on the point value at least meeting a threshold amount.

### Claim 6 (depends on 1)

The method of claim 1, further comprising generating a final score table with the indexed records and the scores, wherein deduplicating comprises sorting the final score table in ascending order a generated first unique identification of the common index, sorting in descending order a generated second unique identification of the common index, sorting a score in a descending order, and retaining only a first row of the table per first unique identification.

### Claim 7 (depends on 6)

The method of claim 6, wherein deduplicating further comprises sorting the final score table in ascending order a generated first unique identification of the common index, sorting in ascending order a generated second unique identification of the common index, sorting a score in a descending order, and retaining only final scores for the generated second unique identification.

### Claim 8

A system comprising one or more processors and one or more storage devices storing instructions that when executed by one or more processors, cause the processor to:
execute a self-deduplication process on a first dataset and a second dataset;
standardize the first dataset and the second dataset using a common data model;
index records from the first dataset and the second dataset in a common index;
score records in the common index;
deduplicate the records in the common index; and
store the records in the common index as a master dataset.

### Claim 9 (depends on 8)

The system of claim 8, further comprising pairing partial matches from the first dataset and the second dataset.

### Claim 10 (depends on 8)

The system of claim 8, further comprising calculating a frequency for one or more of a phone number, an address, and a company name for each dataset, and retaining matching pairs based on the frequency being less than a threshold.

### Claim 11 (depends on 8)

The system of claim 8, further comprising appending each potential matching pair to the master dataset based on a frequency less than a threshold of a type of information.

### Claim 12 (depends on 8)

The system of claim 8, wherein scoring records comprises generating a score with a point value for a matched pair from each dataset, and retaining matching pairs based on the point value at least meeting a threshold amount.

### Claim 13 (depends on 8)

The system of claim 8, further comprising generating a final score table with the indexed records and the scores, wherein matching comprises sorting the final score table in ascending order a generated first unique identification of the common index, sorting in descending order a generated second unique identification of the common index, sorting a score in a descending order, and retaining only a first row of the table per first unique identification.

### Claim 14 (depends on 13)

The system of claim 13, wherein matching further comprises sorting the final score table in ascending order the generated second unique identification of the common index, sorting in ascending order the generated first unique identification of the common index, sorting a score in a descending order, and retaining only final scores for the generated second unique identification.

### Claim 15

A method executed by a processor of one or more computers, the method comprising:
matching a first dataset from an internal dataset from a memory on a computer network with a second dataset from an external dataset and forming a larger dataset from the first dataset and the second dataset;
deduplicating the larger dataset;
identifying a subset from the larger dataset using a parameter;
determining associated features of the subset;
prioritizing the associated features based on a detail of the first or second datasets;
identifying known features in a local database based on the prioritized associated features and estimating a strength of connection of the known features and the prioritized associated features;
selecting an internal database based on the known features, the associated features, and a score of the associated and known features as a match with the internal database; and
generating an interface comprising a message based on the known features, the internal database, and the associated features.

### Claim 16 (depends on 15)

The method of claim 15, further comprising pairing partial matches from the first dataset and the second dataset.

### Claim 17 (depends on 15)

The method of claim 15, further comprising calculating a frequency for one or more of a phone number, an address, and a company name for each dataset, and retaining matching pairs based on the frequency being less than a threshold.

### Claim 18 (depends on 15)

The method of claim 15, further comprising generating a master dataset from the deduplication and appending each potential matching pair to the master dataset based on a frequency less than a threshold of a type of information.

### Claim 19 (depends on 15)

The method of claim 15, wherein scoring records comprises generating a score with a point value for a matched pair from each dataset, and retaining matching pairs based on the point value at least meeting a threshold amount.

### Claim 20 (depends on 15)

The method of claim 15, further comprising index records from the first dataset and the second dataset in a common index; generating a master dataset from the common index; generating a final score table with the indexed records and the scores, wherein matching comprises sorting the final score table in ascending order a generated first unique identification of the common index, sorting in descending order a generated second unique identification of the common index, sorting a score in a descending order, and retaining only a first row of the table per first unique identification.
