# US 2017/0255710 A1 · Grouping records in buckets distributed across nodes of a distributed database system to perform comparison of the grouped records

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2017/0255710 A1
- Document ID: US20170255710A1
- Status: Published application
- Kind: A1
- Application number: 15/599,406
- Filed: 2017-05-18
- Published: 2017-09-07
- Earliest claimed: 2014-05-06
- Assignees: International Business Machines Corporation
- Applicants: International Business Machines Corporation
- Inventors: Allan L. Luo; Craig W. Muchinsky; Edward B. Thorne
- Web page: https://patentgrep.com/patent/US20170255710A1

## CPC

- G06F 16/90344: {by using string matching techniques}
- G06F 16/122: {using management policies (point-in-time backing up or restoration of persistent data G06F11/1446; file migration policies for HSM systems G06F16/185)}
- G06F 16/24565: {Triggers; Constraints}
- G06F 16/24578: {using ranking}
- G06F 16/27: Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
- G06F 16/285: {Clustering or classification}
- G06F 16/951: Indexing; Web crawling techniques
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

Provided are a computer program product, system, and method for grouping records in buckets distributed across nodes a distributed database system to perform comparison of the grouped records. Upon receiving a record, data in the received record is processed to determine at least one containing bucket having attributes matching those of the received record, wherein the at least one containing bucket comprises at least one of a plurality of buckets, and wherein the buckets are assigned to the local node and the external nodes. A determination is made of at least one of the containing buckets assigned to at least one of the external nodes. At least a portion data in the received record is forwarded to each of the determined at least one external node to perform comparison matching with other records in the containing bucket at the external node.

## Claims

### Claim 1

A computer program product for determining a relationship of records in a database distributed among nodes in a network, the computer program product comprising a computer readable storage medium having computer readable program code embodied therein that when executed in a local node in communication with remote external nodes performs operations, the operations comprising:
receiving a record in the database at the local node;
processing data in the received record to determine at least one containing bucket in at least one of the local node and the external nodes having attributes matching those of the received record, wherein the at least one containing bucket comprises at least one of a plurality of buckets, and wherein the buckets are assigned to the local node and the external nodes;
forwarding at least a portion of data in the received record to each external node including one of the determined at least one containing bucket to perform comparison matching with other records in the determined at least one containing bucket at the external node; and
processing the received record in the determined at least one containing bucket at the local node in response to the local node including one of the determined at least one containing bucket.

### Claim 2 (depends on 1)

The computer program product of claim 1, wherein the operations further comprise:
processing the received record to generate derived data comprising a compact representation of the data in the received record including content for less than all fields in the received record and including content used for comparing the derived data with derived data for other records assigned to one of the buckets to determine a relationship value for the compared records, wherein the forwarded at least the portion of data in the received record comprises the derived data.

### Claim 3 (depends on 1)

The computer program product of claim 1, wherein the operations further comprise:
for each containing bucket of the determined at least one containing bucket assigned to the local node, executing a comparison algorithm at the local node to compare at least a portion of data in the received record with at least a portion of data for other records in the containing bucket to determine relationship values between the received record and the other records in the containing bucket.

### Claim 4 (depends on 1)

The computer program product of claim 1, wherein the operations further comprise:
generating a bucket list for the received record indicating the determined at least one containing bucket including the received record.

### Claim 5 (depends on 4)

The computer program product of claim 4, wherein the operations further comprise:
forwarding the bucket list to each of the external nodes assigned one of the determined at least one containing bucket.

### Claim at position 6

6-7. (canceled)

### Claim 8 (depends on 1)

The computer program product of claim 1, wherein the operations further comprise:
receiving data for one record from one of the external nodes for one indicated bucket assigned to the local node;
indicating that the record associated with the received data is included in the indicated bucket; and
executing a comparison algorithm at the local node to compare the received data with at least a portion of the data for other records in the indicated bucket to determine a relationship value between the record associated with the received data and the other records in the indicated bucket.

### Claim 9 (depends on 1)

The computer program product of claim 1, wherein the operations further comprise:
receiving a message from one of the external nodes indicating to remove a record from an indicated bucket; and
indicating that the record indicated in the message to remove is not grouped in the indicated bucket.

### Claim 10 (depends on 1)

The computer program product of claim 1, wherein the database of records is distributed across the nodes, wherein each node includes a node database to store a subset of records in the database, wherein the operations further comprise:
invoking a bucketing database trigger in the node database in the local node in response to receiving the record; and
invoking, by the bucketing database trigger, a bucketing stored procedure in the node database at the local node to perform the operations of processing the received record to determine the at least one containing bucket, determining the at least one of the determined at least one containing bucket assigned to the at least one of the external nodes, and forwarding the data.

### Claim 11 (depends on 10)

The computer program product of claim 10, wherein the operations further comprise:
invoking a comparison database trigger in the node database in the local node in response to the bucketing stored procedure determining that a containing bucket of the at least one containing bucket is assigned to the local node; and
invoking, by the comparison database trigger, a comparison stored procedure in the node database in the local node to compare derived data for the received record with derived data for other records grouped in the containing bucket assigned to the local node to determine relationship values between the received record and the other records grouped in the containing bucket.

### Claim 12

A system for determining a relationship of records in a database distributed among nodes in a network, comprising:
a processor at a local node in the network in communication with external nodes of the nodes; and
a computer readable storage medium having program code executed by the processor to perform operations at the local node, the operations comprising:
receiving a record in the database at the local node;
processing data in the received record to determine at least one containing bucket in at least one of the local node and the external nodes having attributes matching those of the received record, wherein the determined at least one containing bucket comprises at least one of a plurality of buckets, and wherein the buckets are assigned to the local node and the external nodes;
forwarding at least a portion of data in the received record to each external node including one of the determined at least one containing bucket to perform comparison matching with other records in the determined at least one containing bucket at the external node; and
processing the received record in the determined at least one containing bucket at the local node in response to the local node including one of the determined at least one containing bucket.

### Claim 13 (depends on 12)

The system of claim 12, wherein the operations further comprise:
generating a bucket list for the received record indicating the determined at least one containing bucket including the received record.

### Claim 14 (depends on 13)

The system of claim 13, wherein the operations further comprise:
forwarding the bucket list to each of the external nodes assigned one of the determined at least one containing bucket.

### Claim at position 14

15-16. (canceled)

### Claim 17

A method for determining a relationship of records distributed among nodes in a network, comprising:
receiving a record in a database at a local node;
processing data in the received record to determine at least one containing bucket in at least one of the local node and external nodes having attributes matching those of the received record, wherein the at least one containing bucket comprises at least one of a plurality of buckets, and wherein the buckets are assigned to the local node and the external nodes;
forwarding at least a portion of data in the received record to each external node including one of the determined at least one containing bucket to perform comparison matching with other records in the determined at least one containing bucket at the external node; and
processing the received record in the determined at least one containing bucket at the local node in response to the local node including one of the determined at least one containing bucket.

### Claim 18 (depends on 17)

The method of claim 17, further comprising:
generating a bucket list for the received record indicating the determined at least one containing bucket including the received record.

### Claim 19 (depends on 18)

The method of claim 18, further comprising:
forwarding the bucket list to each of the at least one external nodes assigned one of the determined at least one containing bucket.

### Claim at position 18

20-21. (canceled)

### Claim 22 (depends on 12)

The system of claim 12, wherein the operations further comprise:
processing the received record to generate derived data comprising a compact representation of the data in the received record including content for less than all fields in the received record and including content used for comparing the derived data with derived data for other records assigned to one of the buckets to determine a relationship value for the compared records, wherein the forwarded at least the portion of data in the received record comprises the derived data.

### Claim 23 (depends on 12)

The system of claim 12, wherein the operations further comprise:
for each containing bucket of the determined at least one containing bucket assigned to the local node, executing a comparison algorithm at the local node to compare at least a portion of data in the received record with at least a portion of data for other records in the containing bucket to determine relationship values between the received record and the other records in the containing bucket.

### Claim 24 (depends on 12)

The system of claim 12, wherein the operations further comprise:
receiving data for one record from one of the external nodes for one indicated bucket assigned to the local node;
indicating that the record associated with the received data is included in the indicated bucket; and
executing a comparison algorithm at the local node to compare the received data with at least a portion of the data for other records in the indicated bucket to determine a relationship value between the record associated with the received data and the other records in the indicated bucket.

### Claim 25 (depends on 17)

The method of claim 17, further comprising:
processing the received record to generate derived data comprising a compact representation of the data in the received record including content for less than all fields in the received record and including content used for comparing the derived data with derived data for other records assigned to one of the buckets to determine a relationship value for the compared records, wherein the forwarded at least the portion of data in the received record comprises the derived data.

### Claim 26 (depends on 17)

The method of claim 17, further comprising:
for each containing bucket of the determined at least one containing bucket assigned to the local node, executing a comparison algorithm at the local node to compare at least a portion of data in the received record with at least a portion of data for other records in the containing bucket to determine relationship values between the received record and the other records in the containing bucket.

### Claim 27 (depends on 17)

The method of claim 17, further comprising:
receiving data for one record from one of the external nodes for one indicated bucket assigned to the local node;
indicating that the record associated with the received data is included in the indicated bucket; and
executing a comparison algorithm at the local node to compare the received data with at least a portion of the data for other records in the indicated bucket to determine a relationship value between the record associated with the received data and the other records in the indicated bucket.
