# US 2018/0025041 A1 · System and method for improved data consistency in data systems including dependent algorithms

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2018/0025041 A1
- Document ID: US20180025041A1
- Status: Published application
- Kind: A1
- Application number: 15/652,897
- Filed: 2017-07-18
- Published: 2018-01-25
- Earliest claimed: 2016-07-20
- Assignees: Level 3 Communications, LLC
- Applicants: Level 3 Communications, LLC
- Inventors: William Gray; Binchao Chen; Steven D. Meyer
- Web page: https://patentgrep.com/patent/US20180025041A1

## CPC

- G06F 16/2365: {Ensuring data consistency and integrity}
- G06F 16/22: Indexing; Data structures therefor; Storage structures
- G06F 16/23: Updating
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

A data system is provided for analyzing and maintaining data obtained from one or more data sources on which the data system depends. The system includes a primary database including current values used by the system and a collection of executable algorithms used to generate the data maintained in the primary database. In response to receiving a notification regarding a change in one of the data sources, a dependency database is used to establish an execution order for algorithms of the algorithm collection that are directly or indirectly dependent on the changed data. The algorithms identified in the execution order are then executed in accordance with the execution order and the corresponding result is stored in the primary database. The system may include data harvesters adapted to recognize changes in the data sources and to generate and transmit corresponding change notifications when such changes occur.

## Claims

### Claim 1

A method of updating and analyzing data in a data system comprising:
receiving a change notification indicating a change to a field of a data source;
updating a database value of a first database in response to receiving the change notification, wherein the database value is one of a current value of the field and a result of an algorithm dependent on the current value of the field;
identifying a first algorithm dependent on the database value and a second algorithm dependent on a result of the first algorithm, wherein identifying the first algorithm and the second algorithm comprises:
transmitting a request including an identifier corresponding to the database value; and
receiving an execution order in response to the request, the execution order indicating an order in which to execute the first algorithm and the second algorithm;
generating an algorithm result of the second algorithm by executing each of the first algorithm and the second algorithm in accordance with the execution order; and
storing the algorithm result in the first database.

### Claim 2 (depends on 1)

The method of claim 1, wherein the first algorithm is at least one of directly dependent on the database value such that the first algorithm uses the database value as an input and indirectly dependent on the database value such that the first algorithm uses an output of another algorithm dependent on the database value as an input.

### Claim 3 (depends on 1)

The method of claim 1, further comprising storing a result of the first algorithm in the first database.

### Claim 4 (depends on 1)

The method of claim 1, wherein transmitting the request comprises transmitting the request to an application in communication with a second database including dependency data for a plurality of algorithms including the first algorithm and the second algorithm, the dependency data indicating inputs required for each algorithm of the plurality of algorithms.

### Claim 5 (depends on 4)

The method of claim 4, wherein the second database is a graph database.

### Claim 6 (depends on 1)

The method of claim 1, wherein the first database is a graph database.

### Claim 7 (depends on 1)

The method of claim 1, wherein the change notification is received from an application in communication with the data source, the application configured to retrieve and normalize data obtained from the data source and to generate and transmit the change notification in response to identifying changes to the data source.

### Claim 8 (depends on 1)

The method of claim 1 further comprising receiving a feedback value corresponding to but different than the database value, wherein generating the algorithm result comprises providing an input value to the first algorithm, the input value being one of the feedback value and a combination of the database value and the feedback value.

### Claim 9 (depends on 8)

The method of claim 8, wherein the input value is a combination of the database value and the feedback value, and the input value is one of an average of the database value and the feedback value, a weighted average of the database value and the feedback value, and a time-dependent weighted average of the database value and the feedback value.

### Claim 10 (depends on 8)

The method of claim 8 further comprising storing the feedback value in the first database.

### Claim 11 (depends on 1)

The method of claim 1, wherein the algorithm result includes a scoring metric.

### Claim 12 (depends on 1)

The method of claim 1, wherein the first algorithm and the second algorithm are included in an algorithm collection including a plurality of algorithms, the method further comprising:
modifying the algorithm collection by modifying an existing algorithm of the algorithm collection and adding a new algorithm to the algorithm collection;
executing each algorithm of the algorithm collection dependent on the modified existing algorithm and the new algorithm, respectively.

### Claim 13 (depends on 1)

The method of claim 1, wherein the execution order is generated by:
identifying the first algorithm from a plurality of algorithms that are dependent on the database value;
assigning the first algorithm to a first execution layer of the execution order;
identifying the second algorithm from the plurality of algorithms by traversing a dependency graph including dependency data for the plurality of algorithms; and
assigning the second algorithm to a second execution layer of the execution order according to a traversal distance of the second algorithm from the first algorithm,
wherein executing the first algorithm and the second algorithm in accordance with the execution order the first execution layer followed by executing the second execution layer.

### Claim 14

A system for organizing and analyzing data from multiple data sources comprising:
an algorithm collection including a plurality of executable algorithms for evaluating data;
a first database including dependency data for each algorithm of the plurality of algorithms; and
one or more computing devices configured to:
receive a notification corresponding to changed data of a data source;
execute, in response to receiving the notification, a first algorithm of the algorithm collection and a second algorithm of the algorithm collection according to an execution order derived from the dependency data, the first algorithm being dependent on the changed data and the second algorithm being dependent on a result of the first algorithm; and
update a second database to include a result of the second algorithm.

### Claim 15 (depends on 14)

The system of claim 14, wherein at least one of the first database and the second database are graph databases.

### Claim 16 (depends on 14)

The system of claim 14, wherein the one or more computing devices are further configured to receive the notification from a data harvesting application adapted to retrieve and normalize data from the data source.

### Claim 17 (depends on 16)

The system of claim 16, wherein the data harvesting application is one of a plurality of data harvesting applications and each data harvesting application of the plurality of data harvesting applications adapted to retrieve and normalize data from a respective data source, the one or more computing devices further configured to receive notifications from each of the plurality of data harvesting applications.

### Claim 18 (depends on 17)

The system of claim 17, wherein the one or more computing devices are further configured to:
receive an execution plan including an execution order for the first algorithm and the second algorithm,
wherein executing the first algorithm and the second algorithm includes executing the first algorithm and the second algorithm according to the execution order.

### Claim 19 (depends on 18)

The system of claim 18, wherein the one or more computing devices are further configured to:
generate, in response to receiving the notification, a request for an execution plan; and
transmit the request to an application in communication with the first database, the application adapted to generate the execution plan.

### Claim 20 (depends on 14)

The system of claim 14, wherein the one or more computing devices are further configured to generate log entries corresponding to data received and analyzed by the one or more computing devices and to store the log entries in a third database.

### Claim 21 (depends on 14)

The system of claim 14 further comprising a third database adapted to store feedback data corresponding to data stored in the second database, wherein the one or more computing devices are further configured to execute the first algorithm using the feedback data.

### Claim 22

A system for organizing and analyzing data from multiple data sources comprising:
an algorithm collection including a plurality of executable algorithms;
a dependency database including dependency data for each algorithm of the algorithm collection, the dependency data indicating data relationships between algorithms of the algorithm collection;
a current database including current values of data stored in one or more data sources and results of algorithms of the algorithm collection; and
one or more computing devices communicatively coupled to the algorithm collection, the dependency database, and the current database, the one or more computing devices configured to:
recognize a change to data of the one or more data sources;
identify a first algorithm of the algorithm collection dependent on the changed data and a second algorithm of the algorithm dependent on the first algorithm;
generate, based on the dependency data, an execution order for the first algorithm and the second algorithm;
generate an algorithm result by executing the first algorithm and the second algorithm according to the execution order; and
update the database to include the algorithm result.
