Systems and methods for optimizing data processing in a distributed computing environment
AssigneeThe Toronto-Dominion Bank
InventorsDan Ni Yang, Méliné Nikoghossian, Elham Hajarian, Behjat Soltanifar, Karishma Harshal Patel
Life of this patent
Estimating the term…
Abstract
Systems and methods for preprocessing large inference files in a cluster environment prior to transmission to one or more downstream applications. The inference files are processed using templates that correspond to particular downstream applications, allowing for optimized transmission and optimized processing by each downstream application.
Claims20
A system for optimized data processing in a networked computing environment, the system comprising:
- an application database storing a first table and at least one additional table, the first table having inference data generated by a machine learning model, the inference data having fields and records in tabular form;
- a downstream computer executing a downstream application;
- and
- a computing cluster operatively coupled to the application database, the computing cluster comprising a plurality of nodes, at least one node having a memory and a processor configured to:
- retrieve the first table and the at least one additional table from the application database;
- process the first table and the at least one additional table based on a template corresponding to the downstream application to generate an output table corresponding to the downstream application;
- and
- provide the output table to the downstream application;
- and
- wherein the downstream application is configured to generate a notification from the output table.
A method of optimizing data processing in a networked computing environment, the method comprising:
- receiving inference data generated by a machine learning model, the inference data having fields and records in tabular form;
- storing the inference data in a first table of a database, the database storing at least one additional table;
- processing the first table and the at least one additional table based on a template corresponding to a downstream application, to generate an output table corresponding to the downstream application;
- and
- providing the output table to the downstream application to generate notifications from the output table.
A non-transitory computer readable medium storing computer executable instructions which, when executed by at least one computer processor, cause the at least one computer processor to carry out a method of optimizing data processing in a networked computing environment, the method comprising:
- receiving inference data generated by a machine learning model, the inference data having fields and records in tabular form;
- storing the inference data in a first table of a database, the database storing at least one additional table;
- processing the first table and the at least one additional table based on a template corresponding to a downstream application, to generate an output table corresponding to the downstream application;
- and
- providing the output table to the downstream application to generate notifications from the output table.
Dependencies are inferred from the claim text.