Back to results
US 2025/0094386 A1Published application
Distributed query execution and aggregation including historical statistical analysis
AssigneeMorgan Stanley Services Group Inc.
InventorsLuke HIGGINS, Robert BRUNO
Life of this patent
Estimating the term…
Abstract
Computer-implemented methods and systems are disclosed for receiving and indexing a plurality of files for later querying, for dynamically generating scripts to be executed during a query of a data store, and for horizontally distributing a query and aggregating results of the distributed query.
Claims20
A system for dynamically generating scripts to be executed during a query of a data store, comprising:
- a server comprising one or more processors;
- and
- non-transitory memory comprising instructions that, when executed by the one or more processors of the server, cause the one or more processors to:
- receive a query comprising a time window of files to be searched, key values to search on in two or more distinct datasets, one or more output fields to track over a period of time and to generate one or more summary statistics of the one or more output fields, and one or both of a filter selecting a subset of the files to be searched and an aggregation of data from all of the files or from all of the files that are filtered;
- dynamically generate a script based on contents of the query, optimizing the script from a template to include only features necessary to satisfy the query;
- distribute the generated script horizontally to a plurality of computing devices that will execute the query by calling the generated script on each of the files to be searched;
- store output;
- and
- in response to receiving a second instance of the query at a later time, re-provide updated output to the query and the one or more summary statistics.
6 more elements
A computer-implemented method for dynamically generating scripts to be executed during a query of a data store, comprising:
- receiving a query comprising a time window of files to be searched, key values to search on in two or more distinct datasets, one or more output fields to track over a period of time and to generate one or more summary statistics of the one or more output fields, and one or both of a filter selecting a subset of the files to be searched and an aggregation of data from all of the files or from all of the files that are filtered;
- dynamically generating a script based on contents of the query, optimizing the script from a template to include only features necessary to satisfy the query;
- distributing the generated script horizontally to a plurality of computing devices that will execute the query by calling the generated script on each of the files to be searched;
- storing output;
- and
- in response to receiving a second instance of the query at a later time, re-provide updated output to the query and the one or more summary statistics.
3 more elements
Dependencies are inferred from the claim text.