Back to results
US 10,503,799 B2Granted
Hyperdata generation in the cloud
AssigneeSap SE
InventorOlaf Schmidt
Life of this patent
Estimating the term…
Abstract
A system and method for building a hyperdata hub to access an enriched data model is presented. One or more data models are built based on user input to a user interface, and one or more query definitions are built based on the user input to the user interface. Data is collected from external data sources and internal data sources, and contextual data is extracted based on the collected data according to the one or more data models and the one or more query definitions. The metadata associated with the one or more data models and one or more query definitions are stored, and data is matched with the contextual data associated with the hyperdata metadata repository.
Claims15
A system comprising:
- a user interface;
- a data model builder configured to build one or more data models based on user input to the user interface;
- a query builder configured to build one or more query definitions based on the user input to the user interface;
- a data harvesting module configured to receive and collect data from external data sources and internal data sources according to the one or more data models and the one or more query definitions, the data harvesting module comprising one or more data extractors configured to extract contextual data based on the received and collected data according to the one or more data models and the one or more query definitions, wherein each data model includes the extracted contextual data, the contextual data being determined according to metadata associated with the collected data, wherein the one or more data extractors comprise one or more streaming modules configured to support streaming as well as polling of data, wherein the data harvesting module comprises a framework configured to integrate extractors, as well as a catalog for data sources;
- a hyperdata metadata repository configured to store the metadata associated with the one or more data models and one or more query definitions;
- a hyperdata store comprising a time series database, a graph database, and a data lake;
- and
- a message broker configured to match data received and collected by the data harvesting module with the contextual data associated with the hyperdata metadata repository, and to write the matched data to the hyperdata store in one or more of the time series database, the graph database, and the data lake.
5 more elements
A method comprising:
- building, by a data model builder, one or more data models based on user input to a user interface;
- building, by a query builder, one or more query definitions based on the user input to the user interface;
- collecting, by a data harvesting module, data from external data sources and internal data sources according to the one or more query definitions of the one or more data models;
- extracting, by one or more data extractors of the data harvesting module, contextual data based on the collected data according to the one or more data models and the one or more query definitions, the contextual data being determined according to metadata associated with the collected data, wherein each data model includes the extracted contextual data, wherein the one or more data extractors comprise one or more streaming modules configured to support streaming as well as polling of data, wherein the data harvesting module comprises a framework configured to integrate extractors, as well as a catalog for data sources;
- storing, by a hyperdata metadata repository, the metadata associated with the one or more data models and one or more query definitions;
- and
- matching, by a message broker, data received and collected by the data harvesting module with the contextual data associated with the hyperdata metadata repository, and writing the matched data to a hyperdata store in one or more of a time series database, a graph database, and a data lake, the hyperdata store comprising a time series database, a graph database, and a data lake.
4 more elements
A computer program product comprising a non-transitory machine-readable medium storing instructions that, when executed by one or more programmable processors, cause the one or more programmable processors to perform operations comprising:
- building, by a data model builder, one or more data models based on user input to a user interface;
- building, by a query builder, one or more query definitions based on the user input to the user interface;
- collecting, by a data harvesting module, data from external data sources and internal data sources according to the one or more query definitions of the one or more data models;
- extracting, by one or more data extractors of the data harvesting module, contextual data based on the collected data according to the one or more data models and the one or more query definitions, the contextual data being determined according to metadata associated with the collected data, wherein each data model includes the extracted contextual data, wherein the one or more data extractors comprise one or more streaming modules configured to support streaming as well as polling of data, wherein the data harvesting module comprises a framework configured to integrate extractors, as well as a catalog for data sources;
- storing, by a hyperdata metadata repository, the metadata associated with the one or more data models and one or more query definitions;
- and
- matching, by a message broker, data received and collected by the data harvesting module with the contextual data associated with the hyperdata metadata repository, and writing the matched data to a hyperdata store in one or more of a time series database, a graph database, and a data lake, the hyperdata store comprising a time series database, a graph database, and a data lake.
4 more elements
Dependencies are inferred from the claim text.