Unified platform for big data processing
AssigneeInfosys Limited
InventorsSudheesh Chandran Narayanan, Sandeep Bhagat
Life of this patent
Estimating the term…
Abstract
This technology relate to methods and systems for big data processing. The system includes extraction modules for extracting data from the data sources. The system also includes means for defining rules to be applied on the data and means for applying the rules on the data in conjunction with the extraction modules. The means for applying the rules is capable of applying pre-defined set of rules and the rules defined by means of defining the rules. The system also has controllers for defining access control restrictions on the data in conjunction with the extraction modules, display for displaying visual representations of the data processing in conjunction with the extraction modules and memory to store the extracted data in indexed form.
Claims20
A method for processing big data, the method comprising:
- extracting, by a data processing apparatus, data from at least one data source;
- applying, by the data processing apparatus, a pre-defined set of rules on the data at run-time wherein run-time comprises data extraction time period;
- defining, by the data processing apparatus, one or more rules to be applied on the data at run-time wherein the one or more rules comprises a first set of rules for batch processing of the data and a second set of rules for real-time processing of the data;
- applying, by the data processing apparatus, the first set of rules on the data at run-time;
- applying, by the data processing apparatus, the second set of rules on the data at run-time;
- defining, by the data processing apparatus, one or more access control restrictions on the data at run-time;
- displaying, by the data processing apparatus, one or more visual representations of the data processing at one or more time instances wherein the one or more time instances are one or more time occurrences at run-time;
- and
- storing, by the data processing apparatus, the extracted data in indexed form at run-time completion.
A system for processing big data, the system comprising:
- one or more extraction modules for extracting data from at least one data source;
- means for applying a pre-defined set of rules on the data in conjunction with the one or more extraction modules;
- means for defining one or more rules to be applied on the data in conjunction with the one or more extraction modules;
- means for applying the one or more rules on the data in conjunction with the one or more extraction modules;
- one or more controllers for defining one or more access control restrictions on the data in conjunction with the one or more extraction modules;
- display for displaying one or more visual representations of the data processing in conjunction with the one or more extraction modules;
- and
- memory to store the extracted data in indexed form.
A non-transitory computer readable medium having stored thereon instructions for processing data comprising executable code which when executed by a processor, causes the processor to perform steps comprising:
- extracting data from at least one data source;
- applying a pre-defined set of rules on the data at run-time wherein run-time comprises data extraction time period;
- defining one or more rules to be applied on the data at run-time wherein the one or more rules comprises a first set of rules for batch processing of the data and a second set of rules for real-time processing of the data;
- applying the first set of rules on the data at run-time;
- applying the second set of rules on the data at run-time;
- defining one or more access control restrictions on the data at run-time;
- displaying one or more visual representations of the data processing at one or more time instances wherein the one or more time instances are one or more time occurrences at run-time;
- and
- storing the extracted data in indexed form at run-time completion.
A data processing computing apparatus comprising:
- at least one processor;
- and
- at least one memory coupled to the processor configured to execute programmed instructions stored in the memory comprising:
- extracting data from at least one data source;
- applying a pre-defined set of rules on the data at run-time wherein run-time comprises data extraction time period;
- defining one or more rules to be applied on the data at run-time wherein the one or more rules comprises a first set of rules for batch processing of the data and a second set of rules for real-time processing of the data;
- applying the first set of rules on the data at run-time;
- applying the second set of rules on the data at run-time;
- defining one or more access control restrictions on the data at run-time;
- displaying one or more visual representations of the data processing at one or more time instances wherein the one or more time instances are one or more time occurrences at run-time;
- and
- storing the extracted data in indexed form at run-time completion.
Dependencies are inferred from the claim text.