Big Data processing platform and method
OwnerDaniel Jaye, Sakthi Priyan Hari Krishnan +2inventors
InventorsDaniel Jaye, Sakthi Priyan Hari Krishnan, Sudheer Pendyala, Sundara Raghavan Sankaran
Life of this patent
Estimating the term…
Loading patent…
OwnerDaniel Jaye, Sakthi Priyan Hari Krishnan +2inventors
InventorsDaniel Jaye, Sakthi Priyan Hari Krishnan, Sudheer Pendyala, Sundara Raghavan Sankaran
Estimating the term…
A highly efficient, scalable, and adaptable framework suitable for modern Big Data processing challenges in cloud-based environments. The framework preferably leverages a scale-up before scale-out paradigm that prioritizes scaling up individual nodes (e.g., with high-core-count processors) before scaling out across multiple nodes. In addition, preferably the framework moves data to compute nodes, e.g., utilizing high-bandwidth cloud storage networks for efficient data transfer. Further, the framework preferably employs specialized primitives optimized for specific Big Data processing tasks, particularly for collations, sorts, and shuffles. Finally, framework utilizes optimized libraries for a small number of file formats.
A computing system operating in association with a cloud-based environment, comprising:
A method of processing in association with a cloud compute infrastructure with network connections to a cloud storage, comprising:
A method associated with a cloud-based infrastructure comprising a plurality of compute nodes, cloud storage distinct from the plurality of compute nodes, and network connections between the plurality of compute nodes and the cloud storage, the method comprising:
Dependencies are inferred from the claim text.