Debugging a map reduce application on a cluster

An apparatus for debugging a map-reduce application on a computer cluster comprising:

• (A) a computer cluster comprising two or more computers;
• (B) a map-reduce framework installed onto each of the two or more computers, wherein:
• (1) the map-reduce framework defines the cluster;
• (2) the map-reduce framework comprises an integrated development environment (IDE);
• and
• (3) the cluster is formatted by:
• (i) identifying the two or more computers in the cluster;
• (ii) establishing communication between the two or more computers;
• and
• (iii) enabling the cluster of two or more computers to function as a unit;
• (C) data that is placed into the cluster;
• and
• (D) a function configured to be executed by the map-reduce framework on the cluster;
• and
• (E) a debugger that is part of the IDE, wherein:
• (1) the function is debugged directly on the cluster using the debugger;
• and
• (2) the function being debugged is directly executed on the cluster using the data in the cluster;
• (3) the debugger is configured to dynamically accept code for the function that is input into a debugger of the IDE;
• (4) the debugger is configured to dynamically determine, as the code is dynamically typed into the debugger, if the code specifies a heap allocation without reusing memory;
• and
• (5) if the code specifies a heap allocation without reusing memory, the debugger is configured to dynamically highlight the code in the debugger.

A system for debugging a map-reduce application on a cluster comprising:

• (A) two or more computers communicatively coupled to each other to define a cluster that functions as a unit;
• (B) a map-reduce framework installed on each of the two or more computers, wherein the map-reduce framework comprises an integrated development environment (IDE);
• (C) a function configured to be executed by the map-reduce framework on data in the cluster;
• (D) a debugger installed as part of the IDE, wherein the debugger is configured to:
• (1) debug the function directly on the cluster;
• (2) dynamically accept code for the function that is input into a debugger of the IDE;
• (3) dynamically determine, as the code is dynamically typed into the debugger, if the code specifies a heap allocation without reusing memory;
• and
• (4) if the code specifies a heap allocation without reusing memory, dynamically highlight the code in the debugger.