Technique for evaluating software performance online to support online tuning

A system for evaluating performance of code, the system comprising:

• a processor configured for executing computer program instructions, said computer program instructions, when executed, enabling the processor to:
• receive a plurality of code versions;
• select starting and stopping points for timing execution of the code versions;
• dispatch at least two of the plurality of code versions for execution;
• repeatedly execute the at least two code versions;
• record execution times for the at least two code versions, according to the selected starting and stopping points;
• collect the execution times;
• and
• process the collected execution times for comparison purposes;
• a memory for storing the execution times;
• and
• an input/output interface for communicating results to a user of the system.

A computer readable medium comprising program instructions for:

• receiving a plurality of code versions;
• selecting starting and stopping points for timing execution of the code versions, wherein the selecting step comprises designating an entry to the code as the starting point;
• and designating an exit from the code as the stopping point;
• dispatching at least two of the plurality of code versions for execution;
• repeatedly executing the at least two code versions;
• recording execution times for the at least two code versions, according to the selected starting and stopping points;
• and
• processing the collected execution times.