Performance utilities for mobile applications

A system for testing an app, comprising:

• a test server including a test script;
• a video analysis server;
• a first version of a mobile device application;
• a second version of the mobile device application;
• and wherein the test script is operable to:
• detect a first plurality of visual changes over time, of the first version of the mobile device application, while a first feature is executed;
• generate a first performance rating according to the first plurality of visual changes over time;
• detect a second plurality of visual changes over time, of the second version of the mobile device application, while a second feature is executed;
• generate a second performance rating according to the second plurality of visual changes over time;
• and
• compare the first version of the mobile device application and the second version of the mobile device application based on the first performance rating and the second performance rating;
• wherein the first performance rating and the second performance rating are visual speed ratings,
• wherein the first performance rating and the second performance rating are based on an estimate of human visual perception of changes over time in the first plurality of visual changes as a first video and the second plurality of visual changes as a second video being analyzed, and wherein the first performance rating and the second performance rating are visual speed index ratings,
• evaluate including the analysis of the first video and the second video recording of a user interface of the first version of the mobile device application and the second version of the mobile device application produce multiple different metrics from the first video and the second video, the different metrics comprising:
• evaluate area under a curve plotting the changes of all pixels in the first video and the second video of the user interface and weight certain pixels at certain times differently wherein the weight certain pixels at the certain times use knowledge of a particular user interface to weight a portion the first video and the second video, such that upper left-hand quarter of a screen over the remainder of the first video and the second video,
• a heat map indicated which pixels are most interesting to a user, the heat map derived from a click map that measures which areas of the user interface are most frequently clicked on, or derived from portions of the user interface a user scrolls, or with eye tracking ability derived from the portions of the user interface that the user looks at most and wherein the heat map inferred from colors of the pixels and render the pixels considered to have a higher user experience metric, and
• a portion of a screen of the user interface of the first version of the mobile device application and the second version of the mobile device application that provides buttons for user input is weighted higher than portions of a screen of the user interface of the first version of the mobile device application and the second version of the mobile device application that provide design elements that provide no functionality.

A computer readable memory containing instructions executable by a processor, the instructions causing:

• detecting a first plurality of visual changes over time, of a first mobile device application, while a first feature is executed;
• generating a first performance rating according to the first plurality of visual changes over time;
• detecting a second plurality of visual changes over time, of a second mobile device application, while a second feature is executed;
• generating a second performance rating according to the second plurality of visual changes over time;
• and
• comparing the first mobile device application and the second mobile device application based on the first performance rating and the second performance rating;
• wherein the first performance rating and the second performance rating are visual speed ratings,
• wherein the first performance rating and the second performance rating are based on an estimate of human visual perception of changes over time in the first plurality of visual changes as first video and the second plurality of visual changes as second video being analyzed, and wherein the first performance rating and the second performance rating are visual speed index ratings,
• evaluating including the analysis of the first video and the second video recording of a user interface of the first mobile device application and the second mobile device application produce multiple different metrics from the first video and second video, the different metrics comprising:
• evaluate area under a curve plotting the changes of all pixels in the first video and the second video of the user interface and weight certain pixels at certain times differently wherein the weight certain pixels at the certain times use knowledge of a particular user interface to weight a portion the first video and the second video, such that upper left-hand quarter of a screen over the remainder of the first video and the second video,
• a heat map indicated which pixels are most interesting to a user, the heat map derived from a click map that measures which areas of the user interface are most frequently clicked on, or derived from portions of the user interface a user scrolls, or with eye tracking ability derived from the portions of the user interface that the user looks at most and wherein the heat map inferred from colors of the pixels and render the pixels considered to have a higher user experience metric, and
• a portion of a screen of the user interface of the first mobile device application and the second mobile device application that provides buttons for user input is weighted higher than portions of a screen of the user interface of the first mobile device application and the second mobile device application that provide design elements that provide no functionality.