Partitioned batch processing for a usage analysis system

A method, comprising:

• generating, by one or more session event nodes implemented on one or more computing devices, updates for a plurality of application usage records according to session events received from a plurality of devices of a plurality of users, each session event indicating new usage data for a respective application instance on a respective device of a respective user, and each update including an application identifier indicating one of a plurality of applications and increments for one or more aggregated usage metrics of the respective application, wherein, for at least one of the plurality of applications, the one or more session event nodes receives a plurality of session events from two or more different devices of two or more different users indicating new usage data for two or more different application instances of the same application, and wherein the updates are generated as the session events are received;
• partitioning, by the one or more session event nodes, the updates into a plurality of partitions according to the application identifier;
• and
• applying, by a plurality of application usage update nodes distinct from the one or more session event nodes, batches of the updates from the partitions to respective ones of the plurality of application usage records, each application usage record corresponding to a particular one of the plurality of applications and including one or more aggregated usage metrics for the respective application, wherein each application usage update node is associated with a different partition of the plurality of partitions, and applies updates from the different partition of the plurality of partitions to a different one of the plurality of application usage records;
• wherein the updates obtained and applied by at least one of the plurality of application usage update nodes to the respective different one of the plurality of application usage records corresponds to session events received, by one or more of the session event nodes, from two or more different devices of two or more different users.

A non-transitory computer-readable storage medium storing program instructions that when executed on one or more computers cause the one or more computers to implement a usage analysis system comprising:

• one or more session event nodes configured to:
• generate updates for a plurality of records in an application usage table according to session events received from a plurality of devices of a plurality of users, each session event indicating new usage data for a respective application instance on a respective device of a respective user, and each update including an application identifier indicating one of a plurality of applications and increments for one or more aggregated usage metrics of the respective application, wherein, for at least one of the plurality of applications, the session events from two or more different devices of two or more different users indicate new usage data for two or more different application instances of the same application, and wherein the updates are generated as the session events are received;
• and
• partition the updates into a plurality of partitions according to the application identifier;
• a plurality of application usage update nodes distinct from the one or more session event nodes configured to:
• obtain the updates from respective ones of the plurality of partitions;
• and
• apply the updates to respective ones of the plurality of records in the application usage table, each record in the application usage table corresponding to a particular one of the plurality of applications and including one or more aggregated usage metrics for the respective application, wherein each application usage update node is associated with a different partition of the plurality of partitions, and applies updates from the different partition to a different record of the plurality of records;
• wherein the updates obtained and applied by at least one of the plurality of application usage update nodes to the respective different one of the plurality of records corresponds to session events received, by one or more of the session event nodes, from two or more different devices of two or more different users.