Distributed analysis and attribution of source code

A computer-implemented method comprising:

• receiving, by a manager node, a request to perform attribution tasks on a plurality of snapshots of a code base, wherein performing an attribution task on a snapshot comprises attributing characteristic segments of source code in the snapshot to respective responsible entities;
• receiving, by the manager node, data representing a revision graph, the revision graph representing parent and child snapshots between snapshots of the code base, wherein a child snapshot is a subsequent snapshot of a parent snapshot in the code base;
• generating, by the manager node, an attribution set having at most N snapshots of the revision graph, wherein N is an integer greater than zero, the attribution set having a target subset of attributable snapshots to be attributed and a support subset of all parent snapshots of snapshots in the target subset, the snapshots in the support subset including one or more parent snapshots that do not occur in the target subset;
• submitting, by the manager node, an attribution task for the attribution set to one worker node of a plurality of worker nodes;
• copying, to the worker node for each snapshot in the attribution set, analysis data that identifies characteristic segments of source code in the snapshot;
• and
• attributing, by the worker node, each characteristic segment of source code in each snapshot in the attribution set to a respective responsible entity.

A computer-implemented method comprising:

• receiving data representing a plurality of snapshots of a code base, wherein each snapshot comprises source code files, wherein one or more snapshots have a parent snapshot in the code base according to a revision graph of snapshots in the code base;
• generating an attribution set from the plurality of snapshots, the attribution set having a target subset of attributable snapshots to be attributed and a support subset of all parent snapshots of all snapshots in the target subset;
• and
• submitting an attribution task for the attribution set to a first worker node of a plurality of worker nodes;
• copying, to the first worker node for each snapshot in the attribution set, analysis data that identifies characteristic segments of source code in the snapshot;
• attributing, by the first worker node, the characteristic segments of source code in each snapshot to a responsible entity;
• determining that an attribution set of size N is not available according to attributable snapshots in the code base, wherein N is an integer greater than zero;
• and
• in response to determining that an attribution set of size N is not available according to attributable snapshots in the code base, submitting an analysis task for a next unanalyzed snapshot to a second worker node of the plurality of worker nodes.

A system comprising:

• one or more computers and one or more storage devices storing instructions that are operable, when executed by the one or more computers, to cause the one or more computers to perform operations comprising:
• receiving data representing a plurality of snapshots of a code base, wherein each snapshot comprises source code files, wherein one or more snapshots have a parent snapshot in the code base according to a revision graph of snapshots in the code base;
• generating an attribution set from the plurality of snapshots, the attribution set having a target subset of attributable snapshots to be attributed and a support subset of all parent snapshots of all snapshots in the target subset;
• and
• submitting an attribution task for the attribution set to a first worker node of a plurality of worker nodes;
• copying, to the first worker node for each snapshot in the attribution set, analysis data that identifies characteristic segments of source code in the snapshot;
• attributing, by the first worker node, the characteristic segments of source code in each snapshot to a responsible entity;
• determining that an attribution set of size N is not available according to attributable snapshots in the code base, wherein N is an integer greater than zero;
• and
• in response to determining that an attribution set of size N is not available according to attributable snapshots in the code base, submitting an analysis task for a next unanalyzed snapshot to a second worker node of the plurality of worker nodes.