Training multi-object tracking models using simulation

A method of training a multi-object tracking model, the method comprising:

• generating a plurality of training images based at least on scene generation information, each training image comprising a plurality of objects to be tracked, the plurality of training images forming a sequence of images in time;
• generating, for each training image, original simulated data based at least on the scene generation information, the original simulated data comprising tag data for a first object of the plurality of objects;
• locating, within the original simulated data for a first training image of the plurality of training images, tag data for the first object, based on at least one of an occlusion alert, a proximity alert, or a motion alert associated with the first object in the first training image;
• based at least on locating the tag data for the first object, modifying at least a portion of the tag data for the first object from the original simulated data for the first training image, thereby generating preprocessed training data from the original simulated data;
• and
• training a multi-object tracking model with the preprocessed training data to produce a trained multi-object tracker.

One or more computer storage devices having computer-executable instructions stored thereon, which, on execution by a computer, cause the computer to perform operations comprising:

• generating a plurality of training images based at least on scene generation information, each training image comprising a plurality of objects to be tracked, the plurality of training images forming a sequence of images in time;
• generating, for each training image, original simulated data based at least on the scene generation information, the original simulated data comprising tag data for a first object of the plurality of objects;
• locating, within the original simulated data for a first training image of the plurality of training images, tag data for the first object, based on at least one of an occlusion alert, a proximity alert, or a motion alert associated with the first object in the first training image;
• based at least on locating the tag data for the first object, modifying at least a portion of the tag data for the first object from the original simulated data for the first training image, thereby generating preprocessed training data from the original simulated data;
• and
• training a multi-object tracking model with the preprocessed training data to produce a trained multi-object tracker.