Marker based tracking

A non-transitory computer-readable medium having embedded thereon a program, the program being executable by a processor for performing a method comprising:

• converting images to a set of points in 3D space, wherein the images are of a wearable item that includes markers, and the set of points in 3D space include representations of the markers;
• selecting a view from a plurality of views using the set of points, wherein the selected view includes one or more representations of the representations;
• generating a depth map based on the selected view and the set of points, wherein the depth map includes the one or more representations;
• mapping, via a neural network, labels to the one or more representations in the depth map using a model of a portion of a body that wears the wearable item;
• determining a joint parameter using the mapped labels;
• and
• updating the model with the joint parameter, wherein content provided to a user of the wearable item is based in part on the updated model.