Methods and systems for estimating physical properties of objects

A system for estimating one or more physical properties associated with an object, the system comprising:

• a memory;
• at least one processor in communication with the memory, the at least one processor is configured to:
• generate a three-dimensional (3D) reconstruction of a real-world environment based on an input media from a capturing device;
• estimate a current set of physical parameters associated with the object using a physics-based prediction model and a real-world visual content indicating a recorded media while the object is manipulated in the real-world environment;
• generate a simulation variant corresponding to the manipulation of the object based on the 3D reconstruction and the current set of physical parameters;
• compute a cost function based on comparing the simulation variant and the real-world visual content, wherein the cost function indicates dissimilarity between the simulation variant and the real-world visual content;
• and
• estimate the one or more physical properties associated with the object based on optimizing the current set of physical parameters with the cost function such that a similarity between the simulation variant and the real-world visual content increases.