Digital twin authoring and editing environment for creation of AR/VR and video instructions from a single demonstration

A method for generating multi-media instructional content, the method comprising:

• recording, with at least one sensor, a demonstration by a user of a task within a real-world environment;
• determining, with a processor, a first sequence of pose data for a virtual avatar based on the recorded demonstration;
• generating, with the processor, based on the first sequence of pose data, at least one of augmented reality content and virtual reality content that provides instructions to perform the task, the at least one of the augmented reality content and the virtual reality content including a virtual model of the virtual avatar associated with the first sequence of pose data;
• and
• generating, with the processor, based on the first sequence of pose data, a two-dimensional video that provides instructions to perform the task, the two-dimensional video being generated using a virtual camera that views the virtual model of the virtual avatar within a virtual environment and by animating the virtual model of the virtual avatar to move according to the first sequence of pose data.