Mixed reality data stream based device control

A computing system which is configured to provide user guidance about controlling a real-world device, the user guidance based on an analysis of digital mixed reality data streams, the computing system comprising:

• a digital memory;
• a user interface comprising at least one hardware output device, the user interface configured to emit an output based on at least one of:
• visual data, textual data, sound data, color data, haptic data;
• a processor set comprising at least one processor, the processor set in operable communication with the digital memory and the user interface;
• a guidance formulation subsystem which is configured to, upon execution by the processor set, detect a deviation between a candidate mixed reality data stream and a guide mixed reality data stream, at least one of the mixed reality data streams including a digital representation of the real-world device, create a feedback stream based at least in part on the deviation, and actuate the user interface hardware output device according to at least a portion of the feedback stream;
• and
• wherein the guidance formulation subsystem is configured to, upon execution by the processor set, create the feedback stream at least in part by computationally compositing a guide derivation of the guide mixed reality data stream over a candidate derivation of the candidate mixed reality data stream, wherein at least a portion of the guide derivation is at least one of:
• translucent, displayed as a skeleton, or visually blocking less than one third of the candidate derivation.

A computer-readable storage device configured with data and instructions which upon execution by a processor cause a computing system to perform a method of providing user guidance about controlling a real-world device, the user guidance based on an analysis of digital mixed reality data streams, the method comprising:

• detecting a deviation between a candidate mixed reality data stream and a guide mixed reality data stream, at least one of the mixed reality data streams including a digital representation of the real-world device;
• creating a feedback stream based at least in part on the deviation;
• actuating a user interface hardware output device according to at least a portion of the feedback stream;
• and
• searching at least one of the data streams for at least one of:
• a lowest deviation run, a greatest deviation run, or an amortized analysis result, wherein “run” means a video sequence including multiple frames.