Procedural language and content generation environment for use in augmented reality/mixed reality systems to support laboratory and related operations

A non-transitory machine-readable medium comprising instructions that, when applied to one or more computer processor, configure the one or more computer processor to:

• generate first correlations between (a) detected environment objects and detected environmental object movement, and (b) one or more environment sensor input to an augmented reality device;
• evaluate the first correlations against a known objects library, a protocol library, and declared objects to generate programmatic instructions;
• compile the instruction set into executable commands;
• configure control logic to perform the executable commands in response to the detected environment objects and detected environmental object movement;
• generate an augmented reality layer in response to at least one of the executed commands;
• and
• superimpose the augmented reality layer over an environment image layer in the augmented reality device.

A method of operating a procedural language and content generation system comprises:

• generating first correlations between (a) detected environment objects and detected environmental object movement, and (b) one or more environment sensor input to an augmented reality device;
• evaluating the first correlations against a known objects library, a protocol library, and declared objects to generate programmatic instructions;
• compiling the instruction set into executable commands;
• configuring control logic to perform the executable commands in response to the detected environment objects and detected environmental object movement;
• generating an augmented reality layer in response to at least one of the executed commands;
• and
• superimposing the augmented reality layer over an environment image layer in the augmented reality device.