Systems and methods for providing time-based user experiences for an industrial automation system

A method comprising:

• receiving, via processing circuitry, a plurality of sensory datasets associated with an industrial automation system from a plurality of sensors, wherein the plurality of sensors comprises an image sensor, a microphone, a haptic sensor, a movement sensor, a biometric sensor, a gustatory sensor, an odor sensor, or any combination thereof;
• determining, via the processing circuitry and for each respective sensory dataset of the plurality of sensory datasets, one or more events in the industrial automation system associated with the respective sensory dataset;
• receiving user input indicative of a selection of a user experience of a plurality of user experiences, wherein the plurality of user experiences comprises:
• a first user experience associated with a first event that occurred in the industrial automation system during a first time period prior to receiving the user input;
• and
• a second user experience associated with a second event expected to occur in the industrial automation system during a second time period after receiving the user input;
• generating, via the processing circuitry and based on the user input, a first output representative data or a second output representative data associated with the industrial automation system during the first time period or the second time period, respectively, wherein the first user experience is generated based on a first set of data acquired during the first time period by the plurality of sensors associated with the industrial automation system, wherein the first output representative data corresponds to a simulation of a user experience with respect to the industrial automation system during the first time period;
• and
• wherein the second user experience is generated based on a predicted intent of a user determined by matching input sensory data and/or received context information with corresponding input sensory data and/or context information associated with the predicted intent, such that the second output representative data corresponds to an additional simulation of an expected user experience with respect to the industrial automation system during the second time period, and wherein the input sensory data is acquired by one or more sensors associated with the user, the industrial automation system, or both;
• and
• instructing, via the processing circuitry and based on the user input, a computing device to present second output representative data in virtual reality, augmented reality, or both using image data and haptic feedback in response to receiving the user input indicative of the selection of the second user experience.

A system comprising:

• processing circuitry;
• and
• memory comprising computer-readable instructions, wherein the instructions, when executed by the processing circuitry, are configured to cause the processing circuitry to perform operations comprising:
• receiving a plurality of sensory datasets associated with an industrial automation system from a plurality of sensors, wherein the plurality of sensors comprises an image sensor, a microphone, a haptic sensor, a movement sensor, a biometric sensor, a gustatory sensor, an odor sensor, or any combination thereof;
• determining, for each respective sensory dataset of the plurality of sensory datasets, one or more events in the industrial automation system associated with the respective sensory dataset;
• receiving user input indicative of a selection of a user experience of a plurality of user experiences, wherein the plurality of user experiences comprises:
• a first user experience associated with a first event that occurred in the industrial automation system during a first time period prior to receiving the user input;
• and
• a second user experience associated with a second event expected to occur in the industrial automation system during a second time period after receiving the user input;
• generating, based on the user input, a first output representative data or a second output representative data associated with the industrial automation system during the first time period or the second time period, respectively, wherein the first user experience is generated based on a first set of data acquired during the first time period by the plurality of sensors associated with the industrial automation system, wherein the first output representative data corresponds to a simulation of a user experience with respect to the industrial automation system during the first time period;
• and
• wherein the second user experience is generated based on a predicted intent of a user determined by matching input sensory data and/or received context information with corresponding input sensory data and/or context information associated with the predicted intent, such that the second output representative data corresponds to an additional simulation of an expected user experience with respect to the industrial automation system during the second time period, and wherein the input sensory data is acquired by one or more sensors associated with the user, the industrial automation system, or both;
• and
• instructing, based on the user input, a computing device to present the second output representative data in virtual reality, augmented reality, or both using image data and haptic feedback in response to receiving the user input indicative of the selection of the second user experience.