Systems and methods of multimodal interaction-based supply chain execution using immersive guidance

A computer-implemented method for immersive guidance using a supply chain execution platform, comprising:

• monitoring and receiving, by a computer comprising a processor and a memory, input comprising user interaction and user input signals of a user;
• detecting, by the computer, a user intent within a supply chain execution environment from the user input signals;
• determining, by the computer, associated focus prompts and action prompts, wherein the focus prompts are determined based on eye cornea reflection tracking using a corneal tracking sensor and facial expressions using a facial action coding camera;
• displaying, by the computer, immersive guidance comprising an intent-based visual prompt using augmented reality, wherein the intent-based visual prompt comprises one or more recommended actions corresponding to a supply chain execution system;
• and
• updating, by the computer, the immersive guidance based on real-time user action updates received from one or more sensing devices.

A non-transitory computer-readable medium embodied with software for immersive guidance using a supply chain execution platform, the software when executed is configured to:

• monitor and receive, by a computer comprising a processor and a memory, input comprising user interaction and user input signals of a user;
• detect a user intent within a supply chain execution environment from the user input signals;
• determine associated focus prompts and action prompts, wherein the focus prompts are determined based on eye cornea reflection tracking using a corneal tracking sensor and facial expressions using a facial action coding camera;
• display immersive guidance comprising an intent-based visual prompt using augmented reality, wherein the intent-based visual prompt comprises one or more recommended actions corresponding to a supply chain execution system;
• and
• update the immersive guidance based on real-time user action updates received from one or more sensing devices.