Providing uninterrupted remote control of a production device via virtual reality devices

A computing system having a memory having computer readable instructions and one or more processors for executing the computer readable instructions, the computer readable instructions controlling the one or more processors to perform operations comprising:

• obtaining a production task to be performed using a production device;
• identifying a remote worker, from a remote worker database, to perform the production task via a virtual reality device;
• assigning the production task to the remote worker, wherein the virtual reality device generates realistic images and sounds to simulate the presence of the remote worker in a production environment, presents a digital twin of the production device in the production environment, and captures interaction between the remote worker and the digital twin of the production device, wherein the virtual reality device transmits the captured interaction data between the remote worker and the digital twin of the production device to the production device such that the remote worker causes one or more sensors to physically control the production device by interacting with the digital twin of the production device using the virtual reality device, wherein the virtual reality device generates, in real time, control signals corresponding to operational parameters of the production device, including at least movement path, operational speed, and operation direction, and to transmit the control signals to the production device for execution, thereby effecting a transformation of the production device;
• monitoring a remote worker environment of the remote worker during performance of the production task, wherein one or more sensors monitors a location of the remote worker in the remote worker environment, spacing between the remote worker and objects in the remote worker environment, movement of the remote worker in the remote worker environment, a power level of the virtual reality device, and a quality of a network connection between the virtual reality device and the production environment;
• determining that the production task needs to be reassigned, wherein determining that the production task needs to be reassigned comprises obtaining multi-channel time-series data from the one or more sensors, inputting the time-series data into a trained artificial neural network selected from the group consisting of a convolutional neural network and a recurrent neural network, generating, by the artificial neural network, a quantitative risk score representing a likelihood of an interruption event occurring in the remote worker environment, and comparing the risk score to a threshold to determine whether the production task needs to be reassigned, wherein the interruption event includes one of a projected impact between the remote worker and an object in the remote worker environment, a projected communications disruption between the virtual reality device and the production device, and a projected loss of power to the virtual reality device;
• identifying a replacement remote worker from the remote worker database;
• and
• reassigning the production task to the replacement remote worker, wherein reassigning the production task to the replacement remote worker includes performing a handoff of the production task from the remote worker to the replacement remote worker, wherein a voice communications channel is established between the remote worker and the replacement remote
• worker during the handoff, wherein both the remote worker and the replacement remote worker cause one or more sensors to physically control the operation of the production device during the handoff period, wherein a duration of the handoff is determined at least in part based on an expected amount of time between the reassignment and the expected interruption event, and wherein the reassignment of the production task to the replacement remote worker includes instructing the virtual reality device of the replacement remote worker to provide a simulation of the production environment and a digital twin of the production device for the replacement remote worker to interact with,
• wherein a scheduling system coordinates the handoff, wherein, during the handoff, the virtual reality device of the replacement remote worker displays a simulation of the production environment including the assigned remote worker, and wherein the reassignment is performed prior to any interruption in the production task to ensure continuous operation of the production device by one of the remote worker and the replacement remote worker.

A computer program product comprising a computer readable storage medium having program instructions embodied therewith, the program instructions executable by a processor to cause the processor to perform operations comprising:

• obtaining a production task to be performed using a production device;
• identifying a remote worker, from a remote worker database, to perform the production task via a virtual reality device;
• assigning the production task to the remote worker, wherein the virtual reality device generates realistic images and sounds to simulate the presence of the remote worker in a production environment, presents a digital twin of the production device in the production environment, and captures interaction between the remote worker and the digital twin of the production device, wherein the virtual reality device transmits the captured interaction data between the remote worker and the digital twin of the production device to the production device such that the remote worker causes one or more sensors to physically control the production device by interacting with the digital twin of the production device using the virtual reality device, wherein the virtual reality device generates, in real time, control signals corresponding to operational parameters of the production device, including at least movement path, operational speed, and operation direction, and to transmit the control signals to the production device for execution, thereby effecting a transformation of the production device;
• monitoring a remote worker environment of the remote worker during performance of the production task, wherein one or more sensors monitor a location of the remote worker in the remote worker environment, spacing between the remote worker and objects in the remote worker environment, movement of the remote worker in the remote worker environment, a power level of the virtual reality device, and a quality of a network connection between the virtual reality device and the production environment;
• determining that the production task needs to be reassigned, wherein determining that the production task needs to be reassigned comprises obtaining multi-channel time-series data from the one or more sensors, inputting the time-series data into a trained artificial neural network selected from the group consisting of a convolutional neural network and a recurrent neural network, generating, by the artificial neural network, a quantitative risk score representing a likelihood of an interruption event occurring in the remote worker environment, and comparing the risk score to a threshold to determine whether the production task needs to be reassigned, wherein the interruption event includes one of a projected impact between the remote worker and an object in the remote worker environment, a projected communications disruption between the virtual reality device and the production device, and a projected loss of power to the virtual reality device;
• identifying a replacement remote worker from the remote worker database;
• and
• reassigning the production task to the replacement remote worker, wherein reassigning the production task to the replacement remote worker includes performing a handoff of the production task from the remote worker to the replacement remote worker, wherein a voice communications channel is established between the remote worker and the replacement remote worker during the handoff, wherein both the remote worker and the replacement remote worker causes one or more sensors to physically control the operation of the production device during the handoff period, wherein a duration of the handoff is determined at least in part based on an expected amount of time between the reassignment and the expected interruption event, and wherein the reassignment of the production task to the replacement remote worker includes instructing the virtual reality device of the replacement remote worker to provide a simulation of the production environment and a digital twin of the production device for the replacement remote worker to interact with,
• wherein a scheduling system coordinates the handoff, wherein, during the handoff, the virtual reality device of the replacement remote worker displays a simulation of the production environment including the assigned remote worker, and wherein the reassignment is performed prior to any interruption in the production task to ensure continuous operation of the production device by one of the remote worker and the replacement remote worker.