System and methods for robotic teleoperation intention estimation

A method for robotic teleoperation, comprising:

• receiving inputs of a human operator performing a robotic teleoperation task;
• analyzing the inputs;
• extracting features from the inputs;
• processing the extracted features into sequential input data;
• generating windowed sequential data based on the sequential input data;
• determining, with a hierarchical neural network, intentions of the human operator based on the windowed sequential data, and generating an intention estimation based on the intentions;
• and
• performing, with a teleoperated robotic element, a sequence of actions associated with the intention estimation.

A non-transitory computer readable storage medium storing instructions that when executed by a computer having a processor to perform a method for robotic teleoperation, the method comprising:

• receiving inputs of a human operator performing a robotic teleoperation task;
• analyzing the inputs;
• extracting features from the inputs;
• processing the extracted features into sequential input data;
• generating windowed sequential data based on the sequential input data;
• determining, with a hierarchical neural network, intentions of the human operator based on the windowed sequential data, and generating an intention estimation based on the intentions;
• and
• performing, with a teleoperated robotic element, a sequence of actions associated with the intention estimation.