Intelligent robotic controller executing gen-ai generated tasks plans with task failure detection and handling

A system for robotic task execution, wherein the system comprising:

• a memory storing instructions;
• one or more Input/Output (I/O) interfaces;
• and
• one or more hardware processors coupled to the memory via the one or more I/O interfaces, wherein the one or more hardware processors executing a robotic controller are configured by the instructions to:
• receive, by a robotic controller, a validated task plan from a task planning framework, wherein the task planning framework provides the validated task plan for low level execution of a task originating from a user instruction or a goal from a plurality of modalities;
• extract, by the robotic controller, a set of skills comprising a combination of sequential and parallel skills for execution of the validated task plan from among a plurality of skill capabilities of the robotic controller, wherein each skill among the set of sequential or parallel skills comprises a plurality of atomic skills or compound skills or a combination thereof;
• load, by the robotic controller, from a skill specific node library, a set of provisioned skill specific behaviour tree (BT) nodes for the extracted set of skills;
• extract, by the robotic controller, a set of skills from a skill library defining execution of the extracted set of skills;
• create and load, by the robotic controller, a BT train for the set of skills based on the set of skill ledgers and the set of provisioned skill specific BT nodes, wherein for each skill among the set of skills, the BT train defines a multi-level failure handling mechanism comprising:
• a set of preconfigured failures;
• a set of failure types comprising hardware failures and software failures;
• and
• a set of failure handlers, wherein the hardware failures are handled with one or more pre-defined actions and the software level failures are handled by triggering one or more auto correction steps defined during a skill configuration;
• detect and handle a failure event by a multi-level failure handler associated with the robotic controller, during execution of the validated task in accordance with the BT train, wherein a replanning of the validated task is routed by the multi-level failure handler to one of a robotic controller stage and a task planning framework stage based on a detected failure mapping to one among the set of preconfigured failures and a failure handling capability of the robotic controller;
• and
• generate a mitigation strategy by analysing and classifying the one or more failure events based on the node of the BT at which failure is detected.

One or more non-transitory machine-readable information storage mediums comprising one or more instructions which when executed by one or more hardware processors cause:

• receiving, by a robotic controller, validated task plan from a task planning framework, wherein the task planning framework provides the validated task plan for low level execution of a task originating from a user instruction or a goal from a plurality of modalities;
• extracting, by a robotic controller, a set of skills comprising a combination of sequential and parallel skills for execution of the validated task plan from among a plurality of skill capabilities of the robotic controller, wherein each skill among the set of sequential or parallel skills comprises a plurality of atomic skills or compound skills;
• loading, by the robotic controller, from a skill specific node library, a set of provisioned skill specific behaviour tree (BT) nodes for the extracted set of skills;
• extracting, by the robotic controller, a set of skills from a skill library defining execution of the extracted set of skills;
• creating and loading, by the robotic controller, a BT train for the set of skills based on the set of skill ledgers and the set of provisioned skill specific BT nodes, wherein for each skill among the set of skills, the BT train defines a multi-level failure handling mechanism comprising:
• a set of preconfigured failures;
• a set of failure types comprising hardware failures and software failures;
• and
• a set of failure handlers, wherein the hardware failures are handled with one or more pre-defined actions and the software level failures are handled by triggering one or more auto correction steps defined during a skill configuration;
• detecting and handling a failure event by a multi-level failure handler associated with the robotic controller, during execution of the validated task in accordance with the BT train, wherein a replanning of the validated task is routed by the multi-level failure handler to one of a robotic controller stage and a task planning framework stage based on a detected failure mapping to one among the set of preconfigured failures and a failure handling capability of the robotic controller;
• and
• generating a mitigation strategy by analysing and classifying the one or more failure events based on the node of the BT at which failure is detected.