Device and method for controlling a robot device

A robot controller configured to control a robot device, the robot controller configured to:

• provide, for each function of a plurality of functions, a control model for controlling the robot device to perform the function;
• provide a selection model for selecting among the plurality of functions;
• execute multiple instances of a task by the robot device, including, in each execution, when a function of the plurality of functions needs to be selected to perform the task instance, checking whether the selection model provides a selection of a function and,
• if the selection model provides a selection of a function, control the robot device to perform the function selected by the selection model, using the control model for the selected function;
• and
• if the selection model does not provide a selection of a function, receive user input indicating a selection of a function, select a function according to the selection indicated by the user input, control the robot device to perform the function selected according to the selection indicated by the user input using the control model for the selected function. and train the selection model according to the selection indicated by the user input.

A non-transitory computer-readable medium on which are stored instructions controlling a robot device, the instructions, when executed by a computer, causing the computer to perform the following steps:

• providing, for each function of a plurality of functions, a control model for controlling the robot device to perform the function;
• providing a selection model for selecting among the plurality of functions;
• executing multiple instances of a task by the robot device, including, in each execution, when a function of the plurality of functions needs to be selected to perform the task instance, checking whether the selection model provides a selection of a function;
• if the selection model provides a selection of a function, controlling the robot device to perform the function selected by the selection model, using the control model for the selected function;
• and
• if the selection model does not provide a selection of a function, receiving user input indicating a selection of a function, selecting a function according to the selection indicated by the user input, controlling the robot device to perform the function selected according to the selection indicated by the user input using the control model for the selected function. and training the selection model according to the selection indicated by the user input.