System and method for controlling motion of one or more devices

A method for controlling a motion of a device from an initial state to a target state in an environment having obstacles forming constraints on the motion of the device, the method comprising:

• executing a learned function trained with machine learning to generate a feasible or infeasible trajectory connecting the initial state of the device with the target state of the device while penalizing an extent of violation of at least some of the constraints to produce an initial trajectory, wherein the learned function is a neural network trained using reinforcement learning based on a reward function that penalizes the extent of violation of the constraints while allowing to produce the infeasible trajectory;
• solving a convex optimization problem subject to the constraints to produce an optimal trajectory that minimizes deviation from the initial trajectory;
• and
• controlling the motion of the device according to the optimal trajectory,
• wherein the environment comprises multiple devices with a respective target state, wherein the learned function is formulated for each of the multiple devices, and wherein the method further comprises:
• executing the learned function of each device to determine an initial trajectory for each device;
• solving a convex optimization problem of each device to determine an optimal trajectory for each device, wherein the optimal trajectory of each device minimizes deviation of the optimal trajectory from the corresponding initial trajectory;
• and
• controlling motion of each device based on the corresponding optimal trajectory to achieve the corresponding target state of each device.

A non-transitory computer-readable storage medium embodied thereon a program executable by a processor for performing a method for controlling a motion of a device from an initial state to a target state in an environment having obstacles forming constraints on the motion of the device, the method comprising:

• executing a learned function trained with machine learning to generate a feasible or infeasible trajectory connecting the initial state of the device with the target state of the device while penalizing an extent of violation of at least some of the constraints to produce an initial trajectory, wherein the learned function is a neural network trained using reinforcement learning based on a reward function that penalizes the extent of violation of the constraints while allowing to produce the infeasible trajectory;
• solving a convex optimization problem subject to the constraints to produce an optimal trajectory that minimizes deviation from the initial trajectory;
• and
• controlling the motion of the device according to the optimal trajectory,
• wherein the environment comprises multiple devices with a respective target state associated with each of the multiple devices, wherein the learned function is formulated for each of the multiple devices, and wherein the method further comprises:
• executing the learned function for each device of the multiple devices to determine an initial trajectory for each device;
• solving a joint-optimization problem to simultaneously determine an optimal trajectory of each device, wherein the optimal trajectory of each device minimizes deviation of the optimal trajectory of the corresponding device from the corresponding initial trajectory;
• and
• controlling motion of each device based on the corresponding optimal trajectory to achieve the corresponding target state of each device.