Robot planning for gaps

A system comprising one or more computers and one or more storage devices storing instructions that are operable, when executed by the one or more computers, to cause the one or more computers to perform operations comprising:

• maintaining a library of pre-generated candidate actions that represent respective capabilities of one or more particular robots;
• receiving an initial task plan for performing a particular task, wherein the initial task plan includes a sequence of two or more actions that comprises a first action followed by a second action, and wherein the first action has a first effect that can be achieved following execution of the first action and the second action has a second precondition that must be satisfied prior to execution of the second action;
• processing the initial task plan to determine that the first effect of the first action does not result in satisfaction of the second precondition of the second action, and that the initial task plan is missing one or more intermediate actions between the first action and the second action that are required for performing the particular task with the one or more particular robots, wherein processing the initial task plan comprises iterating through the sequence of two or more actions specified by the initial task plan and keeping track of a latest state of a workcell that includes the one or more particular robots, the latest state of the workcell reflecting the first effect of the first action;
• selecting, based on the first effect of the first action and the second precondition of the second action, one or more selected pre-generated candidate actions from the library of pre-generated candidate actions;
• modifying the initial task plan to include the one or more selected pre-generated candidate actions as the intermediate actions to generate a final task plan to be executed by the one or more particular robots when performing the particular task;
• and
• controlling the one or more particular robots to perform the particular task based on the final task plan.

A computer storage medium encoded with a computer program, the program comprising instructions that are operable, when executed by data processing apparatus, to cause the data processing apparatus to perform operations comprising:

• maintaining a library of pre-generated candidate actions that represent respective capabilities of one or more particular robots;
• receiving an initial task plan for performing a particular task, wherein the initial task plan includes a sequence of two or more actions that comprises a first action followed by a second action, and wherein the first action has a first effect that can be achieved following execution of the first action and the second action has a second precondition that must be satisfied prior to execution of the second action;
• processing the initial task plan to determine that the first effect of the first action does not result in satisfaction of the second precondition of the second action, and that the initial task plan is missing one or more intermediate actions between the first action and the second action that are required for performing the particular task with the one or more particular robots, wherein processing the initial task plan comprises iterating through the sequence of two or more actions specified by the initial task plan and keeping track of a latest state of a workcell that includes the one or more particular robots, the latest state of the workcell reflecting the first effect of the first action;
• selecting, based on the first effect of the first action and the second precondition of the second action, one or more selected pre-generated candidate actions from the library of pre-generated candidate actions;
• modifying the initial task plan to include the one or more selected pre-generated candidate actions as the intermediate actions to generate a final task plan to be executed by the one or more particular robots when performing the particular task;
• and
• controlling the one or more particular robots to perform the particular task based on the final task plan.