Generating structured user interface elements by applying generative model to unstructured text received in messaging interface

A computer program product comprising a non-transitory computer readable storage medium having instructions encoded thereon that, when executed by a processor, cause the processor to perform steps comprising:

• maintaining an order associated with a user, the order assigned to a picker and comprising a list of items;
• establishing a communication interface between a user device of the user and a picker device of the picker, wherein the communication interface enables messaging between the user device and the picker device;
• receiving, from the user device via the communication interface, a user request message comprising unstructured text;
• prompting, with a first prompt, one or more generative models to identify a type of request corresponding to the user request message , the first prompt comprising at least a portion of the unstructured text of the user request message and an instruction to identify the type of request the type of request comprising at least one of:
• a request to add an item to the order, a request to remove an item from the order, or a request to modify an item in the order;
• prompting, with a second prompt, the one or more generative models to generate an action plan , the second prompt comprising at least a portion of the user request message and the identified type of request;
• generating an interface element describing the action plan;
• transmitting the interface element to the user device of the user via the communication interface, the transmitting causing the user device to display the interface element;
• receiving a confirmation signal from the user device indicating that the user selected the interface element;
• and
• responsive to receiving the confirmation signal, modifying the order based on the generated action plan.

A system comprising:

• a processor;
• and
• a non-transitory computer readable storage medium having instructions encoded thereon that, when executed by the processor, cause the processor to perform steps comprising:
• maintaining an order associated with a user, the order assigned to a picker and comprising a list of items;
• establishing a communication interface between a user device of the user and a picker device of the picker, wherein the communication interface enables messaging between the user device and the picker device;
• receiving, from the user device via the communication interface, a user request message comprising unstructured text;
• prompting, with a first prompt, one or more generative models to identify a type of request corresponding to the user request message , the first prompt comprising at least a portion of the unstructured text of the user request message and an instruction to identify the type of request the type of request comprising at least one of:
• a request to add an item to the order, a request to remove an item from the order, or a request to modify an item in the order;
• prompting, with a second prompt, the one or more generative models to generate an action plan , the second prompt comprising at least a portion of the user request message and the identified type of request;
• generating an interface element describing the action plan;
• transmitting the interface element to the user device of the user via the communication interface, the transmitting causing the user device to display the interface element;
• receiving a confirmation signal from the user device indicating that the user selected the interface element;
• and
• responsive to receiving the confirmation signal, modifying the order based on the generated action plan.