Using generative artificial intelligence models to implement voice-powered search engine

A computer program product comprising a non-transitory computer readable storage medium having instructions encoded thereon that, when executed by a processor, cause the processor to perform steps comprising:

• receiving, via a network and from a device associated with a user of an online system, an input command;
• processing the input command to generate a processed version of the input command in a textual form;
• generating a first prompt for input into a generative model, the first prompt including the processed version of the input command and a request for generating a first response including a set of structured fields that are associated with an intent of the user derived from the input command;
• requesting the generative model to generate, based on the first prompt, the first response including the set of structured fields, each structured field of the set of structured fields associated with a respective search type of a set of search types;
• generating a second prompt for input into a set of one or more generative models, the second prompt including the processed version of the input command, the first response, information about the user, information about a catalog of items, and a request for generating a second response including a respective value from a set of values for each structured field from the set of structured fields;
• requesting the set of one or more generative models to generate, based on the second prompt, the second response including the set of values for the set of structured fields;
• mapping the set of values for the set of structured fields into a search query having the set of structured fields;
• identifying, using the search query and from a database of the online system, a list of one or more items;
• generating, using information about the list of one or more items, a user interface signal;
• and
• sending, via the network, the user interface signal to the device associated with the user, wherein the sending the user interface signal causes the device associated with the user to display a user interface with the list of one or more items and one or more user interface elements, and wherein selection of a corresponding one of the one or more user interface elements causes addition of a corresponding item from the list of one or more items to an order.

A computer system comprising:

• a processor;
• and
• a non-transitory computer-readable storage medium having instructions that, when executed by the processor, cause the computer system to perform steps comprising:
• receiving, via a network and from a device associated with a user of an online system, an input command;
• processing the input command to generate a processed version of the input command in a textual form;
• generating a first prompt for input into a generative model, the first prompt including the processed version of the input command and a request for generating a first response including a set of structured fields that are associated with an intent of the user derived from the input command;
• requesting the generative model to generate, based on the first prompt, the first response including the set of structured fields, each structured field of the set of structured fields associated with a respective search type of a set of search types;
• generating a second prompt for input into a set of one or more generative models, the second prompt including the processed version of the input command, the first response, information about the user, information about a catalog of items, and a request for generating a second response including a respective value from a set of values for each structured field from the set of structured fields;
• requesting the set of one or more generative models to generate, based on the second prompt, the second response including the set of values for the set of structured fields;
• mapping the set of values for the set of structured fields into a search query having the set of structured fields;
• identifying, using the search query and from a database of the online system, a list of one or more items;
• generating, using information about the list of one or more items, a user interface signal;
• and
• sending, via the network, the user interface signal to the device associated with the user, wherein the sending the user interface signal causes the device associated with the user to display a user interface with the list of one or more items and one or more user interface elements, and wherein selection of a corresponding one of the one or more user interface elements causes addition of a corresponding item from the list of one or more items to an order.