Voice-based content design using generative artificial intelligence techniques

An apparatus comprising:

• at least one processing device comprising a processor coupled to a memory;
• the at least one processing device being configured to implement the following steps:
• accessing at least one data structure comprising information characterizing at least a portion of one or more vocal instructions of at least one user, wherein the one or more vocal instructions of the at least one user comprise one or more vocal instructions describing visual content to be generated, wherein the one or more vocal instructions describing the visual content to be generated comprise a vocal description of one or more visual properties of at least one object to be generated;
• applying at least a portion of the information to at least one generative artificial intelligence (AI) model, wherein the at least one generative AI model employs at least one processor-based content generator that generates visual content, comprising one or more generated objects, for a visual presentation to the at least one user, based at least in part on the one or more vocal instructions of the at least one user describing the visual content to be generated, and wherein, in response to at least one of a creation, a deletion and a modification of at least one generated object in the generated visual content by the one or more vocal instructions of the at least one user, the at least one generative AI model adds at least one visual reference point to the generated visual content, wherein the at least one visual reference point enables the at least one user to interact with the generated visual content to one or more of confirm, revisit and modify the at least one generated object;
• and
• modifying, using the at least one generative AI model, at least a portion of the generated visual content based at least in part on information characterizing at least one additional vocal instruction of the at least one user describing modifications to at least a portion of the generated visual content.

A non-transitory processor-readable storage medium having stored therein program code of one or more software programs, wherein the program code when executed by at least one processing device causes the at least one processing device to perform the following steps:

• accessing at least one data structure comprising information characterizing at least a portion of one or more vocal instructions of at least one user, wherein the one or more vocal instructions of the at least one user comprise one or more vocal instructions describing visual content to be generated, wherein the one or more vocal instructions describing the visual content to be generated comprise a vocal description of one or more visual properties of at least one object to be generated;
• applying at least a portion of the information to at least one generative artificial intelligence (AI) model, wherein the at least one generative AI model employs at least one processor-based content generator that generates visual content, comprising one or more generated objects, for a visual presentation to the at least one user, based at least in part on the one or more vocal instructions of the at least one user describing the visual content to be generated, and wherein, in response to at least one of a creation, a deletion and a modification of at least one generated object in the generated visual content by the one or more vocal instructions of the at least one user, the at least one generative AI model adds at least one visual reference point to the generated visual content, wherein the at least one visual reference point enables the at least one user to interact with the generated visual content to one or more of confirm, revisit and modify the at least one generated object;
• and
• modifying, using the at least one generative AI model, at least a portion of the generated visual content based at least in part on information characterizing at least one additional vocal instruction of the at least one user describing modifications to at least a portion of the generated visual content.