Systems and methods for generating creative sketches using models guided by sketches and text

A non-transitory computer-readable medium comprising:

• instructions that when executed by a processor cause the processor to:
• generate an image from a sketched stroke and text inputted to a learning model, and remix the text to generate forms of the image from randomized seeds associated with design parameters;
• segment the image to identify boundary information with a segmentation model and extract edge information from the image using an edge model;
• render an estimated sketch of the image by computing an intersection between the boundary information and the edge information;
• and
• remove texture and redundant lines for locating natural borders associated with the boundary information and the intersection, wherein the intersection has areas within the image having visual data that are similar.

A method comprising:

• generating an image from a sketched stroke and text inputted to a learning model, and remixing the text to generate forms of the image from randomized seeds associated with design parameters;
• segmenting the image to identify boundary information with a segmentation model and extracting edge information from the image using an edge model;
• rendering an estimated sketch of the image by computing an intersection between the boundary information and the edge information;
• and
• removing texture and redundant lines for locating natural borders associated with the boundary information and the intersection, wherein the intersection has areas within the image having visual data that are similar.