Method and apparatus for one-shot natural language processing using visual imagination

An apparatus comprising:

• at least one memory configured to store program code;
• and
• at least one processor configured to read the program code and operate as instructed by the program code, the program code comprising:
• receiving code configured to cause the at least one processor to receive a first input stream of a task and a second input stream of a solution,
• selecting code configured to cause the at least one processor to select the first input stream or the second input stream,
• providing code configured to cause the at least one processor to provide the selected input stream to an image conversion model and a language model,
• ensembling code configured to cause the at least one processor to create, based on the selected input stream, a model ensemble of the image conversion model and the language model, and
• outputting code configured to cause the at least one processor to output a prediction based on the model ensemble.

A non-transitory computer readable medium having instructions stored therein, which when executed by a processor cause the processor to execute a method comprising:

• receiving a first input stream of a task;
• receiving a second input stream of a solution;
• selecting the first input stream or the second input stream;
• providing the selected input stream to an image conversion model and a language model;
• creating, based on the selected input stream, a model ensemble of the image conversion model and the language model;
• and
• outputting a prediction based on the model ensemble.