Generating cross-domain guidance for navigating hci's

A system comprising one or more processors and memory storing instructions that, in response to execution of the instructions, cause the one or more processors to:

• identify a domain of a first computer application that is operable using a first human-computer interface (HCI);
• based on the identified domain, select a domain model that translates between an action space of the first computer application and another space;
• based on the selected domain model, process an action embedding to generate one or more probability distributions over actions in the action space of the first computer application, wherein the action embedding represents a plurality of actions performed previously using a second HCI of a second computer application to perform a semantic task;
• based on the one or more probability distributions, identify a second plurality of actions that are performable using the first computer application;
• and
• cause output to be presented at one or more output devices, wherein the output includes guidance for navigating the first HCI to perform the semantic task using the first computer application, and wherein the guidance is based on the identified second plurality of actions that are performable using the first computer application.

A non-transitory computer-readable medium comprising instructions that, in response to execution of the instructions by a processor, cause the processor to:

• identify a domain of a first computer application that is operable using a first human-computer interface (HCI);
• based on the identified domain, select a domain model that translates between an action space of the first computer application and another space;
• based on the selected domain model, process an action embedding to generate one or more probability distributions over actions in the action space of the first computer application, wherein the action embedding represents a plurality of actions performed previously using a second HCI of a second computer application to perform a semantic task;
• based on the one or more probability distributions, identify a second plurality of actions that are performable using the first computer application;
• and
• cause output to be presented at one or more output devices, wherein the output includes guidance for navigating the first HCI to perform the semantic task using the first computer application, and wherein the guidance is based on the identified second plurality of actions that are performable using the first computer application.