Condensed spoken utterances for automated assistant control of an intricate application gui

A system comprising:

• memory storing instructions;
• one or more processors operable to execute the instructions to:
• receive a spoken utterance that is provided via a computing device and that is intended for controlling a GUI element;
• and
• access content description data that characterizes GUI elements that are displayed via a display of the computing device when the spoken utterance is provided,
• wherein the content description data is not displayed via the display,
• determine, based on processing the spoken utterance and the content description data that characterizes the GUI elements displayed at the display, that the spoken utterance is directed to a particular GUI element of the GUI elements displayed at the display,
• wherein processing the spoken utterance and the content description data is in response to receiving the spoken utterance when the GUI elements, characterized by the content description data, are displayed via the display of the computing device;
• in response to determining that the spoken utterance is directed to the particular GUI element of the GUI elements displayed at the display:
• control the particular GUI element in accordance with the spoken utterance.