Efficient and low latency automated assistant control of smart devices

A client device comprising:

• one or more speakers;
• one or more microphones;
• one or more processors;
• memory storing computer-executable instructions which, when executed by the one or more processors, causes the one or more processors to perform a method comprising:
• storing, in a cache on the client device:
• a cache entry that includes a mapping of text to a semantic representation, wherein the semantic representation includes a locally interpretable semantic representation that is locally interpretable by the client device;
• capturing, via the one or more microphones, audio data that captures a spoken utterance;
• processing, using a voice-to-text model stored locally on the client device, the audio data to generate current text that corresponds to the spoken utterance;
• determining that the current text matches the text of the cache entry;
• and
• in response to determining that the current text matches the text of the cache entry, and in response to the cache entry including the mapping of the text to the semantic representation:
• processing, at the client device, the locally interpretable semantic representation to generate a given control command, the given control command differing from the locally interpretable semantic representation;
• and
• transmitting, via a local channel, the given control command to cause the altering of at least the given state of the given smart device.