Real time voice mode generative response engine with turn detection

A computing device associated with a cloud computing service, comprising:

• at least one network interface;
• and
• at least one processor coupled to the at least one network interface and configured to:
• receive digital audio frames from a client device, wherein a respective digital audio frame has a fixed duration;
• determine that a first portion of the digital audio frames includes speech of a user during a speech instance;
• transmit the first portion of the digital audio frames that includes the speech to a generative response engine while the digital audio frames are being received;
• when a single digital audio frame is identified as being silent, determine, using a conversation classifier, that the speech instance has concluded based on the single digital audio frame being silent and the first portion of the digital audio frames corresponding to an independent clause, wherein the conversation classifier is configured to identify the independent clause based on accumulated audio frames during the speech instance;
• and
• send a start signal to the generative response engine indicating to begin an inference operation associated with the speech based on the first portion of the digital audio frames and the single digital audio frame being silent.