Voice Query QoS Based On Client-Computed Content Metadata

A system comprising:

• data processing hardware of a query processing backend;
• and
• memory hardware in communication with the data processing hardware and storing instructions that when executed on the data processing hardware cause the data processing hardware to perform operations comprising:
• receiving an automated speech recognition (ASR) request from a user device, the ASR request comprising:
• a speech input captured by the user device that includes a voice query;
• and
• content metadata associated with the speech input, the content metadata generated by the user device;
• determining a priority score for the ASR request based on the content metadata associated with the speech input;
• caching the ASR request in a pre-processing backlog of pending ASR requests each having a corresponding priority score, the pending ASR requests in the pre-processing backlog ranked in order of the priority scores;
• and
• providing, from the pre-processing backlog, one or more of the pending ASR requests to a backend-side ASR module based on processing availability of the backend-side ASR module, wherein pending ASR requests associated with higher priority scores are processed by the backend-side ASR module before pending ASR requests associated with lower priority scores.