Streaming real-time dialog management

A method comprising:

• receiving an initial chunk or a next chunk of a series of chunks, the series of chunks representing a live-stream of speech from a user;
• generating a first candidate responses based on receiving the chunk;
• updating, with at least one of the first candidate responses, a ranked list of candidate responses that, at the time of receipt of the chunk, are accepted or pending, the updated ranked list of candidate responses including one or more backend requests for one or more dialog schemas and one or more system responses generated by one or more of the dialog schemas;
• executing a backend request to two or more of the dialog schemas based on the updated ranked list;
• and
• subsequent to executing the backend request:
• generating backend responses based on information, for the two or more dialog schemas, obtained responsive to the backend request;
• deriving a composite candidate response from the two or more dialog schemas based on the generated backend responses;
• further updating the updated ranked list based on the composite candidate response;
• and
• pruning the further updated ranked list based on updated ranks of the candidate responses of the further updated ranked list.

A non-transitory computer-readable storage medium comprising instructions that, when executed, cause one or more processors to:

• receive an initial chunk or a next chunk of a series of chunks, the series of chunks representing a live-stream of speech from a user;
• generate a first candidate responses based on receiving the chunk;
• update, with at least one of the first candidate responses, a ranked list of candidate responses that, at the time of receipt of the chunk, are accepted or pending, the updated ranked list of candidate responses including one or more backend requests for one or more dialog schemas and one or more system responses generated by one or more of the dialog schemas;
• execute a backend request to two or more of the dialog schemas based on the updated ranked list;
• and
• subsequent to executing the backend request:
• generate backend responses based on information, for the two or more dialog schemas, obtained responsive to the backend request;
• derive a composite candidate response from the two or more dialog schemas based on the generated backend responses;
• further update the updated ranked list based on the composite candidate response;
• and
• prune the further updated ranked list based on updated ranks of the candidate responses of the further updated ranked list.