Device-agnostic framework to measure reliability during user interactions
AssigneeGoogle Inc.
InventorsShashwat Lal Das, Prithwish Mukherjee, Xiaoyi Sheng, Zilong Huang, Prashant Gupta, Alexander Sparber
Life of this patent
Estimating the term…
Loading patent…
AssigneeGoogle Inc.
InventorsShashwat Lal Das, Prithwish Mukherjee, Xiaoyi Sheng, Zilong Huang, Prashant Gupta, Alexander Sparber
Estimating the term…
Implementations relate to retrieving and processing metadata associated with a user query directed to an interactive assistant application. Implementations further relate to classifying the user query using labels assigned to invocation stage, input-receiving stage, response-receiving stage, and/or response-rendering stage of the user query that are determined based on processing the metadata associated with the user query. Whether the user query can be applied to evaluate a performance (e.g., surface reliability) of the interactive assistant application can be determined based on the classification of the user query.
A method implemented using one or more processors, the method comprising:
A system comprising one or more processors and memory storing instructions that, when executed, cause the one or more processors to:
A system comprising one or more processors and memory storing instructions that, when executed, cause the one or more processors to:
Dependencies are inferred from the claim text.