US 11,909,611 B2 · Standardizing analysis metrics across multiple devices

Abstract

Implementations relate to generating standardized metrics from device specific metrics that are generated during an interaction between a user and an automated assistant. The metrics indicate events that occurred while processing an interaction of a user with the automated assistant and are specific to the particular configuration of the device with which the user is interacting. Conversion mappings are determined based on device characteristics that can be utilized to convert the device metrics into standardized metrics. Analysis metrics are generated based on the standardized metrics that are incapable of being generated from the device metrics. Some implementations include visually rendering the analysis metrics such that one or more of the analysis metrics are rendered more prominently than other metrics.

Claims18

Dependent claims

A method, performed by one or more processors, the method comprising:

identifying device-specific metrics generated during an interaction between a user and an automated assistant that is executing on a client device, wherein the device-specific metrics indicate timing of events that occurred during the interaction, including a device delay introduced by device hardware that is specific to the client device;
determining, based on one or more characteristics of the device hardware, a plurality of conversion mappings;
generating standardized metrics, wherein generating the standardized metrics includes converting one or more metrics of the device-specific metrics to one or more standard metrics using the conversion mappings;
and
causing a remote computing device to process the standardized metrics in generating analysis metrics, wherein the remote computing device is incapable of generating the analysis metrics from the device-specific metrics.

2 more elements

A method, performed by on one or more processors, the method comprising:

receiving, from a first client device, first device-specific metrics generated during a first interaction between a first user and a first instance of an automated assistant that is executing on the first client device, wherein the first device-specific metrics indicate timing of events that occurred during the first interaction, including a first device delay introduced by first device hardware that is specific to the first device;
receiving, from a second client device, second device-specific metrics generated during a second interaction between a second user and a second instance of the automated assistant that is executing on the second client device, wherein the second device-specific metrics indicate timing of events that occurred during the second interaction, including a second device delay introduced by second device hardware that is specific the second device, wherein the second device delay is different than the first device delay;
determining, based on one or more first characteristics of the first device hardware, a plurality of first conversion mappings;
determining, based on one or more second characteristics of the second device hardware, a plurality of second conversion mappings;
generating first standardized metrics, wherein generating the first standardized metrics includes converting one or more of the first device-specific metrics to one or more standard metrics using the first conversion mappings;
generating second standardized metrics, wherein generating the second standardized metrics includes converting one or more of the second device-specific metrics to one or more of the standard metrics using the second conversion mappings;
comparing at least one of the first standardized metrics to at least one of the second standardized metrics;
and
generating analysis metrics based on the comparison.

6 more elements

Dependencies are inferred from the claim text.

Standardizing analysis metrics across multiple devices

Life of this patent

Standardizing analysis metrics across multiple devices

Life of this patent

Abstract

Claims18