# US 2024/0402988 A1 · Verifying operational statuses of agents interfacing with digital assistant applications

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2024/0402988 A1
- Document ID: US20240402988A1
- Status: Published application
- Kind: A1
- Application number: 18/806,064
- Filed: 2024-08-15
- Published: 2024-12-05
- Earliest claimed: 2019-11-06
- Assignees: Google Inc.
- Applicants: Google LLC
- Inventors: Quazi Hussain; Nikhil Rao
- Web page: https://patentgrep.com/patent/US20240402988A1

## CPC

- G06F 3/167: {Audio in a user interface, e.g. using voice commands for navigating, audio feedback}
- G06F 11/302: {where the computing system component is a software system}
- G06F 11/3089: {Monitoring arrangements determined by the means or processing involved in sensing the monitored data, e.g. interfaces, connectors, sensors, probes, agents (software debugging using additional hardware using a specific debug interface G06F11/3656; performance evaluation by tracing or monitoring G06F11/3466)}
- G06F 11/3409: {for performance assessment}
- G06F 11/3476: {Data logging (G06F11/14, G06F11/2205 take precedence)}
- G06F 40/20: Natural language analysis (semantic analysis of natural language G06F40/30)
- G06F 40/216: using statistical methods
- G06F 40/295: Named entity recognition
- G06F 40/35: Discourse or dialogue representation
- G10L 15/22: Procedures used during a speech recognition process, e.g. man-machine dialogue
- H04L 43/0817: by checking functioning
- H04L 43/10: Active monitoring, e.g. heartbeat, ping or trace-route
- H04L 43/55: Testing of service level quality, e.g. simulating service usage
- G10L 2015/223: {Execution procedure of a spoken command}
- Y02D 10/00: Energy efficient computing, e.g. low power processors, power management or thermal management
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)
- Y02D: CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE

## Abstract

The present disclosure is generally related to a data processing system to determine operational statuses of agents interfacing with digital assistant applications. The data processing system can access a log database. The log database can maintain response metrics for an agent service. Each response metric can correspond to a response by the agent service to a request generated by a digital assistant application responsive to an input audio signal. The data processing system can transmit a ping request to the agent service and can wait for a second response from the agent service. The data processing system can determine an operational status of the agent service based on the response metrics and on a time elapsed since the transmission of the ping request. The data processing system can cause the digital assistant application to perform an action based on the operational status.

## Claims

### Claim 1

A method implemented by one or more processors, the method comprising:
receiving, by a digital assistant application, an input audio signal;
parsing the input audio signal to identify a request that is fulfillable by an agent service interfacing with the digital assistant application;
identifying, based on a configuration instruction received, from a monitoring service, by the digital assistant application prior to receiving the input audio signal, that an operational status of the agent service is unresponsive, wherein the configuration instruction includes an identification of an alternative agent service;
avoiding, by the digital assistant application, invocation of the agent service, in response to identifying that the operational status of the agent service is unresponsive based on the configuration instruction, wherein avoiding invocation of the agent service comprises avoiding sending, to the agent service, the request based on the input audio signal; and
identifying an action the digital assistant application is to perform, based on the configuration instruction that includes the identification of the alternative agent service and that is received by the digital assistant application.

### Claim 2 (depends on 1)

The method according to claim 1, wherein the identifying the action comprises presenting the operational status of the agent service as unresponsive.

### Claim 3 (depends on 1)

The method according to claim 1, wherein the identifying the action comprises identifying the alternative agent service to fulfill the request.

### Claim 4 (depends on 3)

The method according to claim 3, wherein the identifying the action further comprises presenting an output that indicates the alternative agent service.

### Claim 5 (depends on 4)

The method according to claim 4, wherein an operational status of the alternative agent service is identified as responsive.

### Claim 6 (depends on 4)

The method according to claim 4, further comprising:
receiving, by the digital assistant application, a subsequent input audio signal;
parsing the subsequent input audio signal to identify a selection of the alternative agent service to fulfill the request; and
in response to the selection of the alternative agent service, invoking the alternative agent service to fulfill the request.

### Claim 7

A computer program product comprising one or more non-transitory computer-readable storage media having program instructions collectively stored on the one or more computer-readable storage media, the program instructions executable to:
receive, by a digital assistant application, an input audio signal;
parse the input audio signal to identify a request that is fulfillable by an agent service interfacing with the digital assistant application;
identify, based on a configuration instruction received, from a monitoring service, by the digital assistant application prior to receiving the input audio signal, that an operational status of the agent service is unresponsive, wherein the configuration instruction includes an identification of an alternative agent service;
avoid, by the digital assistant application, invocation of the agent service, in response to identifying that the operational status of the agent service is unresponsive based on the configuration instruction, wherein avoiding invocation of the agent service comprises avoiding sending, to the agent service, the request based on the input audio signal; and
identify an action the digital assistant application is to perform, based on the configuration instruction that includes the identification of the alternative agent service and that is received by the digital assistant application.

### Claim 8 (depends on 7)

The computer program product according to claim 7, wherein the identifying the action comprises presenting the operational status of the agent service as unresponsive.

### Claim 9 (depends on 7)

The computer program product according to claim 7, wherein the identifying the action comprises identifying the alternative agent service to fulfill the request.

### Claim 10 (depends on 9)

The computer program product according to claim 9, wherein the identifying the action further comprises presenting an output that indicates the alternative agent service.

### Claim 11 (depends on 10)

The computer program product according to claim 10, wherein an operational status of the alternative agent service is identified as responsive.

### Claim 12 (depends on 10)

The computer program product according to claim 10, the program instructions further being executable to:
receive, by the digital assistant application, a subsequent input audio signal;
parse the subsequent input audio signal to identify a selection of the alternative agent service to fulfill the request; and
in response to the selection of the alternative agent service, invoke the alternative agent service to fulfill the request.

### Claim 13

A system comprising:
a processor, a computer-readable memory, one or more computer-readable storage media, and program instructions collectively stored on the one or more computer-readable storage media, the program instructions executable to:
receive, by a digital assistant application, an input audio signal;
parse the input audio signal to identify a request that is fulfillable by an agent service interfacing with the digital assistant application;
identify, based on a configuration instruction received, from a monitoring service, by the digital assistant application prior to receiving the input audio signal, that an operational status of the agent service is unresponsive, wherein the configuration instruction includes an identification of an alternative agent service;
avoid, by the digital assistant application, invocation of the agent service, in response to identifying that the operational status of the agent service is unresponsive based on the configuration instruction, wherein avoiding invocation of the agent service comprises avoiding sending, to the agent service, the request based on the input audio signal; and
identify an action the digital assistant application is to perform, based on the configuration instruction that includes the identification of the alternative agent service and that is received by the digital assistant application.

### Claim 14 (depends on 13)

The system according to claim 13, wherein the identifying the action comprises presenting the operational status of the agent service as unresponsive.

### Claim 15 (depends on 13)

The system according to claim 13, wherein the identifying the action comprises identifying the alternative agent service to fulfill the request.

### Claim 16 (depends on 15)

The system according to claim 15, wherein the identifying the action further comprises presenting an output that indicates the alternative agent service.

### Claim 17 (depends on 16)

The system according to claim 16, wherein an operational status of the alternative agent service is identified as responsive.

### Claim 18 (depends on 16)

The system according to claim 16, the program instructions further being executable to:
receive, by the digital assistant application, a subsequent input audio signal;
parse the subsequent input audio signal to identify a selection of the alternative agent service to fulfill the request; and
in response to the selection of the alternative agent service, invoke the alternative agent service to fulfill the request.
