# US 2024/0004608 A1 · Automatic adjustment of muted response setting

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2024/0004608 A1
- Document ID: US20240004608A1
- Status: Published application
- Kind: A1
- Application number: 18/369,627
- Filed: 2023-09-18
- Published: 2024-01-04
- Earliest claimed: 2020-09-02
- Assignees: Google Inc.
- Applicants: Google LLC
- Inventors: Michael Schaer; Vitaly Gatsko; Ágoston Weisz
- Web page: https://patentgrep.com/patent/US20240004608A1

## CPC

- G06F 3/165: {Management of the audio stream, e.g. setting of volume, audio stream path}
- G06F 3/167: {Audio in a user interface, e.g. using voice commands for navigating, audio feedback}
- G06F 16/3329: Natural language query formulation
- G06F 16/90332: {Natural language query formulation or dialogue systems}
- G06F 16/909: using geographical or spatial information, e.g. location (spatiotemporally dependent retrieval from the web G06F16/9537)
- G10L 15/22: Procedures used during a speech recognition process, e.g. man-machine dialogue
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING

## Abstract

Techniques enable an automatic adjustment of a muted response setting of an automated assistant based on a determination of an expectation by a user to hear an audible response to their query, despite the muted setting. Determination of the expectation may be based on historical, empirical data uploaded from multiple users over time for a given response scenario. For example, the system may determine from the historical data that a certain type of query has been associated with a user both repeating their query and increasing a response volume setting within a given timeframe. Metrics may be generated, stored, and invoked in response to attributes associated with identifiable types of queries and query scenarios. Automated response characteristics meant to reduce inefficiencies may be associated with certain queries that can otherwise collectively burden network bandwidth and processing resources.

## Claims

### Claim 1

A method implemented using one or more processors, comprising:
receiving a query from a user via a user interface of a computing device;
determining, by an automated assistant of the computing device, that a response volume setting of the computing device is muted;
identifying, based on a digital calendar dataset, a context of the user during one or more time periods;
determining, based on the context of the user and based on a time period during which the query was received, whether an audible response, for audible perception of the response by the user, by the automated assistant at the computing device, is appropriate; and
in response to determining that an audibly rendered response is appropriate, and in response to determining that the computing device is muted:
determining to override the response volume setting to provide the audibly rendered response to the user, and
rendering, at the computing device, the audible response to the query.

### Claim 2 (depends on 1)

The method of claim 1, further comprising:
determining that, among multiple computing devices, the computing device is closest to the user at a time of the spoken query, wherein the determining whether the audible response is appropriate is further based on the determining that the computing device is closest to the user at the time of the spoken query.

### Claim 3 (depends on 1)

The method of claim 1, wherein identifying the context of the user during one or more time periods further comprises:
identifying one or more visual cues detected in an image frame derived from one or more image sensors of the computing device, concurrent or subsequent to receiving the query from the user, and
determining if the context of the user, corresponds with the visual cues.

### Claim 4 (depends on 1)

The method of claim 1, further comprising:
in response to determining that the audibly rendered response is not appropriate:
rendering, at the computing device, a visual response to the query.

### Claim 5 (depends on 1)

The method of claim 1, wherein the context of the user includes a meeting period that the user is known to be scheduled to participate based on the digital calendar dataset.

### Claim 6 (depends on 5)

The method of claim 5, further comprising:
subsequent to identifying the context of the user during one or more time periods:
determining to postpone response to the query for a threshold duration of time; and
prior to determining whether the audibly rendered response is appropriate:
identifying that the threshold duration of time has passed.

### Claim 7 (depends on 6)

The method of claim 6, wherein the threshold duration of time is based on a duration of the meeting period of the user.

### Claim 8

A system comprising:
one or more computers and one or more storage devices storing instructions that are operable, when executed by the one or more computers, to cause the one or more computers to perform operations comprising:
receiving a query from a user via a user interface of a computing device;
determining, by an automated assistant of the computing device, that a response volume setting of the computing device is muted;
identifying, based on a digital calendar dataset, a context of the user during one or more time periods;
determining, based on the context of the user and based on a time period during which the query was received, whether an audible response, for audible perception of the response by the user, by the automated assistant at the computing device, is appropriate; and
in response to determining that an audibly rendered response is appropriate, and in response to determining that the computing device is muted:
determining to override the response volume setting to provide the audibly rendered response to the user, and
rendering, at the computing device, the audible response to the query.

### Claim 9 (depends on 8)

The system of claim 8, wherein the operations further comprise:
determining that, among multiple computing devices, the computing device is closest to the user at a time of the spoken query, wherein the determining whether the audible response is appropriate is further based on the determining that the computing device is closest to the user at the time of the spoken query.

### Claim 10 (depends on 8)

The system of claim 8, wherein identifying the context of the user during one or more time periods further comprises:
identifying one or more visual cues detected in an image frame derived from one or more image sensors of the computing device, concurrent or subsequent to receiving the query from the user, and
determining if the context of the user, corresponds with the visual cues.

### Claim 11 (depends on 8)

The system of claim 8, wherein the operations further comprise:
in response to determining that the audibly rendered response is not appropriate:
rendering, at the computing device, a visual response to the query.

### Claim 12 (depends on 8)

The system of claim 8, wherein the context of the user includes a meeting period that the user is known to be scheduled to participate based on the digital calendar dataset.

### Claim 13 (depends on 12)

The system of claim 12, wherein the operations further comprise:
subsequent to identifying the context of the user during one or more time periods:
determining to postpone response to the query for a threshold duration of time; and
prior to determining whether the audibly rendered response is appropriate:
identifying that the threshold duration of time has passed.

### Claim 14 (depends on 13)

The system of claim 13, wherein the threshold duration of time is based on a duration of the meeting period of the user.

### Claim 15

A non-transitory computer-readable medium storing software comprising instructions executable by one or more computers which, upon such execution, cause the one or more computers to perform operations comprising:
receiving a query from a user via a user interface of a computing device;
determining, by an automated assistant of the computing device, that a response volume setting of the computing device is muted;
identifying, based on a digital calendar dataset, a context of the user during one or more time periods;
determining, based on the context of the user and based on a time period during which the query was received, whether an audible response, for audible perception of the response by the user, by the automated assistant at the computing device, is appropriate; and
in response to determining that an audibly rendered response is appropriate, and in response to determining that the computing device is muted:
determining to override the response volume setting to provide the audibly rendered response to the user, and
rendering, at the computing device, the audible response to the query.

### Claim 16 (depends on 15)

The non-transitory computer-readable medium of claim 15, wherein the operations further comprise:
determining that, among multiple computing devices, the computing device is closest to the user at a time of the spoken query, wherein the determining whether the audible response is appropriate is further based on the determining that the computing device is closest to the user at the time of the spoken query.

### Claim 17 (depends on 15)

The non-transitory computer-readable medium of claim 15, wherein identifying the context of the user during one or more time periods further comprises:
identifying one or more visual cues detected in an image frame derived from one or more image sensors of the computing device, concurrent or subsequent to receiving the query from the user, and
determining if the context of the user, corresponds with the visual cues.

### Claim 18 (depends on 15)

The non-transitory computer-readable medium of claim 15, wherein the operations further comprise:
in response to determining that the audibly rendered response is not appropriate:
rendering, at the computing device, a visual response to the query.

### Claim 19 (depends on 15)

The non-transitory computer-readable medium of claim 15, wherein the context of the user includes a meeting period that the user is known to be scheduled to participate based on the digital calendar dataset.

### Claim 20 (depends on 19)

The non-transitory computer-readable medium of claim 19, wherein the operations further comprise:
subsequent to identifying the context of the user during one or more time periods:
determining to postpone response to the query for a threshold duration of time based on the meeting period of the user; and
prior to determining whether the audibly rendered response is appropriate:
identifying that the threshold duration of time has passed.
