# US 2024/0185848 A1 · Generating a group automated assistant session to provide content to a plurality of users via headphones

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2024/0185848 A1
- Document ID: US20240185848A1
- Status: Published application
- Kind: A1
- Application number: 18/075,155
- Filed: 2022-12-05
- Published: 2024-06-06
- Earliest claimed: 2022-12-05
- Assignees: Google Inc.
- Applicants: Google LLC
- Inventors: Victor Carbune; Matthew Sharifi
- Web page: https://patentgrep.com/patent/US20240185848A1

## CPC

- G06F 3/167: {Audio in a user interface, e.g. using voice commands for navigating, audio feedback}
- G10L 15/22: Procedures used during a speech recognition process, e.g. man-machine dialogue
- G06F 3/165: {Management of the audio stream, e.g. setting of volume, audio stream path}
- G10L 2015/223: {Execution procedure of a spoken command}
- G10L 2015/225: {Feedback of the input speech}
- G10L 2015/228: {of application context}
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING

## Abstract

Systems and methods for creating a group automated assistant session and processing requests that are intended for the users that are included in the group. A plurality of users can indicate intentions to create a group session that includes selecting an automated assistant, from the automated assistants executing on the devices of the user and providing the selected automated assistant with audio data that is captured by microphones of the user devices. In response, the selected automated assistant processes the audio data and generates a response that is provided, via one or more speakers of the device that is executing the selected automated assistant. Further, fulfillment data is provided to the automated assistants executing on other devices and, in response to being provided the fulfillment data, each automated assistant causes audio data to be rendered, via one or more speakers of each respective device, that is responsive to the request.

## Claims

### Claim 1

A method, implemented by one or more processors, comprising:
receiving a first indication from a first user of intent to join a group automated assistant session, wherein the first indication is provided via a first client device executing a first automated assistant, and wherein the first client device is paired with a first headphone, and wherein audio responses of the first automated assistant are rendered to the first user via the first headphone;
receiving a second indication from a second user of intent to join the group automated assistant session, wherein the second indication is provided via a second client device executing a second automated assistant, wherein the second client device is paired with a second headphone, and wherein audio responses of the second automated assistant are rendered to the second user via the second headphone;
selecting the first automated assistant as a primary automated assistant for the group automated assistant session;
in response to receiving the first indication and the second indication:
creating the group automated assistant session, wherein while the group automated assistant session is active, the primary automated assistant is configured to receive group requests from both the first user and the second user, and cause group responses to be rendered to both the first user and the second user;
receiving, by the primary automated assistant during the group automated assistant session, audio data captured by a first microphone, associated with the first client device and/or captured by a second microphone, associated with the second client device;
processing, by the primary automated assistant, the audio data to determine that the audio data includes a group request;
generating, by the primary automated assistant, an audio response that is responsive to the group request;
causing the audio response to be rendered via the first headphone in response to the group request; and
providing, to the second automated assistant, fulfillment data that causes the second automated assistant to render the audio response via the second headphone in response to the group request.

### Claim 2 (depends on 1)

The method of claim 1, wherein the group automated assistant session is further created in response to the first microphone and/or the second microphone capturing audio data that includes a group invocation phrase.

### Claim 3 (depends on 1)

The method of claim 1, wherein at least one of the first indication and the second indication is an active group session mode.

### Claim 4 (depends on 1)

The method of claim 1, wherein at least one of the first indication and the second indication indicates that the first client device is within a threshold distance from the second client device.

### Claim 5 (depends on 1)

The method of claim 1, further comprising:
determining that the first client device and the second client device are no longer within the threshold distance; and
ending the group automated assistant session.

### Claim 6 (depends on 1)

The method of claim 1, wherein the request is for audio playback, and wherein the audio response is playback of audio data to the users.

### Claim 7 (depends on 1)

The method of claim 1, further comprising:
receiving, by a third client device, executing a third automated assistant, a third indication from a third user of intent to join a group automated assistant session, wherein the third client device is paired with a third headphone, and wherein audio responses of the first automated assistant are rendered to the third user via the third headphone.

### Claim 8 (depends on 7)

The method of claim 7, further comprising:
providing, via the third headphone, a summary of one or more previous requests and/or responses of the group automated assistant session.

### Claim 9 (depends on 1)

The method of claim 1, wherein at least one of the first indication and the second indication is a calendar entry of the first user and/or the second user.

### Claim 10 (depends on 1)

The method of claim 1, further comprising:
receiving, by the primary automated assistant during the group automated assistant session, audio data captured by the first microphone;
processing, by the primary automated assistant, the audio data to determine that the audio data includes a private request, wherein the private request is intended only for the first user;
generating, by the primary automated assistant, an audio response that is responsive to the private request; and
causing the audio response to be rendered via the first headphone in response to the group request without providing, to the second automated assistant, fulfillment data.

### Claim 11 (depends on 1)

The method of claim 1, wherein the first indication and the second indication are received by a third device in communication with the first client device and the second client device.

### Claim 12 (depends on 1)

The method of claim 1, wherein the first indication and the second indication are received by the first client device.

### Claim 13

A system, comprising:
a first client device, wherein the first client device is executing a first automated assistant, wherein the first client device is paired with a first headphone, and wherein audio responses of the first automated assistant are rendered to a first user via the first headphone;
a second client device, wherein the second client device is executing a second automated assistant, wherein the second client device is paired with a second headphone, and wherein audio responses of the second automated assistant are rendered to a second user via the second headphone; and
a group automated assistant client, wherein the group automated assistant client is configured to:
receive a first indication from the first client device of intent to join a group automated assistant session;
receive a second indication from a second client device of intent to join the group automated assistant session;
select a primary automated assistant for the group; and
in response to receiving the first indication and the second indication:
create the group automated assistant session, wherein while the group automated assistant session is active, the primary automated assistant is configured to receive group requests from both the first user and the second user, and cause group responses to be rendered to both the first user and the second user.

### Claim 14 (depends on 13)

The system of claim 13, wherein the primary automated assistant is the first automated assistant.

### Claim 15 (depends on 13)

The system of claim 13, wherein the group automated assistant client is executing on one of the first client device and/or the second client device.

### Claim 16 (depends on 13)

The system of claim 13, wherein the group automated assistant client is executing on a remote device in communication with the first client device and the second client device.

### Claim 17 (depends on 13)

The system of claim 13, wherein the primary automated assistant is further configured to:
receive, during the group automated assistant session, audio data captured by a first microphone, associated with the first client device and/or captured by a second microphone, associated with the second client device;
process the audio data to determine that the audio data includes a group request;
generate an audio response that is responsive to the group request;
cause the audio response to be rendered via the first headphone in response to the group request; and
cause the audio response to be rendered via the second headphone in response to the group request.

### Claim 18

At least one non-transitory computer-readable medium comprising instructions that, in response to execution of the instructions by one or more processors, cause the one or more processors to perform the following operations:
receiving a first indication from a first user of intent to join a group automated assistant session, wherein the first indication is provided via a first client device executing a first automated assistant, and wherein the first client device is paired with a first headphone, and wherein audio responses of the first automated assistant are rendered to the first user via the first headphone;
receiving a second indication from a second user of intent to join the group automated assistant session, wherein the second indication is provided via a second client device executing a second automated assistant, wherein the second client device is paired with a second headphone, and wherein audio responses of the second automated assistant are rendered to the second user via the second headphone;
selecting the first automated assistant as a primary automated assistant for the group automated assistant session;
in response to receiving the first indication and the second indication:
creating the group automated assistant session, wherein while the group automated assistant session is active, the primary automated assistant is configured to receive group requests from both the first user and the second user, and cause group responses to be rendered to both the first user and the second user;
receiving, by the primary automated assistant during the group automated assistant session, audio data captured by a first microphone, associated with the first client device and/or captured by a second microphone, associated with the second client device;
processing, by the primary automated assistant, the audio data to determine that the audio data includes a group request;
generating, by the primary automated assistant, an audio response that is responsive to the group request;
causing the audio response to be rendered via the first headphone in response to the group request; and
providing, to the second automated assistant, fulfillment data that causes the second automated assistant to render the audio response via the second headphone in response to the group request.

### Claim 19 (depends on 18)

The at least one non-transitory computer-readable medium of claim 18, wherein the first indication and the second indication are received by a third device in communication with the first client device and the second client device.

### Claim 20 (depends on 18)

The at least one non-transitory computer-readable medium of claim 18, wherein the first indication and the second indication are received by the first client device.
