# US 2023/0274103 A1 · Method for multi-channel audio synchronization for task automation

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2023/0274103 A1
- Document ID: US20230274103A1
- Status: Published application
- Kind: A1
- Application number: 18/315,027
- Filed: 2023-05-10
- Published: 2023-08-31
- Earliest claimed: 2020-11-23
- Assignees: NLX Inc.
- Applicants: NLX Inc.
- Inventors: Andrei PAPANCEA; Vlad PAPANCEA
- Web page: https://patentgrep.com/patent/US20230274103A1

## CPC

- G06F 3/167: {Audio in a user interface, e.g. using voice commands for navigating, audio feedback}
- G06F 40/58: Use of machine translation, e.g. for multi-lingual retrieval, for server-side translation for client devices or for real-time translation
- G06Q 30/016: After-sales
- G10L 15/005: {Language recognition}
- H04L 67/12: specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks
- H04M 3/5133: {Operator terminal details}
- H04M 3/5183: {Call or contact centers with computer-telephony arrangements}
- H04M 2201/22: Synchronisation circuits
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)
- H04M: TELEPHONIC COMMUNICATION (circuits for controlling other apparatus via a telephone cable and not involving telephone switching apparatus G08)

## Abstract

A method for coordinating actions between an audio channel and a synchronized non-audio channel includes receiving an indication of a start of a session associated with a user and having an audio channel that is synchronized with a non-audio channel. Thereafter, repeated determinations are made as to whether a prompt on the non-audio channel has been received from the user. In response to each determination that the prompt on the non-audio channel has not been received from the user, a signal is sent to cause an inaudible output on the audio channel to the user. In response to a determination that the prompt on the non-audio channel has been received from the user, an audible output is selected based on an activity by the user on the non-audio channel, and a signal is sent to cause the audible output to be output on the audio channel.

## Claims

### Claim 1

An apparatus, comprising:
a processor; and
a memory operably coupled to the processor, the memory storing instructions to cause the processor to:
receive an indication of a start of a session associated with a user and having an audio channel that is synchronized with a non-audio channel;
repeatedly determine, after the receiving, whether a prompt on the non-audio channel has been received from the user; and
send a signal to cause the audio channel to remain synchronized with the non-audio channel in response to each determination that the prompt on the non-audio channel has not been received from the user.

### Claim 2 (depends on 1)

The apparatus of claim 1, wherein the signal to cause the audio channel to remain synchronized with the non-audio channel further causes an inaudible output on the audio channel to the user in response to each determination that the prompt on the non-audio channel has not been received from the user.

### Claim 3 (depends on 1)

The apparatus of claim 1, wherein the memory further stores instructions to cause the processor to:
in response to a determination that the prompt on the non-audio channel has been received from the user, select an audible output based on an activity by the user on the non-audio channel;
select, at a first time, a first language from a plurality of languages; and
select, at a second time after the first time, a second language from the plurality of languages,
the selecting the audible output being based on the second language.

### Claim 4 (depends on 1)

The apparatus of claim 1, wherein:
the audio channel is associated with a first device type from a plurality of device types, the non-audio channel is associated with a second device type from the plurality of device types, and
the first device type includes a phone, a smart speaker, an earphone or an Internet of Things (IoT) device,
the second device type includes a phone, a smart speaker, an earphone or an IoT device,
the first device type being different from the second device type.

### Claim 5 (depends on 1)

The apparatus of claim 1, wherein the memory further stores instructions to cause the processor to:
in response to a determination that the prompt on the non-audio channel has been received from the user, select an audible output based on an activity by the user on the non-audio channel, and
receive, via an application programming interface (API), a signal from a device for the non-audio channel,
the selecting the audible output being based on the signal from the device for the non-audio channel.

### Claim 6 (depends on 4)

The apparatus of claim 4, wherein:
during a first time period, the non-audio channel is associated with and the selecting is performed with respect to a first digital non-audio channel, and
during a second time period after the first time period, the non-audio channel is associated with and the selecting is performed with respect to a second digital non-audio channel different from the first digital non-audio channel.

### Claim 7 (depends on 1)

The apparatus of claim 1, wherein the repeatedly determining and the sending the signal is repeated until an end of the session, the method further comprising:
after the start of the session and before the end of the session, performing at least one of:
determine that a prompt on the audio channel received from the user includes an indication that the user would like to discontinue the non-audio channel, or
determine that the prompt on the non-audio channel includes an indication that the user would like to discontinue the non-audio channel;
terminate the non-audio channel of the session, in response to the indication that the user would like to discontinue the non-audio channel; and
send, after the terminating, a signal to connect a communication device of the user with a communication device of a live agent.

### Claim 8

A non-transitory, processor-readable medium storing instructions to cause a processor to:
initiate a request for a session associated with a user to cause an audio channel associated with the session to synchronize with a non-audio channel associated with the session;
repeatedly determine whether a prompt on the non-audio channel has been received from the user; and
cause the audio channel to remain active during the session in response to each determination that the prompt on the non-audio channel has not been received from the user.

### Claim 9 (depends on 8)

The non-transitory, processor-readable medium of claim 8, wherein the instructions to cause the processor to cause the audio channel to remain active during the session further includes instructions to cause the processor to cause an inaudible output on the audio channel to the user in response to each determination that the prompt on the non-audio channel has not been received from the user.

### Claim 10 (depends on 8)

The non-transitory, processor-readable medium of claim 8, wherein the instructions includes instructions to cause the processor to:
cause an audible output to be output on the audio channel in response to a determination that the prompt on the non-audio channel has been received from the user,
the audible output includes a first portion associated with a first voice and a second portion associated with a second voice different than the first voice.

### Claim 11 (depends on 8)

The non-transitory, processor-readable medium of claim 8, wherein the instructions includes instructions to cause the processor to:
receive an indication from the user to end the session; and
cause a connection to a compute device associated with at least one of a live chat or a live agent.

### Claim 12 (depends on 8)

The non-transitory, processor-readable medium of claim 8, wherein the audio channel is associated with a first compute device, and the non-audio channel is associated with a second compute device different than the first compute device.

### Claim 13 (depends on 8)

The non-transitory, processor-readable medium of claim 8, wherein:
the initiating of the request, the repeatedly determining, and the causing is performed by a first compute device, and
the initiating of the request includes calling, via the first compute device, a phone number associated with a second compute device to cause the second compute device to generate the session.

### Claim 14 (depends on 8)

The non-transitory, processor-readable medium of claim 8, wherein the initiating of the request, the repeatedly determining, and the causing are performed by a voice assistant device, the instructions includes instructions to cause the processor to:
receive, by the voice assistant device, a voice command from the user that includes an indication of the request, the initiating of the request performed automatically in response to the receiving of the voice command.

### Claim 15

A method, comprising:
receiving a representation of a request from a compute device associated with a user to complete a task;
causing an audio channel associated with the user to synchronize with at least one non-audio channel associated with the user;
sending a first signal to cause a first audible output to be output by the audio channel;
repeatedly determining whether a prompt on the at least one non-audio channel has been received from the user;
sending a second signal to cause the audio channel to remain open in response to each determination that the prompt on the at least one non-audio channel has not been received from the user; and
in response to a determination that the prompt on the at least one non-audio channel has been received from the user:
selecting a second audible output based on a determination that the prompt is in accordance with the task,
selecting a third audible output based on a determination that the prompt is not in accordance with the task, and
sending a third signal to cause one of the second audible output or the third audible output to be output on the audio channel.

### Claim 16 (depends on 15)

The method of claim 15, wherein the second signal further causes an inaudible output to be output on the audio channel to the user in response to each determination that the prompt on the non-audio channel has not been received from the user.

### Claim 17 (depends on 15)

The method of claim 15, wherein the prompt is a first prompt, the method further comprising:
repeatedly determining whether a second prompt on the at least one non-audio channel has been received from the user;
sending a fourth signal to cause the inaudible output on the audio channel to the user in response to each determination that the second prompt on the at least one non-audio channel has not been received from the user; and
in response to the determination that the second prompt on the at least one non-audio channel has been received from the user:
selecting a fourth audible output based on an activity by the user on the at least one non-audio channel, and
sending a fourth signal to cause the fourth audible output to be output on the audio channel.

### Claim 18 (depends on 15)

The method of claim 15, wherein the compute device is a mobile device, the method further comprising:
transmitting a hyperlink to the mobile device via at least one of a text message or an email,
the causing of the audio channel associated with the user to synchronize with the at least one non-audio channel associated with the user performed automatically in response to the user selecting the hyperlink.

### Claim 19 (depends on 15)

The method of claim 15, wherein:
the audio channel is associated with a first device type from a plurality of device types,
the at least one non-audio channel is associated with a second device type from the plurality of device types,
the first device type includes a phone, a smart speaker, a speaker, an earphone or an Internet of Things (IoT) device,
the second device type includes a phone, a smart speaker, a speaker, an earphone or an IoT device,
the first device type is different from the second device type.

### Claim 20 (depends on 15)

The method of claim 15, wherein the compute device is a first compute device, the method further comprising:
causing a connection to a second compute device associated with at least one of a live chat or a live agent in response to an indication from the user to connect with at least one of the live chat or the live agent.
