# US 2021/0344666 A1 · Embedding content in audio content through a voice assistant

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0344666 A1
- Document ID: US20210344666A1
- Status: Published application
- Kind: A1
- Application number: 16/903,412
- Filed: 2020-06-17
- Published: 2021-11-04
- Earliest claimed: 2020-04-30
- Assignees: VMware, Inc.
- Applicants: Vmware, Inc.
- Inventors: ROHIT PRADEEP SHETTY; SHEETAL DEENADAYALAN; PON VENKATESH M
- Web page: https://patentgrep.com/patent/US20210344666A1

## CPC

- H04L 63/0815: {providing single-sign-on or federations}
- G06F 3/167: {Audio in a user interface, e.g. using voice commands for navigating, audio feedback}
- G10L 19/018: Audio watermarking, i.e. embedding inaudible data in the audio signal
- H04L 63/102: {Entity profiles}
- H04L 63/107: {wherein the security policies are location-dependent, e.g. entities privileges depend on current location or allowing specific operations only from locally connected terminals}
- H04L 63/0861: {using biometrical features, e.g. fingerprint, retina-scan (cryptographic mechanisms or cryptographic arrangements for entity authentication using biological data H04L9/3231)}
- H04L 2463/082: applying multi-factor authentication
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING

## Abstract

Disclosed are various approaches for authenticating a user through a voice assistant device and creating an association between the device and a user account. The request is associated with a network or federated service. The user can use a client device, such as a smartphone, to initiate an authentication flow. A passphrase is provided to the client device can captured by the client device and a voice assistant device. Audio captured by the client device and voice assistant device can be sent to an assistant connection service. The passphrase and an audio signature calculated from the audio can be validated. An association between the user account and the voice assistant device can then be created.

## Claims

### Claim 1

A system comprising:
at least one computing device;
at least one application that, when executed by the at least one application, causes the at least one computing device to at least:
receive a request to access a voice assistant service provided by the at least one application;
generate audio content associated with the request for playback through a voice assistant device;
obtain a uniform resource locator (URL), the URL linking to respective additional content in a service endpoint;
embed the URL into the audio content, wherein the URL detectable using a client device in proximity to a voice assistant device; and
cause the audio content to be played back by a speaker system of the voice assistant device, wherein the client device in proximity to the voice assistant device extracts the URL and accesses the respective additional content in the service endpoint.

### Claim 2 (depends on 1)

The system of claim 1, wherein the URL is inaudibly embedded into the audio content.

### Claim 3 (depends on 1)

The system of claim 1, wherein the URL is embedded into the audio content using an audio watermarking or a steganographic process.

### Claim 4 (depends on 1)

The system of claim 1, wherein the URL comprises a link to the service endpoint, and the service endpoint federates authentication to an identity provider in which a user account associated with the client device is stored.

### Claim 5 (depends on 4)

The system of claim 4, wherein the at least one application provides an authentication token corresponding to user account to the service endpoint on behalf of the user account.

### Claim 6 (depends on 5)

The system of claim 5, wherein a second client device in proximity to the voice assistant device extracts the URL, and the service endpoint provides respective additional content to the second client device that is different from the respective additional content provided to the client device.

### Claim 7 (depends on 6)

The system of claim 6, wherein the respective additional content to the second client device is different from the respective additional content provided to the client device based upon a first user account associated with the client device being different from a second client device associated with the second client device.

### Claim 8

A non-transitory computer-readable medium comprising machine-readable instructions, wherein the instructions, when executed by at least one processor, cause a computing device to at least:
receive a request to access a voice assistant service provided by the at least one application;
generate audio content associated with the request for playback through a voice assistant device;
obtain a uniform resource locator (URL), the URL linking to respective additional content in a service endpoint;
embed the URL into the audio content, wherein the URL detectable using a client device in proximity to a voice assistant device; and
cause the audio content to be played back by a speaker system of the voice assistant device, wherein the client device in proximity to the voice assistant device extracts the URL and accesses the respective additional content in the service endpoint.

### Claim 9 (depends on 8)

The non-transitory computer-readable medium of claim 8, wherein the URL is inaudibly embedded into the audio content.

### Claim 10 (depends on 8)

The non-transitory computer-readable medium of claim 8, wherein the URL is embedded into the audio content using an audio watermarking or a steganographic process.

### Claim 11 (depends on 8)

The non-transitory computer-readable medium of claim 8, wherein the URL comprises a link to the service endpoint, and the service endpoint federates authentication to an identity provider in which a user account associated with the client device is stored.

### Claim 12 (depends on 11)

The non-transitory computer-readable medium of claim 11, wherein the at least one application provides an authentication token corresponding to user account to the service endpoint on behalf of the user account.

### Claim 13 (depends on 12)

The non-transitory computer-readable medium of claim 12, wherein a second client device in proximity to the voice assistant device extracts the URL, and the service endpoint provides respective additional content to the second client device that is different from the respective additional content provided to the client device.

### Claim 14 (depends on 13)

The non-transitory computer-readable medium of claim 13, wherein the respective additional content to the second client device is different from the respective additional content provided to the client device based upon a first user account associated with the client device being different from a second client device associated with the second client device.

### Claim 15

A method comprising:
receiving a request to access a voice assistant service provided by the at least one application;
generating audio content associated with the request for playback through a voice assistant device;
obtaining a uniform resource locator (URL), the URL linking to respective additional content in a service endpoint;
embedding the URL into the audio content, wherein the URL detectable using a client device in proximity to a voice assistant device; and
causing the audio content to be played back by a speaker system of the voice assistant device, wherein the client device in proximity to the voice assistant device extracts the URL and accesses the respective additional content in the service endpoint.

### Claim 16 (depends on 15)

The method of claim 15, wherein the URL is inaudibly embedded into the audio content.

### Claim 17 (depends on 15)

The method of claim 15, wherein the URL is embedded into the audio content using an audio watermarking or a steganographic process.

### Claim 18 (depends on 15)

The method of claim 15, wherein the URL comprises a link to the service endpoint, and the service endpoint federates authentication to an identity provider in which a user account associated with the client device is stored.

### Claim 19 (depends on 18)

The method of claim 18, further comprising providing an authentication token corresponding to user account to the service endpoint on behalf of the user account.

### Claim 20 (depends on 19)

The method of claim 19, further comprising providing an authentication token corresponding to user account to the service endpoint on behalf of the user account, wherein a second client device in proximity to the voice assistant device extracts the URL, and the service endpoint provides respective additional content to the second client device that is different from the respective additional content provided to the client device.
