# US 2021/0065743 A1 · Audio encoding for functional interactivity

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0065743 A1
- Document ID: US20210065743A1
- Status: Published application
- Kind: A1
- Application number: 17/097,001
- Filed: 2020-11-13
- Published: 2021-03-04
- Earliest claimed: 2017-10-24
- Assignees: Adori Labs, Inc.
- Applicants: Adori Labs, Inc.
- Inventors: Viswanathan IYER; Kartik PARIJA
- Web page: https://patentgrep.com/patent/US20210065743A1

## CPC

- G11B 20/12: Formatting, e.g. arrangement of data block or words on the record carriers {(within interface between computers and data recorders G06F3/06)}
- G06F 3/0482: Interaction with lists of selectable items, e.g. menus
- G06F 16/61: Indexing; Data structures therefor; Storage structures
- G06F 16/635: Filtering based on additional data, e.g. user or group profiles
- G06F 16/638: Presentation of query results
- G06F 16/686: {using information manually generated, e.g. tags, keywords, comments, title or artist information, time, location or usage information, user ratings}
- G11B 20/10527: {Audio or video recording; Data buffering arrangements (G11B20/12 - G11B20/18 take precedence)}
- H04H 20/31: using in-band signals, e.g. subsonic or cue signal
- H04H 60/33: Arrangements for monitoring the users' behaviour or opinions
- H04H 60/74: using programme related information, e.g. title, composer or interpreter
- H04N 21/4334: {Recording operations (recording of a television signal H04N5/76; arrangements for recording or accumulating broadcast information or broadcast-related information H04H60/27)}
- H04N 21/4398: {involving reformatting operations of audio signals (details of audio signal transcoding G10L19/173)}
- H04N 21/8352: involving content or source identification data, e.g. Unique Material Identifier [UMID]
- G10L 19/0018: {Speech coding using phonetic or linguistical decoding of the source; Reconstruction using text-to-speech synthesis}
- G11B 2020/1265: {Control data, system data or management information, i.e. data used to access or process user data}
- H04H 2201/37: via a different channel
- H04H 2201/40: characterised in that additional data relating to the broadcast data are available via a different channel than the broadcast channel
- G11B: INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER (recording measured values in a way that does not require playback through a transducer G01D9/00; recording or playback apparatus using mechanically marked tape, e.g. punched paper tape, or using unit records, e.g. punched or magnetically marked cards G06K; transferring data from one type of record carrier to another G06K1/18; circuits for coupling output of reproducer to radio receiver H04B1/20; gramophone pick-ups or like acoustic electromechanical transducers or circuits therefor H04R)
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- H04H: BROADCAST COMMUNICATION (multiplex communication H04J; pictorial communication aspects of broadcast systems H04N)
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING

## Abstract

Some examples include a computing device that receives media content to distribute to a plurality of electronic devices. The computing device may receive an indication of first data to relate to the media content for distribution to the plurality of electronic devices. A portion of the multimedia content may be decoded to enable a determination that the media content already has second data embedded in the media content. A psychoacoustic mask may be extracted from the media content and subtracted from the received media content to remove the embedded second data. The first data may be associated with the media content by either embedding third data in the media content, or by embedding the first data in the media content.

## Claims

### Claim 1

A system comprising:
an audio encoder able to embed data into audio content; and
a first computing device in communication with the audio encoder, the first computing device including a processor configured by executable instructions to perform operations comprising:
receiving audio content to distribute to a plurality of electronic devices;
receiving, an indication of first data to relate to the audio content for distribution to the plurality of electronic devices; and
causing the audio encoder to perform operations comprising:
decoding a portion of the audio content to enable a determination that the audio content already has second data embedded in the audio content;
extracting a psychoacoustic mask from the audio content;
subtracting the psychoacoustic mask from the received audio content to remove the embedded second data; and
one of:
associating the first data with the audio content by embedding third data in the audio content; or
embedding the first data in the audio content.

### Claim 2 (depends on 1)

The system as recited in claim 1, the operation of decoding the portion of the audio content to enable the determination that the audio content already has second data embedded in the audio content further comprising decoding the portion of the audio content to detect a start of frame indicator.

### Claim 3 (depends on 1)

The system as recited in claim 1, the operations further comprising:
based at least in part on determining that the first data exceeds a threshold size, sending, by the first computing device, the first data to a second computing device to provide for download to the electronic devices; and
associating the first data with the audio content by embedding third data in the audio content as embedded third data, the third data including information for identifying a location of the first data usable by the electronic devices to access the first data following extraction of the embedded third data.

### Claim 4 (depends on 1)

The system as recited in claim 1, the operation of embedding the third data in the audio content comprising, sending, by the first computing device, to the audio encoder, the third data to embed in the audio content, causing the audio encoder to modulate the psychoacoustic mask with the third data and add the modulated psychoacoustic mask to the media content as embedded third data.

### Claim 5 (depends on 1)

The system as recited in claim 1, the operations further comprising, based at least in part on determining that the first data is less than a threshold size, embedding the first data in the audio content.

### Claim 6 (depends on 1)

The system as recited in claim 1, the operations further comprising:
receiving, from the second computing device, information about a plurality of users of the plurality of electronic devices, respectively, based on the second computing device receiving communications from the plurality of electronic devices to access the first data based at least in part on the third data,
wherein the received information about the plurality of users includes at least one of location information, demographic information, listening duration information, or an action performed in response to at least one of the first data or the third data.

### Claim 7 (depends on 1)

The system as recited in claim 1, the operations further comprising sending the audio content with the embedded third data as at least one of:
streaming content sent over a network; or
broadcasted content sent as a radio wave.

### Claim 8

A method comprising:
receiving, by a first computing device, media content to distribute to a plurality of electronic devices;
receiving, an indication of first data to relate to the media content for distribution to the plurality of electronic devices;
decoding a portion of the multimedia content to enable a determination that the media content already has second data embedded in the media content;
extracting a psychoacoustic mask from the media content;
subtracting the psychoacoustic mask from the received media content to remove the embedded second data; and
one of:
associating the first data with the media content by embedding third data in the media content; or
embedding the first data in the media content.

### Claim 9 (depends on 8)

The method as recited in claim 8, wherein the decoding the portion of the media content to enable the determination that the media content already has second data embedded in the media content further comprises decoding the portion of the media content to detect a start of frame indicator.

### Claim 10 (depends on 8)

The method as recited in claim 8, further comprising:
based at least in part on determining that the first data exceeds a threshold size, sending, by the first computing device, the first data to a second computing device to provide for download to the electronic devices; and
associating the first data with the media content by embedding third data in the media content as embedded third data, the third data including information for identifying a location of the first data usable by the electronic devices to access the first data following extraction of the embedded third data.

### Claim 11 (depends on 8)

The method as recited in claim 8, further comprising, based at least in part on determining that the first data is less than a threshold size, embedding the first data in the media content.

### Claim 12 (depends on 8)

The method as recited in claim 8, further comprising:
receiving, from the second computing device, information about a plurality of users of the plurality of electronic devices, respectively, based on the second computing device receiving communications from the plurality of electronic devices to access the first data based at least in part on the third data,
wherein the received information about the plurality of users includes at least one of location information, demographic information, listening duration information, or an action performed in response to at least one of the first data or the third data.

### Claim 13 (depends on 8)

The method as recited in claim 8, further comprising sending the media content with the embedded third data as at least one of:
streaming content sent over a network; or
broadcasted content sent as a radio wave.

### Claim 14

A computing device comprising:
one or more processors configured by executable instructions to perform operations comprising:
receiving media content for distribution to a plurality of electronic devices;
receiving, an indication of first data to relate to the media content for distribution to the plurality of electronic devices;
causing an audio encoder to determine a psychoacoustic mask for the received media content;
based at least in part on determining that the first data exceeds a threshold size, sending, by the first computing device, the first data to a second computing device to be provided for download to the electronic devices;
based at least in part on determining that the first data exceeds the threshold size, sending, to the audio encoder, second data to embed in the audio content as embedded second data; and
causing the audio encoder to modulate the psychoacoustic mask with the second data to obtain an output signal and add the output signal to the media content.

### Claim 15 (depends on 14)

The computing device as recited in claim 14, the operations further comprising:
prior to causing the audio encoder to add the modulated psychoacoustic mask, decoding a portion of the media content to enable a determination that the media content already has third data embedded in the media content; and
subtracting the psychoacoustic mask from the received media content to remove the embedded third data.

### Claim 16 (depends on 15)

The computing device as recited in claim 15, the operation of decoding the portion of the media content to enable the determination that the media content already has third data embedded in the media content further comprising decoding the portion of the media content to detect a start of frame indicator.

### Claim 17 (depends on 14)

The computing device as recited in claim 14, the operations further comprising receiving the indication of the first data via a user interface, wherein the user interface presents a plurality of virtual controls selectable for selecting one or more of a plurality of different data categories, respectively, for selecting the first data.

### Claim 18 (depends on 14)

The computing device as recited in claim 14, the operations further comprising sending the media content with the embedded second data as at least one of:
streaming content sent over a network; or
broadcasted content sent as a radio wave.

### Claim 19 (depends on 14)

The computing device as recited in claim 14, the operations further comprising:
receiving, from the second computing device, information about a plurality of users of the plurality of electronic devices, respectively, based on the second computing device receiving communications from the plurality of electronic devices to access the first data based at least in part on the second data,
wherein the received information about the plurality of users includes at least one of location information, demographic information, listening duration information, or an action performed in response to at least one of the first data or the second data.

### Claim 20 (depends on 14)

The computing device as recited in claim 14, wherein the embedded second data, when extracted from the media content, provides an indication of a network location of the first data.
