# US 11,451,865 B1 · Relay of audio and/or video steganography to improve second screen experiences > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 11,451,865 B1 - Document ID: US11451865B1 - Status: Granted - Kind: B1 - Application number: 16/525,266 - Filed: 2019-07-29 - Granted: 2022-09-20 - Earliest claimed: 2019-04-11 - Assignees: Cue Audio, LLC - Applicants: CUE Audio, LLC - Inventors: Jameson Rader - Web page: https://patentgrep.com/patent/US11451865B1 ## CPC - H04N 21/44008: {involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream (arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59)} - G06F 3/165: {Management of the audio stream, e.g. setting of volume, audio stream path} - H04N 21/4126: {The peripheral being portable, e.g. PDAs or mobile phones} - H04N 21/4348: {Demultiplexing of additional data and video streams} - H04N 21/43637: {involving a wireless protocol, e.g. Bluetooth®, RF or wireless LAN [IEEE 802.11] (arrangements for wireless networking or broadcasting of information in indoor or near-field type systems H04B10/114)} - H04N 21/4394: {involving operations for analysing the audio stream, e.g. detecting features or characteristics in audio streams (arrangements characterised by components specially adapted for monitoring, identification or recognition of audio in broadcast systems H04H60/58)} - H04N 21/812: {involving advertisement data (advertising per se G06Q30/02)} - H04N 21/8352: involving content or source identification data, e.g. Unique Material Identifier [UMID] - H04N 21/84: Generation or processing of descriptive data, e.g. content descriptors {(systems specially adapted for using meta-information in broadcast systems H04H60/73)} - H04N 21/8586: {by using a URL (processing chained hypermedia data for information retrieval G06F16/94; information retrieval from the Internet by using URLs G06F16/955; URL in broadcast information H04H20/93; Web-based protocols H04L67/02)} - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) ## Abstract A system for providing a second screen experience to an end user is disclosed. The system may include a first media device including one or more processors configured to receive a broadcast signal encoded with steganographic metadata, extract a payload from the steganographic metadata, and transmit a steganographic metadata signal, the steganographic metadata signal including the extracted payload. The system may further include a second media device including one or more processors configured to receive the steganographic metadata signal from the first media device, determine one or more data identifiers within the received steganographic metadata signal, and execute one or more actions based on the one or more data identifiers. ## Claims ### Claim 1 A system for providing a second screen experience to an end user, comprising: a first media device comprising one or more processors and a memory, the one or more processors configured to execute a set of program instructions stored in memory, the set of program instructions configured to cause the one or more processors to: receive a broadcast signal encoded with primary audio/visual (AV) data and steganographic metadata; generate a primary audio/visual signal based on the primary AV data via an output device of the first media device, wherein the output unit includes at least one of a display or speaker, the steganographic metadata extracted from the broadcast signal prior to generating the primary audio/visual signal with the output device of the first media device; extract a payload, via an extraction module, from the steganographic metadata within the broadcast signal; and transmit a steganographic metadata signal, via a low energy bluetooth transmitter contained within the first media device, to a second media device, the steganographic metadata signal including the extracted payload, the first media device configured to dynamically change an emitted bluetooth signature of the low energy bluetooth transmitted based on the steganographic metadata encoded within the broadcast signal; wherein the second media device comprises one or more processors and a memory, the one or more processors configured to execute a set of program instructions stored in memory, the set of program instructions configured to cause the one or more processors to: receive, via a low energy bluetooth receiver, the bluetooth steganographic metadata signal from the first media device; determine one or more data identifiers within the received payload of the bluetooth steganographic metadata signal; and generate a supplementary AV signal with an output unit of the second media device, the supplementary output signal based on the one or more data identifiers. ### Claim 2 (depends on 1) The system of claim 1, wherein the generating a supplementary audio/visual signal with an output unit of the second media device comprises: generating an audio notification associated with the primary AV signal with one or more speakers of the second media device, and generating a visual notification associated with the primary AV signal with a display of the second media device. ### Claim 3 (depends on 1) The system of claim 1, wherein the generating a supplementary audio/visual signal with an output unit of the second media device comprises: displaying a selectable link associated with the primary AV signal on a display of the second media device, and displaying an advertisement associated with the primary AV signal on the display of the second media device. ### Claim 4 (depends on 1) The system of claim 1, wherein the one or more processors of the first media device are configured to: receive the primary AV signal with one of a microphone or a camera of the first media device, and extract a payload of the steganographic metadata from the primary AV signal. ### Claim 5 (depends on 1) The system of claim 1, wherein the first media device comprises at least one of a television, a radio, an advertising kiosk, and a jumbotron, and the second media device comprises at least one of a smartphone, a tablet, and a smart watch. ### Claim 6 A system for providing a second screen experience to an end user, comprising: a first media device comprising one or more processors and a memory, the one or more processors configured to execute a set of program instructions stored in memory, the set of program instructions configured to cause the one or more processors to: receive a broadcast signal encoded with primary audio/visual (AV) data and steganographic metadata; generate a primary audio/visual signal based on the primary AV data via an output device, wherein the output unit includes at least one of a display or speaker, the steganographic metadata extracted from the broadcast signal prior to generating the primary audio/visual signal with the output device of the first media device; extract a payload, via an extraction module, from the steganographic metadata within the broadcast signal; and transmit a steganographic metadata signal, via a low energy bluetooth transmitter contained within the first media device, to a second media device, the steganographic metadata signal including the extracted payload, the first media device configured to dynamically change an emitted bluetooth signature of the low energy bluetooth transmitted based on the steganographic metadata encoded within the broadcast signal, wherein the second media device is configured to generate a supplementary AV signal with an output unit of the second media device, the supplementary output signal based on one or more data identifiers within the extracted payload. ### Claim 7 (depends on 6) The system of claim 6, wherein the generating a supplementary audio/visual signal with an output unit of the second media device comprises: generating an audio notification associated with the primary AV signal with one or more speakers of the second media device, and generating a visual notification associated with the primary AV signal with a display of the second media device. ### Claim 8 (depends on 6) The system of claim 6, wherein the generating a supplementary audio/visual signal with an output unit of the second media device comprises: displaying a selectable link associated with the primary AV signal on a display of the second media device, and displaying an advertisement associated with the primary AV signal on the display of the second media device. ### Claim 9 (depends on 6) The system of claim 6, wherein the one or more processors of the first media device are configured to: receive the primary AV signal with one of a microphone or a camera of the first media device, and extract the payload of the steganographic metadata from the primary AV signal. ### Claim 10 (depends on 6) The system of claim 6, wherein the first media device comprises at least one of a television, a radio, an advertising kiosk, and a jumbotron, and the second media device comprises at least one of a smartphone, a tablet, and a smart watch. ### Claim 11 A system for providing a second screen experience to an end user, comprising: a first media device comprising one or more processors and a memory, the one or more processors configured to execute a set of program instructions stored in memory, the set of program instructions configured to cause the one or more processors to: receive a broadcast signal encoded with primary audio/visual (AV) data and steganographic metadata; identify one or more content identifier (ID) markers within the steganographic metadata of the broadcast signal; identify supplementary content associated with the one or more content ID markers within a supplementary content database; and transmit a steganographic metadata signal, via a low energy bluetooth transmitter contained within the first media device, to a second media device, the steganographic metadata signal encoded with the identified supplementary content the first media device configured to dynamically change an emitted bluetooth signature of the low energy bluetooth transmitted based on the steganographic metadata encoded within the broadcast signal; wherein the second media device comprises one or more processors and a memory, the one or more processors configured to execute a set of program instructions stored in memory, the set of program instructions configured to cause the one or more processors to: receive, via a low energy bluetooth receiver, the steganographic metadata signal from the first media device; and generate a supplementary AV signal with an output unit of the second media device, the supplementary output signal based on the encoded supplementary content.