# US 2019/0245609 A1 · Methods and systems for live video broadcasting from a remote location based on an overlay of audio > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2019/0245609 A1 - Document ID: US20190245609A1 - Status: Published application - Kind: A1 - Application number: 16/319,782 - Filed: 2017-07-21 - Published: 2019-08-08 - Earliest claimed: 2016-07-21 - Assignees: Drop In, Inc. - Applicants: Drop In, Inc. - Inventors: Louis ZISKIN - Web page: https://patentgrep.com/patent/US20190245609A1 ## CPC - H04B 7/18506: {Communications with or from aircraft, i.e. aeronautical mobile service} - H04B 7/18504: {Aircraft used as relay or high altitude atmospheric platform} - H04L 65/1069: Session establishment or de-establishment - H04L 65/4025: {where none of the additional parallel sessions is real time or time sensitive, e.g. downloading a file in a parallel FTP session, initiating an email or combinational services} - H04L 65/612: for unicast - H04L 65/65: Network streaming protocols, e.g. real-time transport protocol [RTP] or real-time control protocol [RTCP] - H04L 65/765: {intermediate} - H04N 21/2187: Live feed - H04N 21/233: Processing of audio elementary streams {(monitoring, identification or recognition of audio in broadcast systems H04H60/58)} - H04N 21/234: Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs - H04N 21/2368: Multiplexing of audio and video streams - H04N 21/242: Synchronisation processes, e.g. processing of PCR [Programme Clock References] {(arrangements for synchronising broadcast or distribution via plural systems in broadcast distribution systems H04H20/18)} - H04N 21/43072: {of multiple content streams on the same device} - H04N 21/47202: {for requesting content on demand, e.g. video on demand} - B64U 2101/20: for use as communications relays, e.g. high-altitude platforms - B64U 2101/30: for imaging, photography or videography - B64U 2201/20: Remote controls - H04N 21/214: Specialised server platform, e.g. server located in an airplane, hotel, hospital {(arrangements specially adapted for local area broadcast systems H04H20/61)} - H04B: TRANSMISSION - H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M) - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION - B64U: UNMANNED AERIAL VEHICLES [UAV]; EQUIPMENT THEREFOR ## Abstract Systems, devices, and methods for streaming synchronized video data and audio data from a unmanned aerial vehicle (108) to a requester device (102) based on an operator device (106) overlaying the video data and audio data. ## Claims ### Claim 1 A first computing device comprising a processor and addressable memory, the addressable memory comprising a set of one or more rules, wherein the first computing device is in communication with a second computing device comprising a processor and addressable memory; and wherein the first computing device is configured to: receive, from the second computing device, a request to communicate with an unmanned aerial vehicle (UAV), wherein the request comprises a request for video data streaming; establish a first communication channel with the UAV for receiving streamed data from the UAV based on the received request, wherein the streamed data is transmitted by the UAV as uncompressed data; encode the uncompressed data received from the UAV via the first communication channel; establish a second communication channel for transmitting streamed video data and audio data from the first computing device to the second computing device; synchronize audio data received from the first computing device and the second computing device with the encoded data received from the UAV; wherein the synchronization of the streamed video data and audio data is based on combining the first communication channel and the second communication channel via an overlay process; and stream the video data and audio data between the first computing device and the second computing device based on the encoded and synchronized data. ### Claim 2 (depends on 1) The first computing device of claim 1 further configured to stream the video data received from the UAV and the audio data on the same communication channel. ### Claim 3 (depends on 1) The first computing device of claim 1 wherein the audio data received from the first computing device is via a microphone in communication with the processor at the first computing device. ### Claim 4 (depends on 1) The first computing device of claim 1 wherein the audio data received from the second computing device is via a microphone in communication with the processor at the second computing device. ### Claim 5 (depends on 1) The first computing device of claim 1 wherein the request further comprises a request for audio data streaming. ### Claim 6 (depends on 5) The first computing device of claim 5 wherein the uncompressed data received from the UAV further comprises audio data. ### Claim 7 (depends on 6) The first computing device of claim 6 wherein the first computing device is further configured to communicate with a server computing device. ### Claim 8 (depends on 7) The first computing device of claim 7 wherein the first computing device is further configured to transmit the uncompressed data from the UAV directly to the server computing device for processing. ### Claim 9 (depends on 8) The first computing device of claim 8 wherein the first computing device is between the server computing device and the second computing device, thereby the device is in communication with the UAV, server computing device, and second computing device via a set of communication channels. ### Claim 10 (depends on 1) The first computing device of claim 1 wherein the first computing device utilizes a separate processor to receive uncompressed data form the UAV and transmit audio data to the second computing device. ### Claim 11 (depends on 1) The first computing device of claim 1 wherein the first computing device further comprises a data store for logging a set of associated information for each communication channel. ### Claim 12 A method comprising: receiving, by a first computing device having a processor and addressable memory, a request from a second computing device having a processor and addressable memory, for communicating with an unmanned aerial vehicle (UAV) having a processor and addressable memory, wherein the request for communication comprises a request for video data streaming; establishing, by the first computing device, a first communication channel with the UAV for receiving streamed data from the UAV based on the received request, wherein the streamed data is transmitted by the UAV as uncompressed data; encoding, by the first computing device, the uncompressed data received from the UAV via the first communication channel; establishing, by the first computing device, a second communication channel for transmitting streamed video data and audio data from the first computing device to the second computing device; synchronizing, by the first computing device, audio data received from the first computing device and audio data received from the second computing device with the encoded data received from the UAV; wherein the synchronization of the streamed video data and audio data is based on combining the first communication channel and the second communication channel via an overlay process; and streaming, by the first computing device, the video data and audio data between the first computing device and the second computing device based on the encoded and synchronized data. ### Claim 13 (depends on 12) The method of claim 12 wherein a server computing device is in communication with the first computing device and the second computing device. ### Claim 14 (depends on 13) The method of claim 13 further comprising: generating, by the server computing device, a unique identifier associated with the second computing device requesting video data streaming and audio data streaming. ### Claim 15 (depends on 14) The method of claim 14 further comprising: providing, by the server computing device, the request to communicate with the UAV and the generated unique identifier based on the request. ### Claim 16 (depends on 15) The method of claim 15 further comprising: sending, by the server computing device, the unique identifier along with the request to the first computing device. ### Claim 17 (depends on 16) The method of claim 16 further comprising: receiving, by the server computing device, uncompressed data from the UAV via the first computing device. ### Claim 18 (depends on 12) The method of claim 12 wherein the request further comprises a request for audio data streaming. ### Claim 19 (depends on 12) The method of claim 12 wherein the first computing device is between the server computing device and the second computing device, thereby the device is in communication with the UAV, server computing device, and second computing device via a set of communication channels. ### Claim 20 A system comprising a server computing device, a first computing device, and a second computing device; wherein the second computing device comprises a processor and addressable memory, the processor configured to: send a request to the first computing device for communicating with an unmanned aerial vehicle (UAV), wherein the request comprises a request for video data streaming; wherein the server computing device comprises a processor and addressable memory, the processor configured to: generate a unique identifier associated with the second computing device requesting video data streaming and audio data streaming; and provide the request to communicate with the UAV and the generated unique identifier based on the request; and wherein the first computing device comprises a processor and addressable memory, the processor configured to: receive, from the second computing device, the request; establish a first communication channel with the UAV for receiving streamed data from the UAV based on the received request, wherein the streamed data is transmitted by the UAV as uncompressed data; encode the uncompressed data received from the UAV via the first communication channel; establish a second communication channel for transmitting streamed video data and audio data from the first computing device to the second computing device; synchronize audio data received from the first computing device and the second computing device with the encoded data received from the UAV; wherein the synchronization of the streamed video data and audio data is based on combining the first communication channel and the second communication channel via an overlay process; and stream the video data and audio data between the first computing device and the second computing device based on the encoded and synchronized data.