# US 12,010,375 B2 · Synchronizing audio of a secondary-language audio track > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,010,375 B2 - Document ID: US12010375B2 - Status: Granted - Kind: B2 - Application number: 17/678,196 - Filed: 2022-02-23 - Published: 2022-06-09 - Granted: 2024-06-11 - Earliest claimed: 2018-06-04 - Assignees: DISH Network L.L.C. - Applicants: DISH Network L.L.C. - Inventors: Kevin Yao - Web page: https://patentgrep.com/patent/US12010375B2 ## CPC - H04N 21/43076: {of the same content streams on multiple devices, e.g. when family members are watching the same movie on different devices} - H04N 21/8106: {involving special audio data, e.g. different tracks for different languages} - G06F 3/16: Sound input; Sound output (speech processing G10L) - G06F 3/165: {Management of the audio stream, e.g. setting of volume, audio stream path} - H04N 21/41265: {having a remote control device for bidirectional communication between the remote control device and client device (unidirectional remote control device H04N21/42204)} - H04N 21/41407: {embedded in a portable device, e.g. video client on a mobile phone, PDA, laptop (constructional details of equipment or arrangements specially adapted for portable computer application G06F1/1626; arrangements specially adapted for mobile receivers in broadcast systems H04H20/57)} - H04N 21/42221: {Transmission circuitry, e.g. infrared [IR] or radio frequency [RF]} - H04N 21/43079: {of additional data with content streams on multiple devices} - H04N 21/439: Processing of audio elementary streams - H04N 21/47217: {for controlling playback functions for recorded or on-demand content, e.g. using progress bars, mode or play-point indicators or bookmarks (specific graphical features in visual interfaces H04N21/4312)} - H04N 21/4722: for requesting additional data associated with the content - H04N 21/8547: involving timestamps for synchronizing content - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) ## Abstract A method of providing a synchronized secondary audio track via a mobile device. The method includes: receiving, at a mobile device, a request from a user to receive a secondary audio track that corresponds with a primary audio track of an audio-visual (AV) program which is presented to the user; receiving the secondary audio track at the mobile device; receiving at the mobile device a playback-control cue; and in response to receiving the playback-control cue, outputting audio data of the secondary audio track so that the audio data is synchronized with the primary audio track. ## Claims ### Claim 1 An electronic device comprising: one or more processing devices and memory communicatively coupled with and readable by the one or more processing devices and having stored therein processor-readable instructions, which, when executed by the one or more processing devices, cause the one or more processing devices to perform operations comprising: detecting a signal to output a first audio track that corresponds with a visual output of an audio-visual program, where the audio-visual program is output by a set of one or more devices configured to output audio-visual data, and the set of one or more devices is separate from the electronic device; processing the first audio track received via one or more networks from a remote system; communicating with the set of one or more devices outputting the audio-visual data; consequent to the communicating, synchronizing output of audio data of the first audio track with a playback-control operation that adjusts output corresponding to the audio-visual program based at least in part on: detecting an indication of a playback-control cue output by the set of one or more devices to adjust output corresponding to the audio-visual program, where the indication corresponds to one or more soundwaves having one or more characteristics that distinguish the playback control operation from other playback control operations; calculating a playback offset for the first audio track to synchronize the first audio track with one or more visual components of the audio-visual program, the playback offset based at least in part on the communicating; and based at least in part on the playback offset and in response to receiving the indication of the playback-control cue, outputting the audio data of the first audio track so that the audio data is synchronized with the visual output. ### Claim 2 (depends on 1) The electronic device as recited in claim 1, where the set of one or more devices comprises a display device and one or more speaker devices. ### Claim 3 (depends on 1) The electronic device as recited in claim 1, where the set of one or more devices comprises a set-top box. ### Claim 4 (depends on 1) The electronic device as recited in claim 1, where the playback-control cue comprises a fast-forward cue, a rewind cue, a slow-motion cue, a single-frame advance cue, a single-frame rewind cue, a resume-play cue, or a skip cue. ### Claim 5 (depends on 4) The electronic device as recited in claim 4, where the detecting the indication of the playback-control cue to adjust output corresponding to the audio-visual program comprises detecting an acoustic indication of the playback-control cue. ### Claim 6 (depends on 1) The electronic device as recited in claim 1, where the playback offset is based at least in part on one or more of a response time of the electronic device, a propagation delay, and/or a computational latency. ### Claim 7 (depends on 1) The electronic device as recited in claim 1, where the electronic device is configured to provide a digital assistant. ### Claim 8 A method comprising: detecting by a first device a signal to output a first audio track that corresponds with a visual output of an audio-visual program, where the audio-visual program is output by a set of one or more devices configured to output audio-visual data, and the set of one or more devices is separate from the first device; processing the first audio track received via one or more networks from a remote system; communicating with the set of one or more devices outputting the audio-visual data; consequent to the communicating, synchronizing output of audio data of the first audio track with a playback-control operation that adjusts output corresponding to the audio-visual program based at least in part on: detecting an indication of a playback-control cue output by the set of one or more devices to adjust output corresponding to the audio-visual program, where the indication corresponds to one or more soundwaves having one or more characteristics that distinguish the playback control operation from other playback control operations; calculating a playback offset for the first audio track to synchronize the first audio track with one or more visual components of the audio-visual program, the playback offset based at least in part on the communicating; and based at least in part on the playback offset and in response to receiving the indication of the playback-control cue, outputting the audio data of the first audio track so that the audio data is synchronized with the visual output. ### Claim 9 (depends on 8) The method as recited in claim 8, where the set of one or more devices comprises a display device and one or more speaker devices. ### Claim 10 (depends on 8) The method as recited in claim 8, where the set of one or more devices comprises a set-top box. ### Claim 11 (depends on 8) The method as recited in claim 8, where the playback-control cue comprises a fast-forward cue, a rewind cue, a slow-motion cue, a single-frame advance cue, a single-frame rewind cue, a resume-play cue, or a skip cue. ### Claim 12 (depends on 11) The method as recited in claim 11, where the detecting the indication of the playback-control cue to adjust output corresponding to the audio-visual program comprises detecting an acoustic indication of the playback-control cue. ### Claim 13 (depends on 8) The method as recited in claim 8, where the playback offset is based at least in part on one or more of a response time of the first device, a propagation delay, and/or a computational latency. ### Claim 14 (depends on 8) The method as recited in claim 8, where the first device is configured to provide a digital assistant. ### Claim 15 A non-transitory, processor-readable medium comprising instructions which, when executed by one or more processing devices, cause the one or more processing devices to perform operations comprising: detecting a signal to output a first audio track that corresponds with a visual output of an audio-visual program, where the audio-visual program is output by a set of one or more devices configured to output audio-visual data, and the set of one or more devices is separate from the one or more processing devices; processing the first audio track received via one or more networks from a remote system; communicating with the set of one or more devices outputting the audio-visual data; consequent to the communicating, synchronizing output of audio data of the first audio track with a playback-control operation that adjusts output corresponding to the audio-visual program based at least in part on: detecting an indication of a playback-control cue output by the set of one or more devices to adjust output corresponding to the audio-visual program, where the indication corresponds to one or more soundwaves having one or more characteristics that distinguish the playback control operation from other playback control operations; calculating a playback offset for the first audio track to synchronize the first audio track with one or more visual components of the audio-visual program, the playback offset based at least in part on the communicating; and based at least in part on the playback offset and in response to receiving the indication of the playback-control cue, outputting the audio data of the first audio track so that the audio data is synchronized with the visual output. ### Claim 16 (depends on 15) The non-transitory, processor-readable medium as recited in claim 15, where the set of one or more devices comprises a display device and one or more speaker devices. ### Claim 17 (depends on 15) The non-transitory, processor-readable medium as recited in claim 15, where the set of one or more devices comprises a set-top box. ### Claim 18 (depends on 15) The non-transitory, processor-readable medium as recited in claim 15, where the playback-control cue comprises a fast-forward cue, a rewind cue, a slow-motion cue, a single-frame advance cue, a single-frame rewind cue, a resume-play cue, or a skip cue. ### Claim 19 (depends on 18) The non-transitory, processor-readable medium as recited in claim 18, where the detecting the indication of the playback-control cue to adjust output corresponding to the audio-visual program comprises detecting an acoustic indication of the playback-control cue. ### Claim 20 (depends on 15) The non-transitory, processor-readable medium as recited in claim 15, where the playback offset is based at least in part on one or more of a response time of the one or more processing devices, a propagation delay, and/or a computational latency.