# US 2022/0045715 A1 · Audio Synchronization of a Dumb Speaker and a Smart Speaker Using a Spread Code

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2022/0045715 A1
- Document ID: US20220045715A1
- Status: Published application
- Kind: A1
- Application number: 17/506,801
- Filed: 2021-10-21
- Published: 2022-02-10
- Earliest claimed: 2018-09-18
- Assignees: Roku, Inc.
- Applicants: Roku, Inc.
- Inventors: Robert Caston CURTIS; Mark ELY; Brain Thoft Moth MØLLER
- Web page: https://patentgrep.com/patent/US20220045715A1

## CPC

- H04B 1/7087: Carrier synchronisation aspects
- H04S 7/301: {Automatic calibration of stereophonic sound system, e.g. with test microphone}
- G06F 3/165: {Management of the audio stream, e.g. setting of volume, audio stream path}
- H04N 5/073: for mutually locking plural sources of synchronising signals, e.g. studios or relay stations
- H04N 5/607: {for more than one sound signal, e.g. stereo, multilanguages (H04N5/602 takes precedence)}
- H04R 1/028: {associated with devices performing functions other than acoustics, e.g. electric candles}
- G06F 3/167: {Audio in a user interface, e.g. using voice commands for navigating, audio feedback}
- H04R 3/00: Circuits for transducers (arrangements for producing a reverberation or echo sound G10K15/08; amplifiers H03F)
- H04B: TRANSMISSION
- H04S: STEREOPHONIC SYSTEMS
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04R: LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS (producing sounds with frequency not determined by supply frequency G10K)

## Abstract

Disclosed herein are system, apparatus, article of manufacture, method and/or computer program product embodiments, and/or combinations and sub-combinations thereof, for synchronizing playback of audiovisual content with a dumb speaker. In some embodiments, a display device transmits a spread spectrum signal to a dumb speaker over a data channel using a spread spectrum code. The display device then receives the spread spectrum signal from the dumb speaker over an audio data channel. The display device despreads the spread spectrum signal based on the spreading code. The display device determines a time of receipt of the spread spectrum signal. The display device calculates an audiovisual output path delay for the dumb speaker based on the time of receipt and a time of transmission. The display device then synchronizes the playback of the audiovisual content at the dumb speaker and a smart speaker based on the audiovisual output path delay.

## Claims

### Claim 1

A computer-implemented method for synchronizing playback of audiovisual content, comprising:
transmitting, at a display device, a spread spectrum signal to a dumb speaker over a data channel at a time of transmission, wherein the spread spectrum signal is based on a spreading code;
receiving, at the display device, the spread spectrum signal played back auditorily by the dumb speaker, wherein the spread spectrum signal played back auditorily by the dumb speaker represents an input from a microphone at an electronic device;
despreading, at the display device, the spread spectrum signal from the dumb speaker based on the spreading code;
determining, at the display device, a time of receipt of the spread spectrum signal from the dumb speaker based on the despreaded spread spectrum signal;
calculating, at the display device, an audiovisual output path delay for the dumb speaker based on the time of receipt of the spread spectrum signal and the time of transmission of the spread spectrum signal, wherein the audiovisual output path delay comprises a time delay between receiving the spread spectrum signal at the dumb speaker and the spread spectrum signal being played back auditorily by the dumb speaker; and
synchronizing, at the display device, the playback of the audiovisual content at the dumb speaker and the display device based on the audiovisual output path delay of the dumb speaker.

### Claim 2 (depends on 1)

The computer-implemented method of claim 1, wherein the data channel comprises an audio jack channel, a Radio Corporation of America (RCA) channel, an optical channel, or a High-Definition Multimedia Interface (HDMI) channel.

### Claim 3 (depends on 1)

The computer-implemented method of claim 1, the despreading further comprising:
despreading the spread spectrum signal from the dumb speaker based on a reference point associated with the spreading code.

### Claim 4 (depends on 3)

The computer-implemented method of claim 3, the despreading further comprising:
selecting a sliding window into the spreading code based on the reference point; and
despreading the spread spectrum signal from the dumb speaker based on the sliding window.

### Claim 5 (depends on 1)

The computer-implemented method of claim 1, further comprising:
changing, at the display device, an amount of the audiovisual content to buffer based on the audiovisual output path delay.

### Claim 6 (depends on 1)

The computer-implemented method of claim 1, further comprising:
updating, at the display device, a playback offset for the audiovisual content based on the audiovisual output path delay.

### Claim 7 (depends on 1)

The computer-implemented method of claim 1, wherein the electronic device is a remote control or a smart speaker.

### Claim 8

A system, comprising:
a memory; and
at least one processor coupled to the memory and configured to:
transmit a spread spectrum signal to a dumb speaker over a data channel at a time of transmission, wherein the spread spectrum signal is based on a spreading code;
receive the spread spectrum signal played back auditorily by the dumb speaker, wherein the spread spectrum signal played back auditorily by the dumb speaker represents an input from a microphone at an electronic device;
despread the spread spectrum signal from the dumb speaker based on the spreading code;
determine a time of receipt of the spread spectrum signal from the dumb speaker based on the despreaded spread spectrum signal;
calculate an audiovisual output path delay for the dumb speaker based on the time of receipt of the spread spectrum signal and the time of transmission of the spread spectrum signal, wherein the audiovisual output path delay comprises a time delay between receiving the spread spectrum signal at the dumb speaker and the spread spectrum signal being played back auditorily by the dumb speaker; and
synchronize playback of audiovisual content at the dumb speaker and the system based on the audiovisual output path delay of the dumb speaker.

### Claim 9 (depends on 8)

The system of claim 8, wherein the data channel comprises an audio jack channel, a Radio Corporation of America (RCA) channel, an optical channel, or a High-Definition Multimedia Interface (HDMI) channel.

### Claim 10 (depends on 8)

The system of claim 8, wherein to despread, the at least one processor is further configured to:
despread the spread spectrum signal from the dumb speaker based on a reference point associated with the spreading code.

### Claim 11 (depends on 10)

The system of claim 10, wherein to despread, the at least one processor is further configured to:
select a sliding window into the spreading code based on the reference point; and
despread the spread spectrum signal from the dumb speaker based on the sliding window.

### Claim 12 (depends on 8)

The system of claim 8, wherein the at least one processor is further configured to:
change an amount of the audiovisual content to buffer based on the audiovisual output path delay.

### Claim 13 (depends on 8)

The system of claim 8, wherein the at least one processor is further configured to:
change a playback offset for the audiovisual content based on the audiovisual output path delay.

### Claim 14 (depends on 8)

The system of claim 8, wherein the electronic device is a remote control or a smart speaker.

### Claim 15

A non-transitory computer-readable medium having instructions stored thereon that, when executed by at least one computing device, cause the at least one computing device to perform operations comprising:
transmitting a spread spectrum signal to a dumb speaker over a data channel at a time of transmission, wherein the spread spectrum signal is based on a spreading code;
receiving the spread spectrum signal played back auditoriliy by the dumb speaker, wherein the spread spectrum signal played back auditorily by the dumb speaker represents an input from a microphone at an electronic device;
despreading the spread spectrum signal from the dumb speaker based on the spreading code;
determining a time of receipt of the spread spectrum signal from the dumb speaker based on the despreaded spread spectrum signal;
calculating an audiovisual output path delay for the dumb speaker based on the time of receipt of the spread spectrum signal and the time of transmission of the spread spectrum signal, wherein the audiovisual output path delay comprises a time delay between receiving the spread spectrum signal at the dumb speaker and the spread spectrum signal being played back auditorily by the dumb speaker; and
synchronizing playback of audiovisual content at the dumb speaker and the computing device based on the audiovisual output path delay of the dumb speaker.

### Claim 16 (depends on 15)

The non-transitory computer-readable medium of claim 15, wherein the data channel comprises an audio jack channel, a Radio Corporation of America (RCA) channel, an optical channel, or a High-Definition Multimedia Interface (HDMI) channel.

### Claim 17 (depends on 15)

The non-transitory computer-readable medium of claim 15, the despreading comprising:
despreading the spread spectrum signal from the dumb speaker based on a reference point associated with the spreading code.

### Claim 18 (depends on 15)

The non-transitory computer-readable medium of claim 15, wherein the operations further comprise:
changing an amount of the audiovisual content to buffer based on the audiovisual output path delay.

### Claim 19 (depends on 15)

The non-transitory computer-readable medium of claim 15, wherein the operations further comprise:
changing a playback offset for the audiovisual content based on the audiovisual output path delay.

### Claim 20 (depends on 15)

The non-transitory computer-readable medium of claim 15, wherein the electronic device is a remote control or a smart speaker.
