# US 2021/0065696 A1 · Systems and Methods for Generating a Cleaned Version of Ambient Sound

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0065696 A1
- Document ID: US20210065696A1
- Status: Published application
- Kind: A1
- Application number: 16/557,734
- Filed: 2019-08-30
- Published: 2021-03-04
- Earliest claimed: 2019-08-30
- Assignees: Spotify AB
- Applicants: Spotify AB
- Inventors: Daniel Bromand; Richard Mitic; Björn Erik Roth
- Web page: https://patentgrep.com/patent/US20210065696A1

## CPC

- G10L 15/20: Speech recognition techniques specially adapted for robustness in adverse environments, e.g. in noise, of stress induced speech (G10L21/02 takes precedence)
- G10L 21/0208: Noise filtering
- G06F 3/165: {Management of the audio stream, e.g. setting of volume, audio stream path}
- G10L 15/22: Procedures used during a speech recognition process, e.g. man-machine dialogue
- G10L 21/0264: characterised by the type of parameter measurement, e.g. correlation techniques, zero crossing techniques or predictive techniques
- G10L 25/84: for discriminating voice from noise
- G10L 2015/223: {Execution procedure of a spoken command}
- G10L 2021/02161: {Number of inputs available containing the signal or the noise to be suppressed}
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

While a media content item is emitted by a second electronic device that is remote from the first electronic device, the first electronic device receives data that includes: timing information, offset information that indicates a difference between an initial position of the media content item and a current playback position of the media content item, and an audio stream that corresponds to the media content item. The first electronic device detects ambient sound that includes sound corresponding to the media content item emitted by the second electronic device. The first electronic device generates a cleaned version of the ambient sound by using the timing information and the offset information to align the audio stream with the ambient sound and performing a subtraction operation to substantially subtract the audio stream from the ambient sound.

## Claims

### Claim 1

A method performed by a first electronic device, the method comprising:
while a media content item is emitted by a second electronic device that is remote from the first electronic device:
receiving data that includes:
timing information,
offset information that indicates a difference between an initial position of the media content item and a current playback position of the media content item, and
an audio stream that corresponds to the media content item;
detecting ambient sound that includes sound corresponding to the media content item emitted by the second electronic device; and
generating a cleaned version of the ambient sound, including:
using the timing information and the offset information to align the audio stream with the ambient sound; and
performing a subtraction operation to substantially subtract the audio stream from the ambient sound.

### Claim 2 (depends on 1)

The method of claim 1, wherein the timing information includes a clock signal.

### Claim 3 (depends on 1)

The method of claim 1, wherein the timing information includes an indication of latency between the second electronic device and the first electronic device.

### Claim 4 (depends on 1)

The method of claim 1, wherein the offset information includes an indication of a time duration between the initial position of the media content item and the current playback position of the media content item.

### Claim 5 (depends on 1)

The method of claim 1, wherein the offset information includes an indication of a data amount that corresponds to the difference between the initial position of the media content item and the current playback position of the media content item.

### Claim 6 (depends on 1)

The method of claim 1, wherein the timing information is received from the second electronic device.

### Claim 7 (depends on 1)

The method of claim 1, wherein the timing information is received from a first server.

### Claim 8 (depends on 1)

The method of claim 1, wherein the offset information is received from the second electronic device.

### Claim 9 (depends on 1)

The method of claim 1, wherein the offset information is received from a first server.

### Claim 10 (depends on 1)

The method of claim 1, wherein the audio stream has a lower data rate than the media content item that is provided to the second electronic device.

### Claim 11 (depends on 1)

The method of claim 1, wherein the audio stream is received from the second electronic device.

### Claim 12 (depends on 1)

The method of claim 1, wherein the audio stream is received from a first server.

### Claim 13 (depends on 1)

The method of claim 1, wherein the audio stream is received from a second server distinct from a first server.

### Claim 14 (depends on 1)

The method of claim 1, wherein the timing information is embedded in the audio stream.

### Claim 15 (depends on 1)

The method of claim 1, including analyzing the cleaned version of the ambient sound to determine whether a command is present in them ambient sound.

### Claim 16 (depends on 1)

The method of claim 1, wherein the first electronic device is not playing the media content item.

### Claim 17 (depends on 1)

The method of claim 1, wherein the first electronic device is playing the media content item.

### Claim 18

A first electronic device comprising:
one or more processors; and
memory storing instructions for execution by the one or more processors, the instructions including instructions for:
while a media content item is emitted by a second electronic device that is remote from the first electronic device:
receiving data that includes:
timing information,
offset information that indicates a difference between an initial position of the media content item and a current playback position of the media content item, and
an audio stream that corresponds to the media content item;
detecting ambient sound that includes sound corresponding to the media content item emitted by the second electronic device; and
generating a cleaned version of the ambient sound, including:
using the timing information and the offset information to align the audio stream with the ambient sound; and
performing a subtraction operation to substantially subtract the audio stream from the ambient sound.

### Claim 19

A non-transitory computer-readable storage medium having one or more processors and memory storing instructions for execution by the one or more processors, the instructions including instructions for:
while a media content item is emitted by a second electronic device that is remote from a first electronic device:
receiving data that includes:
timing information,
offset information that indicates a difference between an initial position of the media content item and a current playback position of the media content item, and
an audio stream that corresponds to the media content item;
detecting ambient sound that includes sound corresponding to the media content item emitted by the second electronic device; and
generating a cleaned version of the ambient sound, including:
using the timing information and the offset information to align the audio stream with the ambient sound; and
performing a subtraction operation to substantially subtract the audio stream from the ambient sound.
