# US 2013/0254422 A2 · Systems and Methods for Sound Recognition

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2013/0254422 A2
- Document ID: US20130254422A2
- Status: Published application
- Kind: A2
- Application number: 12/773,753
- Filed: 2010-05-04
- Published: 2013-09-26
- Earliest claimed: 2010-05-04
- Assignees: SoundHound, Inc.
- Inventors: Aaron Steven Master; Timothy P. Stonehocker; Benjamin John Levitt; Jun Huang; Keyvan Mohajer
- Web page: https://patentgrep.com/patent/US20130254422A2

## CPC

- G06F 16/683: using metadata automatically derived from the content
- G06F 16/634: {Query by example, e.g. query by humming}
- G06F 16/68: Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
- G10L 25/51: for comparison or discrimination
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING

## Abstract

Systems and methods for recognizing sounds are provided herein. User input relating to one or more sounds is received from a computing device. Instructions, which are stored in memory, are executed by a processor to discriminate the one or more sounds, extract music features from the one or more sounds, analyze the music features using one or more databases, and obtain information regarding the music features based on the analysis. Further, information regarding the music features of the one or more sounds may be transmitted to display on the computing device.

## Claims

### Claim 1

A method for recognizing one or more sounds, comprising:
receiving user input from the computing device, the user input providing a search query comprising the one or more sounds;
executing instructions stored in memory, wherein execution of the instructions by a processor:
discriminates the one or more sounds,
extracts music features from the one or more sounds,
analyzes the music features using one or more databases, and
obtains information regarding the music features based on the analysis; and
in response to the search query, transmitting for display information regarding the music features of the one or more sounds to the computing device.

### Claim 2 (depends on 1)

The method of claim 1, wherein executing instructions stored in memory, wherein execution of the instructions by a processor discriminates the one or more sounds further comprises executing instructions stored in memory, wherein execution of the instructions by a processor classifies the one or more sounds of the search query as a singing or humming sound, recorded music, or speech.

### Claim 3 (depends on 1)

The method of claim 1, wherein the one or more sounds includes a song, a song clip, a song snippet, a singing or humming sound, voice, spoken words or any combination thereof.

### Claim 4 (depends on 1)

The method of claim 1, further comprising utilizing load balancing routers to distribute workload to one or more computing resources.

### Claim 5 (depends on 1)

The method of claim 1, wherein information regarding the music features of the one or more sounds comprises a song title, a name of an artist, an artist's biographical information, identification of similar artists, a link to download a song, a link to download a video related to the song, or any combination thereof.

### Claim 6 (depends on 1)

The method of claim 1, further comprising executing instructions stored in memory, wherein execution of the instructions by a processor separates music features from background noise by noise cancellation.

### Claim 7 (depends on 1)

The method of claim 1, further comprising:
executing instructions stored in memory, wherein execution of the instructions by a processor determines whether the music features of the one or more sounds are already included in a local music database of the computing device; and
transmitting to display a flag on the display of the computing device, the flag depicting the determination of whether the music features of the one or more sounds are already included in a local music database of the computing device.

### Claim 8 (depends on 1)

The method of claim 1, further comprising:
executing instructions stored in memory, wherein execution of the instructions by a processor provides relevant content relating to the music features; and
transmitting to display a premium row on the display of the computing device, the premium row depicting the relevant content relating to the music features.

### Claim 9

A method for recognizing one or more sounds, comprising:
receiving user input from the computing device, the user input providing a search query comprising the one or more sounds;
executing instructions stored in memory, wherein execution of the instructions by a processor:
discriminates the one or more sounds by classifying and routing the one or more sounds to one of three sound recognition applications for processing based on sound type, the three sound recognition applications comprising a first sound recognition application for singing or humming sounds, a second sound recognition application for recorded music, and a third sound recognition application for speech,
extracts music features from the one or more sounds,
analyzing and searching the music features using one of three databases for searching based on sound type, the three databases comprising a first database for singing or humming sounds, a second database for recorded music, and a third database for speech, and
obtains information regarding the music features based on the analysis, searching and extraction; and
in response to the search query, transmitting for display information regarding the music features of the one or more sounds to the display of the computing device.

### Claim 10

A computer readable storage medium having embodied thereon a program, the program being executable by a processor to perform a method for recognizing one or more sounds, the method comprising:
receiving user input from the computing device, the user input providing a search query comprising the one or more sounds;
discriminating the one or more sounds;
extracting music features from the one or more sounds;
analyzing the music features using one or more databases;
obtaining information regarding the music features based on the analysis; and
in response to the search query, transmitting for display information regarding the music features of the one or more sounds to the computing device.

### Claim 11 (depends on 10)

The computer readable storage medium of claim 10, wherein discriminating the one or more sounds further comprises classifying the one or more sounds of the search query as a singing or humming sound, recorded music, or speech.

### Claim 12 (depends on 10)

The computer readable storage medium of claim 10, wherein the one or more sounds includes a song, a song clip, a song snippet, a humming sound, voice, or any combination thereof.

### Claim 13 (depends on 10)

The computer readable storage medium of claim 10, wherein the method further comprises utilizing load balancing routers to distribute workload to one or more computing resources.

### Claim 14 (depends on 10)

The computer readable storage medium of claim 10, wherein information regarding the music features of the one or more sounds comprises a song title, a name of an artist, an artist's biographical information, identification of similar artists, a link to download a song, a link to download a video related to the song, or any combination thereof.

### Claim 15 (depends on 10)

The computer readable storage medium of claim 10, wherein the method further comprises executing instructions stored in memory, wherein execution of the instructions by a processor separates music features from background noise by noise cancellation.

### Claim 16 (depends on 10)

The computer readable storage medium of claim 10, wherein the method further comprises:
executing instructions stored in memory, wherein execution of the instructions by a processor determines whether the music features of the one or more sounds are already included in a local music database of the computing device; and
transmitting to display a flag on the display of the computing device, the flag depicting the determination of whether the music features of the one or more sounds are already included in a local music database of the computing device.

### Claim 17 (depends on 10)

The computer readable storage medium of claim 10, wherein the method further comprises executing instructions stored in memory, wherein execution of the instructions by a processor provides relevant content relating to the music features; and
transmitting to display a premium row on the display of the computing device, the premium row depicting the relevant content relating to the music features.

### Claim 18

A system for recognizing one or more sounds, comprising:
a computing device having a display;
one or more databases coupled to the computing device;
a server having a music processor, the server being coupled to the computing device and the one or more databases, the processor configured to execute instructions stored in memory to:
receive user input from the computing device, the user input providing a search query comprising the one or more sounds,
discriminate the one or more sounds,
extract music features from the one or more sounds,
analyze the music features using the one or more databases, and
obtain information regarding the music features based on the analysis; and
in response to the search query, transmit for display information regarding the music features of the one or more sounds to the display of the computing device.

### Claim 19 (depends on 18)

The system of claim 18, wherein the processor is further configured to classify the one or more sounds of the search query as a singing or humming sound, recorded music, or speech.

### Claim 20 (depends on 18)

The system of claim 18, wherein the one or more sounds includes a song, a song clip, a song snippet, a humming sound, voice, or any combination thereof.

### Claim 21 (depends on 18)

The system of claim 18, wherein the processor is further configured to utilize load balancing routers to distribute workload to one or more computing resources.

### Claim 22 (depends on 18)

The system of claim 18, wherein information regarding the music features of the one or more sounds comprises a song title, a name of an artist, an artist's biographical information, identification of similar artists, a link to download or purchase a song, a link to download or purchase a video related to the song, or any combination thereof.

### Claim 23 (depends on 18)

The system of claim 18, wherein the processor is further configured to execute instructions stored in memory to separate music features from background noise by noise cancellation.

### Claim 24 (depends on 18)

The system of claim 18, wherein the processor is further configured to execute instructions stored in memory to determine whether the music features of the one or more sounds are already included in a local music database of the computing device, and the method further comprises transmitting to display a flag on the display of the computing device, the flag depicting the determination of whether the music features of the one or more sounds are already included in a local music database of the computing device.

### Claim 25 (depends on 18)

The system of claim 18, wherein the processor is further configured to execute instructions stored in memory to provide relevant content relating to the music features; and the method further comprises transmitting to display a premium row on the display of the computing device, the premium row depicting the relevant content relating to the music features.

### Claim 26

A system for recognizing one or more sounds, comprising:
a computing device having a display;
three databases coupled to a server,
the server having a music processor, the music processor having three sound recognition applications coupled to the three databases, the server being coupled to the computing device and the three databases, the processor configured to execute instructions stored in memory to:
receive user input from the computing device, the user input providing a search query comprising the one or more sounds,
discriminates the one or more sounds by classifying and routing the one or more sounds to one of the three sound recognition applications for processing based on sound type, the three sound recognition applications comprising a first sound recognition application for singing or humming sounds, a second sound recognition application for recorded music, and a third sound recognition application for speech,
extract music features from the one or more sounds,
analyze and search the music features using one of the three databases for searching based on sound type, the three databases comprising a first database for singing or humming sounds, a second database for recorded music, and a third database for speech, and
obtain information regarding the music features based on the analysis, searching and extraction; and
in response to the search query transmitting for display information regarding the music features of the one or more sounds to the display of the computing device.

### Claim 27

An audio discriminator, comprising:
a classifier of one or more sounds received by user input, the user input providing a search query comprising the one or more sounds, the user input received through a unified search interface provided by a computing device.

### Claim 28 (depends on 27)

The audio discriminator of claim 27, wherein the classifier of the one or more sounds comprises a classifier of the one or more sounds classifies sounds based on one of three sound types, the three sound types comprising humming or singing sounds, recorded music and speech.

### Claim 29 (depends on 27)

The audio discriminator of claim 27, further comprising a router of the one or more sounds to a database based on the classification of the sound type.

### Claim 30

A flag for a display of a computing device, the computing device further comprising a local music database for storing one or more music features, the flag generated by a server coupled to the computing device, the flag visually depicting a determination of whether music features of one or more sounds are already stored in the local music database of the computing device, the flag being transmitted to display on the display of the computing device.

### Claim 31

A premium row for a display of a computing device, the premium row generated by a server coupled to the computing device, the premium row depicting relevant content relating to music features of one or more sounds, the premium row being transmitted to display on the display of the computing device.
