# US 2012/0259637 A1 · Method and apparatus for receiving audio

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2012/0259637 A1
- Document ID: US20120259637A1
- Status: Published application
- Kind: A1
- Application number: 13/444,566
- Filed: 2012-04-11
- Published: 2012-10-11
- Earliest claimed: 2011-04-11
- Assignees: Samsung Electronics Co., Ltd.
- Inventors: A. Srinivas; P. Krishnamoorthy; Rajen Bhatt; Sarvesh Kumar
- Web page: https://patentgrep.com/patent/US20120259637A1

## CPC

- G06F 16/634: {Query by example, e.g. query by humming}
- G10L 2025/906: {Pitch tracking}
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING

## Abstract

An electronic apparatus and method for retrieving a song, and a storage medium. The electronic apparatus includes: a storage unit which stores a plurality of songs; a user input unit which receives a hummed query which is inputted for retrieving a song; and a song retrieving unit which retrieves a song based on the hummed query from among the plurality of stored songs when the hummed query is received. The song retrieving unit extracts a pitch and a duration of the hummed query, converts each of the extracted pitch and duration into multi-level symbols, calculates a string edit distance between the hummed query and one of the plurality of songs based on the symbols, and determines a similarity between the hummed query and a song based on edit operations which are performed within the calculated string edit distance.

## Claims

### Claim 1

An electronic apparatus comprising:
a storage unit which stores a plurality of songs;
a user input unit which receives a hummed query which is inputted for retrieving a song; and
a song retrieving unit which retrieves a song based on the hummed query from among the plurality of stored songs when the hummed query is received;
wherein the song retrieving unit extracts a pitch and a duration of the hummed query, converts each of the extracted pitch and duration into multi-level symbols, calculates a string edit distance between the hummed query and one of the plurality of songs based on the symbols, and determines a similarity between the hummed query and a respective song based on one or more edit operations which are performed within the calculated string edit distance.

### Claim 2 (depends on 1)

The electronic apparatus according to claim 1, wherein the song retrieving unit converts the extracted pitch into 5-level symbols and converts the extracted duration into 3-level symbols.

### Claim 3 (depends on 1)

The electronic apparatus according to claim 1, wherein the edit operations comprise at least one of a substitution operation, a replacement operation, an insertion operation, and a deletion operation, and
the song retrieving unit determines the similarity between the hummed query and the respective song based on a number of edit operations which are performed within the edit distance.

### Claim 4 (depends on 3)

The electronic apparatus according to claim 3, wherein the song retrieving unit determines that a degree of the similarity between the hummed query and the respective song increases as more substitution operations are performed within the edit distance.

### Claim 5 (depends on 3)

The electronic apparatus according to claim 3, wherein the song retrieving unit determines that a degree of the similarity between the hummed query and the respective song decreases as more replacement, insertion or deletion operations are performed within the edit distance.

### Claim 6 (depends on 1)

The electronic apparatus according to claim 1, wherein the storage unit further stores data relating to the multi-level symbols into which the extracted pitch and the extracted duration are converted, which data is generated by the song retrieving unit as a result of processing performed upon the multi-level symbols.

### Claim 7 (depends on 1)

The electronic apparatus according to claim 1, further comprising a display unit which displays at least one song retrieved by the song retrieving unit based on the determined similarity.

### Claim 8 (depends on 1)

The electronic apparatus according to claim 1, further comprising a user interface generating unit which generates a user interface for facilitating user retrieval of at least one song.

### Claim 9

A method for retrieving a song by using an electronic apparatus, the method comprising:
storing a plurality of songs;
receiving an inputted hummed query for retrieving a song;
extracting a pitch and a duration of the hummed query;
converting each of the extracted pitch and the extracted duration into multi-level symbols; and
calculating a string edit distance between the hummed query and one of the plurality of songs based on the converted symbols, and determining a similarity between the hummed query and a respective song based on one or more edit operations which are performed within the calculated string edit distance.

### Claim 10 (depends on 9)

The method according to claim 9, wherein the conversion into the symbols comprises converting the extracted pitch into 5-level symbols and converting extracted the duration into 3-level symbols.

### Claim 11 (depends on 9)

The method according to claim 9, wherein the edit operations comprise at least one of a substitution operation, a replacement operation, an insertion operation, and a deletion operation, and
the determining the similarity between the hummed query and a respective song comprises determining the similarity between the hummed query and the respective song based on a number of edit operations which are performed within the edit distance.

### Claim 12 (depends on 11)

The method according to claim 11, wherein the determining the similarity between the hummed query and a respective song comprises determining that a degree of the similarity between the hummed query and the respective song increases as more substitution operations are performed within the edit distance.

### Claim 13 (depends on 11)

The method according to claim 11, wherein the determining the similarity between the hummed query and a respective song comprises determining that a degree of the similarity between the hummed query and the respective song decreases as more replacement, insertion or deletion operations are performed within the edit distance.

### Claim 14 (depends on 9)

The method according to claim 9, further comprising storing data relating to the multi-level symbols into which the extracted pitch and the extracted duration are converted.

### Claim 15 (depends on 9)

The method according to claim 9, further comprising displaying at least one song retrieved based on the determined similarity.

### Claim 16 (depends on 9)

The method according to claim 9, further comprising generating and displaying a user interface for facilitating user retrieval of at least one song.

### Claim 17

A non-transitory computer-readable recording medium which stores a program which includes computer-executable instructions for:
receiving an inputted hummed query for retrieving a song from among a plurality of stored songs;
extracting a pitch and a duration of the hummed query;
converting each of the extracted pitch and the extracted duration into multi-level symbols; and
calculating a string edit distance between the hummed query and one of the plurality of songs based on the converted symbols, and
determining a similarity between the hummed query and a respective song based on one or more edit operations which are performed within the calculated string edit distance.

### Claim 18

An electronic apparatus comprising:
a song retrieving unit which retrieves a song based on a received hummed query from among a plurality of stored songs;
wherein the song retrieving unit extracts a pitch and a duration of the hummed query, determines a similarity between the hummed query and a respective song based the extracted pitch and the extracted duration, and retrieves a song based on the determined similarity.

### Claim 19 (depends on 18)

The electronic apparatus according to claim 18, further comprising a display unit which displays at least one song retrieved by the song retrieving unit based on the determined similarity.

### Claim 20 (depends on 18)

The electronic apparatus according to claim 18, further comprising a user interface generating unit which generates a user interface for facilitating user retrieval of at least one song.

### Claim 21

A method for retrieving a song by using an electronic apparatus, the method comprising:
receiving an inputted hummed query for retrieving a song from among a plurality of stored songs;
extracting a pitch and a duration of the hummed query;
determining a similarity between the hummed query and a respective song based on the extracted pitch and the extracted duration; and
retrieving at least one song from among the plurality of stored songs based on the determined similarity.

### Claim 22 (depends on 21)

The method according to claim 21, further comprising displaying at least one song retrieved based on the determined similarity.

### Claim 23 (depends on 21)

The method according to claim 21, further comprising generating and displaying a user interface for facilitating user retrieval of at least one song from among the plurality of stored songs.
