# US 2010/0169085 A1 · Model based real time pitch tracking system and singer evaluation method

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2010/0169085 A1
- Document ID: US20100169085A1
- Status: Published application
- Kind: A1
- Application number: 12/647,449
- Filed: 2009-12-26
- Published: 2010-07-01
- Earliest claimed: 2008-12-27
- Assignees: Tanla Solutions Limited
- Inventors: KALURI V RANGA RAO; SATISH KATHIRISETTI; SRIDHAR VENKATANARASIMHAN
- Web page: https://patentgrep.com/patent/US20100169085A1

## CPC

- G10L 25/90: Pitch determination of speech signals
- G10H 1/361: {Recording/reproducing of accompaniment for use with an external source, e.g. karaoke systems}
- G10H 2210/066: for pitch analysis as part of wider processing for musical purposes, e.g. transcription, musical performance evaluation; Pitch recognition, e.g. in polyphonic sounds; Estimation or use of missing fundamental
- G10H 2210/091: for performance evaluation, i.e. judging, grading or scoring the musical qualities or faithfulness of a performance, e.g. with respect to pitch, tempo or other timings of a reference performance
- G10H 2250/085: Butterworth filters
- G10L 2025/906: {Pitch tracking}
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10H: ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE

## Abstract

The various embodiments herein provide a system and method to track the pitch of a human being in real time using time varying model. According to one embodiment, the input voice is synthesised to obtain a lower order model. The lower model is down sampled and fitted to a time varying 2nd order model. The down sampled signal is passed through a pitch tracking filter, a fading filter and a gradient filter to obtain a pitch signal in real time. The noise included in the pitch signal is removed by passing the acquired pitch signal through a Kalman filter to obtain a smoothened pitch signal in real time.

## Claims

### Claim 1

A model based real time pitch tracking system comprising:
a low pass filter;
a down sampler connected to the low pass filter;
a second order band pass filter connected to the down sampler;
a gradient filter connected to the second order band pass filter;
a fading filter connected to the second order band pass filter;
an integrator connected to the fading filter and to the gradient filter;
a first order filter connected to the integrator;
a pitch frequency estimator connected to the first order filter; and
a smoothing filter connected to the pitch frequency estimator;
wherein a lower order model is separated from a voice time series to perform a pitch tracking process in real time.

### Claim 2 (depends on 1)

The system according to claim 1, wherein the low pass filter is a sixth order low pass Butterworth filter to receive the input voice series and to extract a lower order voice series from the input voice series in real time.

### Claim 3 (depends on 1)

The system according to claim 1, wherein the down sampler performs the down sampling of the extracted lower order voice series to obtain a low order voice signal.

### Claim 4 (depends on 1)

The system according to claim 1, wherein the second order band pass filter is connected to the down sampler and is provided with an algorithm to fit a second order time varying model to the output of the down sampler to obtain the model parameters related to the lower order voice series of the input voice.

### Claim 5 (depends on 1)

The system according to claim 1, wherein the fading filter is connected to the output of the second order band pass filter through an adder and to the input of the second order band pass filter through a first delay unit, to calculate an error value in the measurement of the lower order voice in a pitch tracking process.

### Claim 6 (depends on 1)

The system according to claim 1, wherein the gradient filter is connected to the second order band pass filter and provided with an algorithm to calculate a gradient of the measured error value in the measurement of the lower order voice in a pitch tracking process.

### Claim 7 (depends on 1)

The system according to claim 1, wherein the integrator is connected to the gradient filter through a second delay unit to receive the gradient of the measured error value and to the input and to the output of the fading filter to receive the input lower order voice and the measured error value.

### Claim 8 (depends on 1)

The system according to claim 1, wherein the integrator is connected to the fading filter and the gradient filter to calculate a model parameter related to the pitch of the lower order voice.

### Claim 9 (depends on 1)

The system according to claim 1, wherein the pitch frequency estimator is connected to the integrator through a first order filter to receive the output of the integrator to calculate a pitch value of the input voice.

### Claim 10 (depends on 1)

The system according to claim 1, wherein the smoothing filter is connected to the pitch frequency estimator to obtain a smooth pitch.

### Claim 11 (depends on 1)

The system according to claim 1, wherein the smoothing filter is a second order Kalman filter.

### Claim 12

A singer evaluation method using model based real time pitch tracking system, the method comprising:
accessing an interactive voice response system through a communication means by a singer;
selecting a song for singing;
playing the selected song;
singing the selected song by the singer;
recording the song sung by the singer;
evaluating the song sung by the singer with the selected reference song to calculate a score; and
displaying the evaluation result.

### Claim 13 (depends on 12)

The method according to claim 12, wherein the process of evaluating includes estimating the pitch of the singer and the pitch of the reference singer who has played the reference singer to calculate the score corresponding to the degree of matching between the singer and the reference singer.

### Claim 14 (depends on 12)

The method according to claim 12, wherein the method of accessing interactive voice response system involves initiating a phone call using a fixed line or a mobile phone.

### Claim 15 (depends on 12)

The method according to claim 12, wherein the method of selecting a song for singing involves selecting a desired song from a list of songs stored in a database and selecting options including language, gender and songs.

### Claim 16 (depends on 12)

The method according to claim 12, further comprising a process of selecting a listening option or recording option at the end of the playing of the selected song by a singer.

### Claim 17 (depends on 12)

The method according to claim 12, wherein the selected song is played again when the listening option is chosen by the singer.

### Claim 18 (depends on 12)

The method according to claim 12, wherein the recording option is selected by the singer to record the song sung by the singer.

### Claim 19 (depends on 12)

The method according to claim 12, wherein the process of recording the song sung by the singer involves playing the recorded song along with karaoke and returning back to the recording mode after playing the recorded song sung by the singer.

### Claim 20 (depends on 12)

The method according to claim 12, wherein the process recording involves enabling the singer to sing the selected song for any number of times until the singer is satisfied with the recorded song.

### Claim 21 (depends on 12)

The method according to claim 12, wherein the process of evaluating the song sung by the singer is initiated after receiving a confirmation of the recorded song from the singer.
