# US 2014/0207456 A1 · Waveform analysis of speech

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2014/0207456 A1
- Document ID: US20140207456A1
- Status: Published application
- Kind: A1
- Application number: 14/223,304
- Filed: 2014-03-24
- Published: 2014-07-24
- Earliest claimed: 2010-09-23
- Assignees: Waveform Communications, LLC
- Applicants: Waveform Communications, LLC
- Inventors: Michael A. Stokes
- Web page: https://patentgrep.com/patent/US20140207456A1

## CPC

- G10L 25/48: specially adapted for particular use
- G10L 15/02: Feature extraction for speech recognition; Selection of recognition unit
- G10L 25/15: the extracted parameters being formant information
- G10L 25/90: Pitch determination of speech signals
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING

## Abstract

A waveform analysis of speech is disclosed. Embodiments include methods for analyzing captured sounds produced by animals, such as human vowel sounds, and accurately determining the sound produced. Some embodiments utilize computer processing to identify the location of the sound within a waveform, select a particular time within the sound, and measure a fundamental frequency and one or more formants at the particular time. Embodiments compare the fundamental frequency and the one or more formants to known thresholds and multiples of the fundamental frequency, such as by a computer-run algorithm. The results of this comparison identify of the sound with a high degree of accuracy.

## Claims

### Claim 1

A system for identifying a spoken sound in audio data, comprising a processor and a memory in communication with the processor, the memory storing programming instructions executable by the processor to:
read audio data representing at least one spoken sound;
identify a sample location within the audio data representing at least one spoken sound;
determine a first formant frequency F1 of the spoken sound at the sample location with the processor;
determine the second formant frequency F2 of the spoken sound at the sample location with the processor;
compare the value of F1 or F2 to one or more predetermined ranges related to spoken sound parameters with the processor; and
as a function of the results of the comparison, output from the processor data that encodes the identity of a particular spoken sound.

### Claim 2 (depends on 1)

The system of claim 1, wherein the programming instructions are executable by the processor to compare the value of F1, without comparison to another formant frequency, to one or more predetermined ranges related to spoken sound parameters with the processor.

### Claim 3 (depends on 1)

The system of claim 1, wherein the programming instructions are executable by the processor to compare the value of F2, without comparison to another formant frequency, to one or more predetermined ranges related to spoken sound parameters with the processor.

### Claim 4 (depends on 3)

The system of claim 3, wherein the programming instructions are executable by the processor to compare the value of F1, without comparison to another formant frequency, to one or more predetermined ranges related to spoken sound parameters with the processor.

### Claim 5 (depends on 4)

The system of claim 4, wherein the programming instructions are further executable by the processor to capture the sound wave.

### Claim 6 (depends on 5)

The system of claim 5, wherein the programming instructions are further executable by the processor to:
digitize the sound wave; and
create the audio data from the digitized sound wave.

### Claim 7 (depends on 6)

The system of claim 6, wherein the programming instructions are further executable by the processor to:
determine a fundamental frequency F0 of the spoken sound at the sample location with the processor;
compare the ratio F1/F0 to the existing data related to spoken sound parameters with the processor.

### Claim 8 (depends on 7)

The system of claim 7, wherein the programming instructions are further executable by the processor to:
determine the third formant frequency F3 of the spoken sound at the sample location with the processor;
compare F3 to the predetermined thresholds related to spoken sound parameters with the processor.

### Claim 9 (depends on 8)

The system of claim 8, wherein the predetermined thresholds related to spoken sound parameters include one or more of the following ranges:
Sound
F1/F0 (as R)
F1
F2
F3
/er/ - heard
1.8 < R < 4.65
1150 < F2 < 1650
F3 < 1950
/i/ - heed
R < 2.0
2090 < F2
1950 < F3
/i/ - heed
R < 3.1
276 < F1 < 385
2090 < F2
1950 < F3
/u/ - whod
3.0 < R < 3.1
F1 < 406
F2 < 1200
1950 < F3
/u/ - whod
R < 3.05
290 < F1 < 434
F2 < 1360
1800 < F3
/I/ - hid
2.2 < R < 3.0
385 < F1 < 620
1667 < F2 < 2293
1950 < F3
/U/ - hood
2.3 < R < 2.97
433 < F1 < 563
1039 < F2 < 1466
1950 < F3
/æ/ - had
2.4 < R < 3.14
540 < F1 < 626
2015 < F2 < 2129
1950 < F3
/I/ - hid
3.0 < R < 3.5
417 < F1 < 503
1837 < F2 < 2119
1950 < F3
/U/ - hood
2.98 < R < 3.4
415 < F1 < 734
1017 < F2 < 1478
1950 < F3
/ε/ - head
3.01 < R < 3.41
541 < F1 < 588
1593 < F2 < 1936
1950 < F3
/æ/ - had
3.14 < R < 3.4
540 < F1 < 654
1940 < F2 < 2129
1950 < F3
/I/ - hid
3.5 < R < 3.97
462 < F1 < 525
1841 < F2 < 2061
1950 < F3
/U/ - hood
3.5 < R < 4.0
437 < F1 < 551
1078 < F2 < 1502
1950 < F3
/{circumflex over ( )}/ - hud
3.5 < R < 3.99
562 < F1 < 787
1131 < F2 < 1313
1950 < F3
/ / - hawed
3.5 < R < 3.99
651 < F1 < 690
887 < F2 < 1023
1950 < F3
/æ/ - had
3.5 < R < 3.99
528 < F1 < 696
1875 < F2 < 2129
1950 < F3
/ε/ - head
3.5 < R < 3.99
537 < F1 < 702
1594 < F2 < 2144
1950 < F3
/I/ - hid
4.0 < R < 4.3
457 < F1 < 523
1904 < F2 < 2295
1950 < F3
/U/ - hood
4.0 < R < 4.3
475 < F1 < 560
1089 < F2 < 1393
1950 < F3
/{circumflex over ( )}/ - hud
4.0 < R < 4.6
561 < F1 < 675
1044 < F2 < 1445
1950 < F3
/ / - hawed
4.0 < R < 4.67
651 < F1 < 749
909 < F2 < 1123
1950 < F3
/æ/ - had
4.0 < R < 4.6
592 < F1 < 708
1814 < F2 < 2095
1950 < F3
/ε/ - head
4.0 < R < 4.58
519 < F1 < 745
1520 < F2 < 1967
1950 < F3
/{circumflex over ( )}/ - hud
4.62 < R < 5.01
602 < F1 < 705
1095 < F2 < 1440
1950 < F3
/ / - hawed
4.67 < R < 5.0
634 < F1 < 780
985 < F2 < 1176
1950 < F3
/æ/ - had
4.62 < R < 5.01
570 < F1 < 690
1779 < F2 < 1969
1950 < F3
/ε/ - head
4.59 < R < 4.95
596 < F1 < 692
1613 < F2 < 1838
1950 < F3
/ / - hawed
5.01 < R < 5.6
644 < F1 < 801
982 < F2 < 1229
1950 < F3
/{circumflex over ( )}/ - hud
5.02 < R < 5.75
623 < F1 < 679
1102 < F2 < 1342
1950 < F3
/{circumflex over ( )}/ - hud
5.02 < R < 5.72
679 < F1 < 734
1102 < F2 < 1342
1950 < F3
/æ/ - had
5.0 < R < 5.5
1679 < F2 < 1807
1950 < F3
/æ/ - had
5.0 < R < 5.5
1844 < F2 < 1938
/ε/ - head
5.0 < R < 5.5
1589 < F2 < 1811
/æ/ - had
5.0 < R < 5.5
1842 < F2 < 2101
/ / - hawed
5.5 < R < 5.95
680 < F1 < 828
992 < F2 < 1247
1950 < F3
/ε/ - head
5.5 < R < 6.1
1573 < F2 < 1839
/æ/ - had
5.5 < R < 6.3
1989 < F2 < 2066
/ε/ - head
5.5 < R < 6.3
1883 < F2 < 1989
2619 < F3
/æ/ - had
5.5. < R < 6.3
1839 < F2 < 1944
F3 < 2688
/ / - hawed
5.95 < R < 7.13
685 < F1 < 850
960 < F2 < 1267
1950 < F3

### Claim 10 (depends on 9)

The system of claim 9, wherein the predetermined ranges related to spoken sound parameters include all of the ranges listed in claim 9.

### Claim 11 (depends on 7)

The system of claim 7, wherein the programming instructions are further executable by the processor to:
determine the duration of the spoken sound with the processor;
compare the duration of the spoken sound to the predetermined thresholds related to spoken sound parameters with the processor.

### Claim 12 (depends on 11)

The system of claim 11, wherein the predetermined spoken sound parameters include one or more of the following ranges:
Sound
F1/F0 (as R)
F1
F2
Dur.
/er/ - heard
2.4 < R < 5.14
1172 < F2 < 1518
/I/ - hid
2.04 < R < 2.89
369 < F1 < 420
2075 < F2 < 2162
/I/ - hid
3.04 < R < 3.37
362 < F1 < 420
2106 < F2 < 2495
/i/ - heed
R < 3.45
304 < F1 < 421
2049 < F2
/I/ - hid
2.0 < R < 4.1
362 < F1 < 502
1809 < F2 < 2495
/u/ - whod
2.76 < R
450 < F1 < 456
F2 < 1182
/u/ - whod
R < 2.96
312 < F1 < 438
F2 < 1182
/U/ - hood
2.9 < R < 5.1
434 < F1 < 523
993 < F2 < 1264
/u/ - whod
R < 3.57
312 < F1 < 438
F2 < 1300
/U/ - hood
2.53 < R < 5.1
408 < F1 < 523
964 < F2 < 1376
/ / - hawed
4.4 < R < 4.82
630 < F1 < 637
1107 < F2 < 1168
/ / - hawed
4.4 < R < 6.15
610 < F1 < 665
1042 < F2 < 1070
/{circumflex over ( )}/ - hud
4.18 < R < 6.5
595 < F1 < 668
1035 < F2 < 1411
/ / - hawed
3.81 < R < 6.96
586 < F1 < 741
855 < F2 < 1150
/{circumflex over ( )}/ - hud
3.71 < R < 7.24
559 < F1 < 683
997 < F2 < 1344
/ε/ - head
3.8 < R < 5.9
516 < F1 < 623
1694 < F2 < 1800
205 < dur < 285
/ε/ - head
3.55 < R < 6.1
510 < F1 < 724
1579 < F2 < 1710
205 < dur < 245
/ε/ - head
3.55 < R < 6.1
510 < F1 < 686
1590 < F2 < 2209
123 < dur < 205
/æ/ - had
3.35 < R < 6.86
510 < F1 < 686
1590 < F2 < 2437
245 < dur < 345
/ε/ - head
4.8 < R < 6.1
542 < F1 < 635
1809 < F2 < 1875
205 < dur < 244
/æ/ - had
3.8 < R < 5.1
513 < F1 < 663
1767 < F2 < 2142
205 < dur < 245

### Claim 13 (depends on 12)

The system of claim 12, wherein the predetermined ranges related to spoken sound parameters include all of the ranges listed in claim 12.

### Claim 14 (depends on 7)

The system of claim 7, wherein the programming instructions are further executable by the processor to identify multiple speakers in the audio data by comparing F0, F1 and F2 from multiple instances of spoken sound utterances in the audio data.

### Claim 15 (depends on 4)

The system of claim 4, wherein the audio data includes background noise and the processor determines the first and second formant frequencies F1 and F2 in the presence of the background noise.

### Claim 16 (depends on 7)

The system of claim 7, wherein the programming instructions are further executable by the processor to identify the spoken sound of one or more talkers.

### Claim 17 (depends on 7)

The system of claim 7, wherein the programming instructions are further executable by the processor to differentiate the spoken sounds of two or more talkers.

### Claim 18 (depends on 7)

The system of claim 7, wherein the programming instructions are further executable by the processor to:
identify the spoken sound of a talker;
compare the spoken sound the talker to a database containing information related to the spoken sounds of a plurality of individuals; and
identify a particular individual in the database to which the spoken sound correlates.

### Claim 19 (depends on 18)

The system of claim 18, wherein the spoken sound is a vowel sound.

### Claim 20 (depends on 18)

The system of claim 18, wherein the spoken sound is a 10-15 millisecond sample of a vowel sound.

### Claim 21 (depends on 18)

The system of claim 18, wherein the spoken sound is a 20-25 millisecond sample of a vowel sound.

### Claim 22

A method, comprising:
transmitting spoken sounds to a listener;
detecting misperceptions in the listener's interpretation of the spoken sounds;
determining the frequency ranges related to the listener's misperception of the spoken sounds; and
adjusting the frequency range response of a listening device for use by the listener to compensate for the listener's misperception of the spoken sounds.

### Claim 23 (depends on 22)

The method of claim 22, wherein the spoken sounds include vowel sounds.

### Claim 24 (depends on 22)

The method of claim 22, wherein the spoken sounds include at least three (3) different vowel productions from one talker.

### Claim 25 (depends on 22)

The method of claim 22, wherein the spoken sounds include at least nine (9) different American English vowels.

### Claim 26 (depends on 25)

The method of claim 25, wherein said determining includes comparing the misperceived sounds to one or more of the following ranges:
Vowel
F1/F0 (as R)
F1
F2
F3
/er/ - heard
1.8 < R < 4.65
1150 < F2 < 1650
F3 < 1950
/i/ - heed
R < 2.0
2090 < F2
1950 < F3
/i/ - heed
R < 3.1
276 < F1 < 385
2090 < F2
1950 < F3
/u/ - whod
3.0 < R < 3.1
F1 < 406
F2 < 1200
1950 < F3
/u/ - whod
R < 3.05
290 < F1 < 434
F2 < 1360
1800 < F3
/I/ - hid
2.2 < R < 3.0
385 < F1 < 620
1667 < F2 < 2293
1950 < F3
/U/ - hood
2.3 < R < 2.97
433 < F1 < 563
1039 < F2 < 1466
1950 < F3
/æ/ - had
2.4 < R < 3.14
540 < F1 < 626
2015 < F2 < 2129
1950 < F3
/I/ - hid
3.0 < R < 3.5
417 < F1 < 503
1837 < F2 < 2119
1950 < F3
/U/ - hood
2.98 < R < 3.4
415 < F1 < 734
1017 < F2 < 1478
1950 < F3
/ε/ - head
3.01 < R < 3.41
541 < F1 < 588
1593 < F2 < 1936
1950 < F3
/æ/ - had
3.14 < R < 3.4
540 < F1 < 654
1940 < F2 < 2129
1950 < F3
/I/ - hid
3.5 < R < 3.97
462 < F1 < 525
1841 < F2 < 2061
1950 < F3
/U/ - hood
3.5 < R < 4.0
437 < F1 < 551
1078 < F2 < 1502
1950 < F3
/{circumflex over ( )}/ - hud
3.5 < R < 3.99
562 < F1 < 787
1131 < F2 < 1313
1950 < F3
/ / - hawed
3.5 < R < 3.99
651 < F1 < 690
887 < F2 < 1023
1950 < F3
/æ/ - had
3.5 < R < 3.99
528 < F1 < 696
1875 < F2 < 2129
1950 < F3
/ε/ - head
3.5 < R < 3.99
537 < F1 < 702
1594 < F2 < 2144
1950 < F3
/I/ - hid
4.0 < R < 4.3
457 < F1 < 523
1904 < F2 < 2295
1950 < F3
/U/ - hood
4.0 < R < 4.3
475 < F1 < 560
1089 < F2 < 1393
1950 < F3
/{circumflex over ( )}/ - hud
4.0 < R < 4.6
561 < F1 < 675
1044 < F2 < 1445
1950 < F3
/ / - hawed
4.0 < R < 4.67
651 < F1 < 749
909 < F2 < 1123
1950 < F3
/æ/ - had
4.0 < R < 4.6
592 < F1 < 708
1814 < F2 < 2095
1950 < F3
/ε/ - head
4.0 < R < 4.58
519 < F1 < 745
1520 < F2 < 1967
1950 < F3
/{circumflex over ( )}/ - hud
4.62 < R < 5.01
602 < F1 < 705
1095 < F2 < 1440
1950 < F3
/ / - hawed
4.67 < R < 5.0
634 < F1 < 780
985 < F2 < 1176
1950 < F3
/æ/ - had
4.62 < R < 5.01
570 < F1 < 690
1779 < F2 < 1969
1950 < F3
/ε/ - head
4.59 < R < 4.95
596 < F1 < 692
1613 < F2 < 1838
1950 < F3
/ / - hawed
5.01 < R < 5.6
644 < F1 < 801
982 < F2 < 1229
1950 < F3
/{circumflex over ( )}/ - hud
5.02 < R < 5.75
623 < F1 < 679
1102 < F2 < 1342
1950 < F3
/{circumflex over ( )}/ - hud
5.02 < R < 5.72
679 < F1 < 734
1102 < F2 < 1342
1950 < F3
/æ/ - had
5.0 < R < 5.5
1679 < F2 < 1807
1950 < F3
/æ/ - had
5.0 < R < 5.5
1844 < F2 < 1938
/ε/ - head
5.0 < R < 5.5
1589 < F2 < 1811
/æ/ - had
5.0 < R < 5.5
1842 < F2 < 2101
/ / - hawed
5.5 < R < 5.95
680 < F1 < 828
992 < F2 < 1247
1950 < F3
/ε/ - head
5.5 < R < 6.1
1573 < F2 < 1839
/æ/ - had
5.5 < R < 6.3
1989 < F2 < 2066
/ε/ - head
5.5 < R < 6.3
1883 < F2 < 1989
2619 < F3
/æ/ - had
5.5. < R < 6.3
1839 < F2 < 1944
F3 < 2688
/ / - hawed
5.95 < R < 7.13
685 < F1 < 850
960 < F2 < 1267
1950 < F3

### Claim 27 (depends on 26, 43)

The system of claim 26, wherein said determining includes comparing the misperceived sounds to the ranges listed in claim 43 until F1/F0, F1, F2 and F3 match a set of ranges correlating to at least one vowel or all ranges have been compared.

### Claim 28 (depends on 26)

The system of claim 26, wherein said adjusting includes increasing the output of a listening device in frequencies that contain one or more of F0, F1, F2 and F3.
