# US 10,441,152 B2 · Tracking the fundamental frequency of a voice signal in real time

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 10,441,152 B2
- Document ID: US10441152B2
- Status: Granted
- Kind: B2
- Application number: 15/113,034
- Filed: 2015-01-22
- Published: 2017-02-09
- Granted: 2019-10-15
- Earliest claimed: 2014-01-24
- Assignees: Digital Endoscopy GmbH
- Applicants: Digital Endoscopy GmbH
- Inventors: Friedrich Pauker
- Web page: https://patentgrep.com/patent/US10441152B2

## CPC

- A61B 1/2673: {for monitoring movements of vocal chords}
- A61B 1/00006: {of control signals}
- A61B 5/4803: {Speech analysis specially adapted for diagnostic purposes}
- A61B 5/7285: {for synchronizing or triggering a physiological measurement or image acquisition with a physiological event or waveform, e.g. an ECG signal}
- A61B 7/003: {Detecting lung or respiration noise}
- A61B 7/023: {for introduction into the body, e.g. into the oesophagus (oesophageal ECG probes A61B5/285)}
- A61B 7/04: Electric stethoscopes
- G10L 25/66: for extracting parameters related to health condition (detecting or measuring for diagnostic purposes A61B5/00)
- G10L 2025/906: {Pitch tracking}
- A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D)
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING

## Abstract

The invention relates to a method and an apparatus for tracking a fundamental frequency of a voice signal. A sampling device samples a voice signal of a test person for a predetermined period of time (S1), thus obtaining sampling data of the voice signal, forms a data packet from the sampling data (S2), and sends the data packet to a calculating device (S3). The calculating device receives the data packet (S5) and calculates a fundamental frequency of the voice signal by means of the sampling data contained in the data packet (S6). The sampling device sets a timer based on the fundamental frequency calculated by the calculating device and outputs a trigger signal upon expiration of the timer (S11).

## Claims

### Claim 1

A method comprising:
(a) sampling, via a sampling device, a voice signal of a test person for a predetermined period of time, thus obtaining sampling data of the voice signal, wherein the predetermined period of time comprises a specified number of oscillations of the voice signal, and triggering process (b) when a specified number of sampling values has been acquired by the sampling of the voice signal for the predetermined period of time, wherein the sampling device is attached to an endoscope and the sampling device includes a first processor, a first one or more data stores configured to store a first set of computer-executable instructions, and a microphone that is configured to record the voice signal of the test person;
(b) forming, via the sampling device, a data packet from the sampling data, wherein the data packet includes the specified number of sampling values of the voice signal;
(c) sending, via a serial interface by the sampling device, the data packet from the sampling device to a calculating device;
(d) calculating, via the calculating device, from the sampling data contained in the data packet, a fundamental frequency of the voice signal and sending the fundamental frequency to the sampling device via the serial interface, wherein the calculating device includes a second processor and a second one or more data stores configured to store a second set of computer-executable instructions;
(e) setting and initiating, via the sampling device, a timer with a duration that is based at least in part on the fundamental frequency, wherein initiating the timer includes allowing the timer run till expiration of the duration; and
(f) outputting, via the sampling device, a trigger signal upon expiration of the timer, wherein processes (a), (b), (c), and (d) are repeated a specified number of times, process (e) is repeated after expiration of the duration, processes (a), (b), (c), (e), and (f) are performed by the first processor by executing the first set of computer-executable instructions, and process (d) is performed by the second processor by executing the second set of computer-executable instructions.

### Claim 2 (depends on 1)

The method according to claim 1, further comprising:
outputting the trigger signal to a stroboscope which is arranged close to a glottis of the test person.

### Claim 3 (depends on 1)

The method according to claim 1, wherein the voice signal is a phonation flow.

### Claim 4

An apparatus comprising:
a sampling device attached to an endoscope, wherein the sampling device includes:
a first processor,
a first one or more data stores configured to store a first computer-executable instructions, and
a microphone configured to record a voice signal of a test person;
a calculating device, wherein the calculating device includes:
a second processor, and
a second one or more data stores configured to store a second computer-executable instructions;
a serial interface electronically connecting the calculating device and the sampling device together;
wherein the first computer-executable instructions, when executed by the first processor, configure the first processor to:
(a) sample, via the sampling device, the voice signal of the test person for a predetermined period of time, thus obtaining sampling data of the voice signal, wherein the predetermined period of time comprises a specified number of oscillations of the voice signal;
(b) in response to a specified number of sampling values having been acquired by the sampling of the voice signal for the predetermined period of time, form, via the sampling device, a data packet from the sampling data, wherein the data packet includes the specified number of sampling values of the voice signal; and
(c) send, via a serial interface and by the sampling device, the data packet to the calculating device, wherein the calculating device is adapted to receive the data packet via the serial interface;
wherein the second computer-executable instructions, when executed by the second processor, configure the second processor to:
(d) calculate, via the calculating device, a fundamental frequency of the voice signal from the sampling data contained in the data packet, and send the fundamental frequency to the sampling device via the serial interface; and
wherein the first computer-executable instructions, when executed by the first processor, further configure the first processor to:
(e) set and initiate, via the sampling device, a timer with a duration that is based at least in part on the fundamental frequency wherein initiating the timer includes allowing the timer run till expiration of the duration; and
(f) output, via the sampling device, a trigger signal upon expiration of the duration.

### Claim 5 (depends on 4)

The apparatus according to claim 4, wherein the sampling device is adapted to output the trigger signal to a stroboscope attached to the endoscope.

### Claim 6 (depends on 4)

The apparatus according to claim 4, wherein the first processor is further configured to:
output the trigger signal to a stroboscope which is arranged close to a glottis of the test person.

### Claim 7 (depends on 4)

The apparatus according to claim 4, wherein the voice signal is a phonation flow.

### Claim 8

A method comprising:
(a) sampling, via a sampling device, a voice signal of a test person for a predetermined period of time, thus obtaining sampling data of the voice signal, wherein the predetermined period of time comprises a specified number of oscillations of the voice signal, and triggering process (b) when a specified number of sampling values has been acquired by the sampling of the voice signal for the predetermined period of time, wherein the sampling device is attached to an endoscope and the sampling device includes a first processor, a first one or more data stores configured to store a first set of computer-executable instructions, and a microphone that is configured to record the voice signal of the test person;
(b) forming a data packet from the sampling data, wherein the data packet includes the specified number of sampling values of the voice signal;
(c) sending, via a serial interface, the data packet from the sampling device to a calculating device;
(d) receiving, from the calculating device via the serial interface, a fundamental frequency of the voice signal;
(e) setting and initiating a timer with a duration that is based at least in part on the fundamental frequency, wherein initiating the timer includes allowing the timer run till expiration of the duration; and
(f) outputting a trigger signal upon expiration of the timer,
wherein processes (a), (b), (c), and (d) are repeated a specified number of times, process (e) is repeated after expiration of the duration, process (d) is performed asynchronously to processes (a), (b), (c), (e), and (f).

### Claim 9 (depends on 8)

The method according to claim 8, wherein the sampling device is adapted to output the trigger signal to a stroboscope attached to the endoscope.

### Claim 10 (depends on 8)

The method according to claim 8, further comprising:
outputting the trigger signal to a stroboscope which is arranged close to a glottis of the test person.

### Claim 11 (depends on 8)

The method according to claim 8, wherein the voice signal is a phonation flow.