# US 12,191,033 B2 · Monitoring system for monitoring a patient and method for operating the monitoring system

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 12,191,033 B2
- Document ID: US12191033B2
- Status: Granted
- Kind: B2
- Application number: 17/126,000
- Filed: 2020-12-17
- Published: 2021-06-24
- Granted: 2025-01-07
- Earliest claimed: 2019-12-19
- Assignees: Siemens Healthineers AG
- Applicants: Siemens Healthcare GmbH
- Inventors: Marcus Pfister; Martin Berger
- Web page: https://patentgrep.com/patent/US12191033B2

## CPC

- A61M 21/02: for inducing sleep or relaxation, e.g. by direct nerve stimulation, hypnosis, analgesia (for massage A61H; electrotherapy A61N, e.g. applying alternating or intermittent electric currents for producing anaesthesia A61N1/36021)
- G16H 40/67: for remote operation
- A61B 5/165: {Evaluating the state of mind, e.g. depression, anxiety}
- A61B 5/741: {using synthesised speech}
- A61M 21/00: Other devices or methods to cause a change in the state of consciousness; Devices for producing or ending sleep by mechanical, optical, or acoustical means, e.g. for hypnosis
- G06N 3/0464: Convolutional networks [CNN, ConvNet]
- G06N 3/0475: Generative networks
- G06N 3/09: Supervised learning
- G06N 20/00: Machine learning
- G06T 11/00: Two-dimensional [2D] image generation
- G10L 21/007: characterised by the process used
- G16H 20/70: relating to mental therapies, e.g. psychological therapy or autogenous training
- G16H 40/20: for the management or administration of healthcare resources or facilities, e.g. managing hospital staff or surgery rooms
- G16H 50/30: for calculating health indices; for individual health risk assessment
- G16H 80/00: ICT specially adapted for facilitating communication between medical practitioners or patients, e.g. for collaborative diagnosis, therapy or health monitoring
- A61M 2021/0027: {by the hearing sense}
- A61M 2021/005: {images, e.g. video}
- A61M 2205/507: Head Mounted Displays [HMD]
- A61M 2230/06: Heartbeat rate only
- A61M 2230/10: Electroencephalographic signals
- A61M 2230/30: Blood pressure (A61M2230/04 takes precedence)
- G06N 3/08: Learning methods
- A61M: DEVICES FOR INTRODUCING MEDIA INTO, OR ONTO, THE BODY (introducing media into or onto the bodies of animals A61D7/00; means for inserting tampons A61F13/26; devices for administering food or medicines orally A61J; containers for collecting, storing or administering blood or medical fluids A61J1/05); DEVICES FOR TRANSDUCING BODY MEDIA OR FOR TAKING MEDIA FROM THE BODY (surgery A61B; chemical aspects of surgical articles A61L); DEVICES FOR PRODUCING OR ENDING SLEEP OR STUPOR {(Electrotherapy, e.g. producing anaesthesia by the use of alternating or intermittent currents A61N1/36021)}
- G16H: HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D)
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING

## Abstract

For particularly good communication even with difficult patients, a monitoring system for monitoring a patient, such as during a medical diagnostic or therapeutic procedure, is provided. The monitoring system includes a voice cloning device having a voice generator. The voice cloning device is configured to replace a natural voice of a person with a cloned synthetic voice different from the voice of the person. At least two synthetic voices may be selected. The monitoring system also includes a measuring unit configured to record at least one physiological parameter of the patient, an evaluation unit configured to evaluate the at least one measured physiological parameter of the patient, and an actuation unit configured to actuate the voice cloning device such that a synthetic voice is selected or rejected depending on a result of the evaluation by the evaluation unit.

## Claims

### Claim 1

A monitoring system for monitoring a patient, the monitoring system comprising:
a voice cloning device including a voice generator, the voice cloning device being configured to:
replace a natural voice of a person with a first cloned synthetic voice different from the natural voice of the person, the first cloned synthetic voice being selectable from at least two cloned synthetic voices; and
output the first cloned synthetic voice;
a measuring unit configured to record at least one physiological parameter of the patient during operation of the voice cloning device using the first cloned synthetic voice;
an evaluation unit configured to evaluate the at least one physiological parameter of the patient; and
an actuation unit configured to actuate the voice cloning device such that the first cloned synthetic voice is selected or rejected depending on a result of the evaluation of the at least one physiological parameter of the patient by the evaluation unit,
wherein the evaluation of the at least one physiological parameter of the patient comprises comparison of the at least one physiological parameter with at least one threshold value, and
wherein the actuation of the voice cloning device takes place such that the first cloned synthetic voice is selected when the evaluation of the at least one physiological parameter indicates that a threshold value of the at least one threshold value for the at least one physiological parameter is not exceeded, and that the first cloned synthetic voice is rejected when the evaluation of the at least one physiological parameter indicates that a threshold value for the at least one physiological parameter is exceeded.

### Claim 2 (depends on 1)

The monitoring system of claim 1, wherein the actuation unit is further configured to actuate the voice cloning device such that a second cloned synthetic voice of the at least two cloned synthetic voices that does not cause the threshold value to be exceeded is selected or a third cloned synthetic voice of the at least two cloned synthetic voices that causes the threshold value to be exceeded is rejected.

### Claim 3 (depends on 1)

The monitoring system of claim 1, wherein the first cloned synthetic voice has been generated using a pre-trained algorithm for machine learning.

### Claim 4 (depends on 3)

The monitoring system of claim 3, wherein pre-training of the algorithm was carried out by speech samples of persons known to the patient.

### Claim 5 (depends on 1)

The monitoring system of claim 1, wherein the measuring unit is further configured to measure a physiological parameter that is usable as an indicator for a state of mind of the patient, and
wherein the evaluation unit is further configured to evaluate the physiological parameter with respect to the state of mind of the patient.

### Claim 6 (depends on 1)

The monitoring system of claim 1, wherein the at least one physiological parameter is constituted by blood pressure, pulse, or EEG.

### Claim 7 (depends on 1)

The monitoring system of claim 1, wherein the actuation unit is further configured to actuate the voice cloning device such that a second cloned synthetic voice of the least two cloned synthetic voices that produces a positive state of mind is selected or a third cloned synthetic voice of the least two cloned synthetic voices that produces a negative state of mind is rejected.

### Claim 8

A method for operating a monitoring system for monitoring a patient, the monitoring system comprising a voice cloning device, the voice cloning device including a voice generator and being configured to replace a natural voice of a person with a first cloned synthetic voice different from the natural voice of the person, and output the first cloned synthetic voice, the method comprising:
activating the voice cloning device, wherein the first synthetic voice is set;
recording, by a measuring unit of the monitoring system, at least one physiological parameter of the patient during operation of the voice cloning device using the first synthetic voice;
evaluating, by an evaluation unit of the monitoring system, the at least one physiological parameter of the patient for the first synthetic voice;
automatically actuating, by an actuation unit of the monitoring system, the voice cloning device depending on a result of the evaluating of the at least one physiological parameter of the patient;
measuring and evaluating at least one physiological parameter for at least one second synthetic voice; and
depending on the evaluating of the at least one physiological parameter for the at least one second synthetic voice, selecting a synthetic voice from the first synthetic voice and the at least one second synthetic voice for further operation of the voice cloning device.

### Claim 9 (depends on 8)

The method of claim 8, wherein, depending on the result of the evaluating by the evaluation unit, the first synthetic voice is selected or rejected for further operation of the voice cloning device.

### Claim 10 (depends on 8)

The method of claim 8, wherein evaluating the at least one physiological parameter of the patient comprises comparing the at least one physiological parameter with at least one threshold value.

### Claim 11 (depends on 10)

The method of claim 10, wherein activating the voice cloning device takes place such that the first synthetic voice is selected when the evaluating of the at least one physiological parameter indicates that a threshold value for the at least one physiological parameter is not exceeded, and that the first synthetic voice is rejected when the evaluating of the at least one physiological parameter indicates that a threshold value for the at least one physiological parameter is exceeded.

### Claim 12 (depends on 8)

The method of claim 8, wherein evaluating the at least one physiological parameter comprises evaluating the at least one physiological parameter with respect to a state of mind of the patient.

### Claim 13 (depends on 12)

The method of claim 12, wherein activating the voice cloning device takes place such that the first synthetic voice is selected when the first synthetic voice produces a positive state of mind in the patient, and that the first synthetic voice is rejected when the first synthetic voice produces a negative state of mind.

### Claim 14 (depends on 12)

The method of claim 12, wherein the synthetic voice that produces a most positive state of mind in the patient is selected.

### Claim 15

A method for operating a monitoring system for monitoring a patient, the method comprising:
activating a voice cloning device of the monitoring system, such that a first synthetic voice is set, the voice cloning device comprising a voice generator and being configured to replace a natural voice of a person with the first synthetic voice, which is different than the natural voice of the person, and output the first synthetic voice, the first synthetic voice being selectable from at least two synthetic voices;
recording, by a measuring unit of the monitoring system, the at least one physiological parameter of the patient during operation of the voice cloning device using the first synthetic voice;
evaluating, by an evaluation unit of the monitoring system, the at least one physiological parameter of the patient; and
automatically actuating, by an actuation unit of the monitoring system, the voice cloning device depending on a result of the evaluating,
wherein evaluating the at least one physiological parameter of the patient comprises comparing the at least one physiological parameter with at least one threshold value, and
wherein activating the voice cloning device takes place such that the first synthetic voice is selected when the evaluating of the at least one physiological parameter indicates that a threshold value of the at least one threshold value for the at least one physiological parameter is not exceeded, and that the first synthetic voice is rejected when the evaluating of the at least one physiological parameter indicates that the threshold value for the at least one physiological parameter is exceeded.
