Emotional detection and processing for barge-in speech
AssigneeCerence Operating Company
InventorsRaymond Brueckner, Daniel Mario Kindermann, Markus Funk
Life of this patent
Estimating the term…
Abstract
A method for managing an interaction between a user and a driver interaction system in a vehicle, the method comprising presenting a first audio output to a user from an output device of the driver interaction system, and, while presenting the first audio output to the user, receiving sensed input at the driver interaction system, processing the sensed input including determining an emotional content of the driver, and controlling the interaction based at least in part on the emotional content of the sensed input.
Claims26
A method for managing an interaction between a user and a driver-interaction system in a vehicle, the method comprising:
- presenting a first audio output to a user from an output device of the driver-interaction system, and
- while presenting the first audio output to the user, receiving sensed input at the driver-interaction system, processing the sensed input, wherein processing the sensed input comprises determining whether the sensed input includes speech of the driver defining a barge-in event, and determining an emotional content of the driver from the speech of the driver, and controlling the interaction based at least in part on the emotional content responsive to the sensed input being determined to include speech of the driver defining the barge-in event.
A driver-interaction system for interacting with a driver in a vehicle, the driver-interaction system comprising:
- a microphone that senses sensed signals from the driver, wherein the sensed signals includes speech;
- an output device through which the driver-interaction system presents audio output to the driver;
- a speech detector, wherein the speech detector processes the sensed signals and generates output speech signals corresponding to speech from the driver;
- a speech recognizer, wherein the speech recognizer processes the sensed signals to generate a transcript of the speech signals;
- an emotion detector, wherein the emotion detector processes the sensed signals to generate a classified emotion of the driver;
- and
- a barge-in detector, wherein, while the driver-interaction system is presenting audio output to the driver, the barge-in detector carries out processing steps to determine that a barge-in event has occurred involving speech of the driver and to determine whether or not to interrupt the audio output being presented in response to the barge-in event based on the classified emotion of the driver determined from the speech of the driver defining the barge-in event, wherein the processing steps carried out by the barge-in detector rely on one or more of:
- the sensed signals, the output speech signals, the transcript, and the classified emotion.
A non-transitory computer-readable medium having instructions stored thereon, the instructions, when executed by a processor of a driver-interaction system, cause the driver-interaction system to, as the driver-interaction system outputs a first audio output to a driver, execute a first action, a second action, and a third action, wherein:
- the first action is that of receiving sensed input;
- the second action is that of processing the sensed input including determining whether the sensed input includes speech of the driver defining a barge-in event, and determining an emotional content of the driver from the speech of the driver, and the third action is that of controlling an interaction with the driver based at least in part on the emotional content of the sensed input responsive to the sensed input being determined to include speech of the driver defining the barge-in event.
Dependencies are inferred from the claim text.