System and method for incorporating gesture and voice recognition into a single system
AssigneesHonda Motor Co., Ltd., Edge3 Technologies LLC
InventorsPedram Vaghefinazari, Stuart Masakazu Yamamoto, Tarek El Dokor, Josh Tyler King
Life of this patent
Estimating the term…
Abstract
A system and method for combining two separate types of human machine interfaces, e.g., a voice signal and a gesture signal, performing voice recognition to a voice signal and gesture recognition to the gesture signal. Based on a confidence determination using the voice recognition result and the gesture recognition result the system can, for example, immediately perform the command/request, request confirmation of the command/request or determine that the command/request was not identified.
Claims20
A computer based method for executing a command in a vehicle, comprising the steps of:
- receiving a voice signal;
- receiving a gesture signal;
- performing a voice recognition procedure to generate a first voice recognition (VR) score representing a likelihood that the voice signal corresponds to a first command and to generate a second VR score representing a likelihood that the voice signal corresponds to a second command;
- performing a gesture recognition procedure to generate a first gesture recognition (GR) score representing a likelihood that the gesture signal corresponds to said first command, and to generate a second GR score representing a likelihood that the gesture signal corresponds to said second command;
- determining a selected command, said selected command being one of the first command or the second command, based upon the first and second VR scores and said first and second GR scores;
- and
- executing, in a vehicle, said selected command.
A computer based method for executing a command in a vehicle, comprising the steps of:
- receiving a voice signal;
- receiving a gesture signal;
- performing a voice recognition procedure to generate a first voice recognition (VR) score representing a likelihood that the voice signal corresponds to a first command and to generate a second VR score representing a likelihood that the voice signal corresponds to a second command;
- performing a gesture recognition procedure to generate a first gesture recognition (GR) score representing a likelihood that the gesture signal corresponds to said first command, and to generate a second GR score representing a likelihood that the gesture signal corresponds to said second command;
- determining a selected command, said selected command being one of the first command or the second command, based upon said first VR score and said second GR score;
- and
- executing, in a vehicle, said selected command.
A non-transitory computer readable medium comprising computer executable code which when executed by a computer performs the steps of:
- receiving a voice signal;
- receiving a gesture signal;
- performing a voice recognition procedure to generate a first voice recognition (VR) score representing a likelihood that the voice signal corresponds to a first command and to generate a second VR score representing a likelihood that the voice signal corresponds to a second command;
- performing a gesture recognition procedure to generate a first gesture recognition (GR) score representing a likelihood that the gesture signal corresponds to said first command, and to generate a second GR score representing a likelihood that the gesture signal corresponds to said second command;
- determining a selected command, said selected command being one of the first command or the second command, based upon the first and second VR scores and said first and second GR scores;
- and
- executing, in a vehicle, said selected command.
A non-transitory computer readable medium comprising computer executable code which when executed by a computer performs the steps of:
- receiving a voice signal;
- receiving a gesture signal;
- performing a voice recognition procedure to generate a first voice recognition (VR) score representing a likelihood that the voice signal corresponds to a first command and to generate a second VR score representing a likelihood that the voice signal corresponds to a second command;
- performing a gesture recognition procedure to generate a first gesture recognition (GR) score representing a likelihood that the gesture signal corresponds to said first command, and to generate a second GR score representing a likelihood that the gesture signal corresponds to said second command;
- determining a selected command, said selected command being one of the first command or the second command, based upon said first VR score and said second GR score;
- and
- executing, in a vehicle, said selected command.
Dependencies are inferred from the claim text.