Systems and methods for gesture generation
AssigneeDatum Point Labs Inc.
InventorsSeonghyeok Noh, Hanseok Ko, Bonhwa Ku
Life of this patent
Estimating the term…
Loading patent…
AssigneeDatum Point Labs Inc.
InventorsSeonghyeok Noh, Hanseok Ko, Bonhwa Ku
Estimating the term…
Embodiments described herein include a hybrid gesture generation model using a sentence encoder. By using a pre-trained model as the sentence encoder, the framework may output an embedding for a sentence containing any word, even if it is not in the training set, Further, embodiments described herein include a hybrid gesture model that combines trained co-speech gesture generation with a retrieval of pre-defined special gestures. The generation part uses text input to a model trained with co-speech gesture data. The retrieval part uses pre-defined gestures for six different situations that have been prepared in advance. Using embodiments described herein, an AI avatar can perform special gestures like greeting or shaking hands in predefined specific situations, and co-speech gestures in other conversational situations.
A method of gesture generation, comprising:
Dependencies are inferred from the claim text.