# US 2025/0166274 A1 · Systems and methods for gesture generation

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0166274 A1
- Document ID: US20250166274A1
- Status: Published application
- Kind: A1
- Application number: 18/953,359
- Filed: 2024-11-20
- Published: 2025-05-22
- Earliest claimed: 2023-11-22
- Assignees: Datum Point Labs Inc.
- Applicants: Datum Point Labs Inc.
- Inventors: Seonghyeok Noh; Hanseok Ko; Bonhwa Ku
- Web page: https://patentgrep.com/patent/US20250166274A1

## CPC

- G06T 13/40: of characters, e.g. humans, animals or virtual beings
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

Embodiments described herein include a hybrid gesture generation model using a sentence encoder. By using a pre-trained model as the sentence encoder, the framework may output an embedding for a sentence containing any word, even if it is not in the training set, Further, embodiments described herein include a hybrid gesture model that combines trained co-speech gesture generation with a retrieval of pre-defined special gestures. The generation part uses text input to a model trained with co-speech gesture data. The retrieval part uses pre-defined gestures for six different situations that have been prepared in advance. Using embodiments described herein, an AI avatar can perform special gestures like greeting or shaking hands in predefined specific situations, and co-speech gestures in other conversational situations.

## Claims

### Claim 1

A method of gesture generation, comprising:
generating a sentence embedding via a sentence encoder based on an input sentence;
determining a similarity of the sentence embedding to a plurality of sentence embeddings, wherein the plurality of sentence embeddings are associated with respective special gestures;
performing, based on the similarity, at least one of:
generating a co-speech gesture based on the sentence embedding; or
loading a special gesture; and
causing the co-speech gesture or the special gesture to be performed by a virtual avatar.
