# US 2008/0259085 A1 · Method for Animating an Image Using Speech Data

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2008/0259085 A1
- Document ID: US20080259085A1
- Status: Published application
- Kind: A1
- Application number: 12/147,840
- Filed: 2008-06-27
- Published: 2008-10-23
- Earliest claimed: 2005-12-29
- Assignees: Motorola, Inc.
- Inventors: Gui-Lin Chen; Jian-Cheng Huang; Duan-Duan Yang
- Web page: https://patentgrep.com/patent/US20080259085A1

## CPC

- G06T 13/205: {driven by audio data}
- G06T 13/40: of characters, e.g. humans, animals or virtual beings
- G10L 2021/105: {Synthesis of the lips movements from speech, e.g. for talking heads}
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING

## Abstract

A method for animating an image is useful for animating avatars using real-time speech data. According to one aspect, the method includes identifying an upper facial part and a lower facial part of the image (step 705); animating the lower facial part based on speech data that are classified according to a reduced vowel set (step 710); tilting both the upper facial part and the lower facial part using a coordinate transformation model (step 715); and rotating both the upper facial part and the lower facial part using an image warping model (step 720).

## Claims

### Claim 1

A method for animating an image, comprising:
identifying an upper facial part and a lower facial part of the image;
animating the lower facial part based on speech data that are classified according to a reduced vowel set;
tilting both the upper facial part and the lower facial part using a coordinate transformation model; and
rotating both the upper facial part and the lower facial part using an image warping model.

### Claim 2 (depends on 1)

The method of claim 1, further comprising:
identifying a limb part of the image; and
animating the limb part using a random model.

### Claim 3 (depends on 1)

The method of claim 1, wherein tilting and rotating both the upper facial part and the lower facial part are performed independently of animating the lower facial part.

### Claim 4 (depends on 1)

The method of claim 1, further comprising animating the upper facial part independently of animating the lower facial part.

### Claim 5 (depends on 4)

The method of claim 4, wherein animating the upper facial part comprises generating eye blink images.

### Claim 6 (depends on 1)

The method of claim 1, wherein the lower facial part includes a mouth and lips.

### Claim 7 (depends on 1)

The method of claim 1, wherein the coordinate transformation model is based on a Hotelling transform according to the following formula:
Sx=Dxcos(θ)+Dysin(θ)
Sy=−Dxsin(θ)+Dycos(θ),
wherein S and D represent source and destination coordinates.

### Claim 8 (depends on 1)

The method of claim 1, wherein the image warping model is a Thin-Plate Spine (TPS) model based on the following biharmonic equation:
Δ
2

U
=
(
∂
2
∂
x
2
+
∂
2
∂
y
2
)

U
=
0.

### Claim 9 (depends on 1)

The method of claim 1, wherein the image comprises an avatar.

### Claim 10 (depends on 1)

The method of claim 1, wherein animating the lower facial part comprises displaying a sequence of visemes.

### Claim 11 (depends on 10)

The method of claim 10, wherein each viseme in the sequence of visemes is associated with a phoneme derived from the speech data.

### Claim 12 (depends on 1)

The method of claim 1, wherein animating the lower facial part comprises image morphing between images of a closed mouth and images of an open mouth.

### Claim 13

A method for animating an image, comprising:
identifying an upper facial part and a lower facial part of the image;
animating the lower facial part based on speech data that are classified according to a reduced vowel set; and
animating the upper facial part independently of animating the lower facial part.

### Claim 14 (depends on 13)

The method of claim 13, wherein animating the upper facial part is based on data that are different from the speech data.
