# US 2023/0274483 A1 · Method, system, and non-transitory computer-readable recording medium for authoring animation

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2023/0274483 A1
- Document ID: US20230274483A1
- Status: Published application
- Kind: A1
- Application number: 18/017,496
- Filed: 2021-07-22
- Published: 2023-08-31
- Earliest claimed: 2020-07-22
- Assignees: Anipen Inc.
- Applicants: Anipen Inc.
- Inventors: Jae Woong JEON
- Web page: https://patentgrep.com/patent/US20230274483A1

## CPC

- G06T 11/00: Two-dimensional [2D] image generation
- G06Q 10/10: Office automation; Time management
- G06Q 10/40: Business processes related to social networking or social networking services
- G06Q 30/0276: {Advertisement creation}
- G06Q 30/0643: {graphically representing goods, e.g. 3D product representation}
- G06T 7/20: Analysis of motion (motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51)
- G06T 13/00: Animation
- G06T 13/40: of characters, e.g. humans, animals or virtual beings
- G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)}
- G06Q 30/0631: {Recommending goods or services}
- G06T 2200/24: involving graphical user interfaces [GUIs]
- G06T 2207/10016: Video; Image sequence
- G06T 2207/20081: Training; Learning
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR

## Abstract

A method for authoring an animation is provided. The method includes the steps of: acquiring characteristic information on an appearance and a motion of a real-world object from an input video; determining a virtual object associated with the real-world object with reference to the characteristic information on the appearance of the real-world object, and determining a virtual motion associated with the real-world object with reference to the characteristic information on the motion of the real-world object; and generating an animation sequence on the basis of the virtual object and the virtual motion.

## Claims

### Claim 1

A method for authoring an animation, the method comprising the steps of:
acquiring characteristic information on an appearance and a motion of a real-world object from an input video;
determining a virtual object associated with the real-world object with reference to the characteristic information on the appearance of the real-world object, and determining a virtual motion associated with the real-world object with reference to the characteristic information on the motion of the real-world object; and
generating an animation sequence on the basis of the virtual object and the virtual motion.

### Claim 2 (depends on 1)

The method of claim 1, wherein in the acquiring step, the characteristic information on the appearance and motion of the real-world object is extracted by analyzing the real-world object in the input video using an object analysis model, and
wherein the object analysis model is a model that is trained using a plurality of real-world objects and characteristic information on appearances and motions associated with the plurality of real-world objects.

### Claim 3 (depends on 1)

The method of claim 1, wherein in the acquiring step, the characteristic information on the appearance and motion of the real-world object is extracted with reference to a type of the real-world object specified in the input video.

### Claim 4 (depends on 1)

The method of claim 1, wherein in the acquiring step, characteristic information on an emotion of the real-world object is further acquired from the input video.

### Claim 5 (depends on 1)

The method of claim 1, wherein in the determining step, an object having an appearance similar to the appearance of the real-world object at or above a predetermined level, among a plurality of virtual objects, is determined as the virtual object on the basis of the characteristic information on the appearance of the real-world object, and a motion similar to the motion of the real-world object at or above a predetermined level, among a plurality of virtual motions, is determined as the virtual motion on the basis of the characteristic information on the motion of the real-world object.

### Claim 6 (depends on 5)

The method of claim 5, wherein the plurality of virtual objects and the plurality of virtual motions are specified with reference to a purchase history on a platform associated with animation authoring.

### Claim 7 (depends on 1)

The method of claim 1, wherein in the generating step, at least one of an augmented reality (AR) video and a mixed reality (MR) video is generated by combining the animation sequence with a real-world video.

### Claim 8 (depends on 1)

The method of claim 1, wherein the generated animation sequence is allowed to be shared between a plurality of users.

### Claim 9 (depends on 8)

The method of claim 8, wherein a user interface for allowing at least one of the plurality of users to modify at least one of the virtual object and the virtual motion in the shared animation sequence is provided.

### Claim 10 (depends on 1)

A non-transitory computer-readable recording medium having stored thereon a computer program for executing the method of claim 1.

### Claim 11

A system for authoring an animation, the system comprising:
a characteristic information acquisition unit configured to acquire characteristic information on an appearance and a motion of a real-world object from an input video;
a determination unit configured to determine a virtual object associated with the real-world object with reference to the characteristic information on the appearance of the real-world object, and determine a virtual motion associated with the real-world object with reference to the characteristic information on the motion of the real-world object; and
a sequence generation unit configured to generate an animation sequence on the basis of the virtual object and the virtual motion.

### Claim 12 (depends on 11)

The system of claim 11, wherein the characteristic information acquisition unit is configured to extract the characteristic information on the appearance and motion of the real-world object by analyzing the real-world object in the input video using an object analysis model, and
wherein the object analysis model is a model that is trained using a plurality of real-world objects and characteristic information on appearances and motions associated with the plurality of real-world objects.

### Claim 13 (depends on 11)

The system of claim 11, wherein the characteristic information acquisition unit is configured to extract the characteristic information on the appearance and motion of the real-world object with reference to a type of the real-world object specified in the input video.

### Claim 14 (depends on 11)

The system of claim 11, wherein the characteristic information acquisition unit is configured to further acquire characteristic information on an emotion of the real-world object from the input video.

### Claim 15 (depends on 11)

The system of claim 11, wherein the determination unit is configured to determine an object having an appearance similar to the appearance of the real-world object at or above a predetermined level, among a plurality of virtual objects, as the virtual object on the basis of the characteristic information on the appearance of the real-world object, and to determine a motion similar to the motion of the real-world object at or above a predetermined level, among a plurality of virtual motions, as the virtual motion on the basis of the characteristic information on the motion of the real-world object.

### Claim 16 (depends on 15)

The system of claim 15, wherein the plurality of virtual objects and the plurality of virtual motions are specified with reference to a purchase history on a platform associated with animation authoring.

### Claim 17 (depends on 11)

The system of claim 11, wherein the sequence generation unit is configured to generate at least one of an augmented reality (AR) video and a mixed reality (MR) video by combining the animation sequence with a real-world video.

### Claim 18 (depends on 11)

The system of claim 11, further comprising a sharing management unit configured to allow the generated animation sequence to be shared between a plurality of users.

### Claim 19 (depends on 18)

The system of claim 18, wherein the sharing management unit is configured to provide a user interface for allowing at least one of the plurality of users to modify at least one of the virtual object and the virtual motion in the shared animation sequence.
