# US 2024/0193839 A1 · Automatically generating a custom artificially intelligent (ai) character based on a user-provided description of the ai character

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2024/0193839 A1
- Document ID: US20240193839A1
- Status: Published application
- Kind: A1
- Application number: 18/535,380
- Filed: 2023-12-11
- Published: 2024-06-13
- Earliest claimed: 2022-12-12
- Inventors: Arif Ali Khan; Ahmad Bukhsh Matyana
- Web page: https://patentgrep.com/patent/US20240193839A1

## CPC

- G06N 3/045: Combinations of networks
- G06T 13/40: of characters, e.g. humans, animals or virtual beings
- G06N 3/044: Recurrent networks, e.g. Hopfield networks
- G06N 3/047: Probabilistic or stochastic networks
- G06N 3/08: Learning methods
- G06N 3/088: Non-supervised learning, e.g. competitive learning
- G06T 13/80: Two-dimensional [2D] animation, e.g. using sprites
- G10L 13/033: Voice editing, e.g. manipulating the voice of the synthesiser
- G10L 13/047: Architecture of speech synthesisers
- G10L 15/1822: {Parsing for meaning understanding}
- G06N 3/006: based on simulated virtual individual or collective life forms, e.g. social simulations or particle swarm optimisation [PSO]
- G06T 2200/24: involving graphical user interfaces [GUIs]
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING

## Abstract

Some examples of the present disclosure related to converting a text description input by a user into an artificially intelligent character. In one example, a system can receive a user input that includes a description of a custom artificially intelligent (AI) character. The system can then automatically generate the custom AI character based on the description. For example, the system can generate a personality dataset based on the description, a voice dataset based on the description, and/or an appearance dataset based on the description. The system can then provide the custom AI character using the personality dataset, the voice dataset, and/or the appearance dataset.

## Claims

### Claim 1

A computer-implemented method comprising:
receiving a user input that includes a description of a custom artificially intelligent (AI) character;
in response to receiving the user input, automatically constructing the custom AI character by:
generating a personality dataset based on the description, the personality dataset describing personality characteristics of the custom AI character;
generating a voice dataset based on the description, the voice dataset describing voice characteristics of the custom AI character; and
generating an appearance dataset based on the description, the appearance dataset describing a visual appearance of the custom AI character; and
providing the custom AI character based on the personality dataset, the voice dataset, and the appearance dataset.

### Claim 1 (depends on 1)

The method of claim 1, wherein the personality characteristics comprise intelligence attributes, psyche attributes, identity attributes, and skill attributes.

### Claim 3 (depends on 1)

The method of claim 1, further comprising:
generating a voice model for the custom AI character based on the voice dataset; and
generating an image of the custom AI character based on the appearance dataset.

### Claim 4 (depends on 3)

The method of claim 3, further comprising:
generating an auditory expression associated with the custom AI character by using the voice model; and
generating a visual movement associated with the custom AI character by providing the image as input to a generative adversarial network (GAN).

### Claim 5 (depends on 3)

The method of claim 3, further comprising, subsequent to automatically generating the custom AI character:
detecting a user interaction with the custom AI character by a user;
in response to detecting the user interaction:
generating a textual response by providing the personality dataset and data associated with the user interaction as input to a first deep learning model, the first deep learning model being configured to generate the textual response to be consistent with the personality characteristics of the custom AI character based on the personality dataset;
generating a spoken response by providing the textual response as input to the voice model, the spoken response including a synthetic speech version of the textual response; and
generating a visual response by providing the image and the textual response as input to a second deep learning model, the visual response including an animated facial expression associated with the spoken response; and
providing the visual response concurrently with the spoken response and the textual response to the user as the custom AI character's response to the user interaction.

### Claim 6 (depends on 1)

The method of claim 1, further comprising:
parsing, using a parsing subsystem, the description of the custom AI character into (i) personality features associated with the personality characteristics of the custom AI character, (ii) voice features associated with the voice characteristics of the custom AI character, and (iii) appearance features associated with the visual appearance of the custom AI character; and
generating the personality dataset based on the personality features, the voice dataset based on the voice features, and the appearance dataset based on the appearance features.

### Claim 7 (depends on 6)

The method of claim 6, wherein the parsing subsystem includes one or more trained models.

### Claim 8 (depends on 1)

The method of claim 1, further comprising:
receiving the user input through a graphical user interface of a webpage; and
presenting the custom AI character in the webpage.

### Claim 9 (depends on 1)

The method of claim 1, further comprising receiving the user input from a third party via an application programming interface (API).

### Claim 10 (depends on 1)

The method of claim 1, wherein the user input is received as textual input from a user.

### Claim 11 (depends on 1)

The method of claim 1, wherein the user input is received as speech input from a user, and further comprising:
converting the speech input into a textual input using one or more natural-language models; and
generating the personality dataset, the voice dataset, and the appearance dataset based on the textual input.

### Claim 12

A non-transitory computer-readable medium comprising program code that is executable by one or more processors for causing the one or more processors to perform operations including:
receiving a user input that includes a description of a custom artificially intelligent (AI) character;
in response to receiving the user input, automatically constructing the custom AI character by:
generating a personality dataset based on the description, the personality dataset describing personality characteristics of the custom AI character;
generating a voice dataset based on the description, the voice dataset describing voice characteristics of the custom AI character; and
generating an appearance dataset based on the description, the appearance dataset describing a visual appearance of the custom AI character; and
providing the custom AI character based on the personality dataset, the voice dataset, and the appearance dataset.

### Claim 13 (depends on 12)

The non-transitory computer-readable medium of claim 12, wherein the personality characteristics comprise intelligence attributes and psyche attributes.

### Claim 14 (depends on 12)

The non-transitory computer-readable medium of claim 12, wherein the operations further comprise:
generating an image of the custom AI character based on the appearance dataset.

### Claim 15 (depends on 14)

The non-transitory computer-readable medium of claim 14, wherein the operations further comprise:
generating a visual movement associated with the custom AI character by providing the image as input to a generative adversarial network (GAN).

### Claim 16 (depends on 14)

The non-transitory computer-readable medium of claim 14, wherein the operations further comprise, subsequent to automatically generating the custom AI character:
detecting a user interaction with the custom AI character by a user;
in response to detecting the user interaction:
generating a textual response by providing the personality dataset as input to a first deep learning model, the first deep learning model being configured to generate the textual response to be consistent with the personality characteristics of the custom AI character based on the personality dataset; and
generating a visual response by providing the image and the textual response as input to a second deep learning model, the visual response including an animated movement associated with the textual response; and
providing the visual response to the user as the custom AI character's response to the user interaction.

### Claim 17 (depends on 12)

The non-transitory computer-readable medium of claim 12, wherein the operations further comprise:
parsing the description of the custom AI character into (i) personality features associated with the personality characteristics of the custom AI character, (ii) voice features associated with the voice characteristics of the custom AI character, and (iii) appearance features associated with the visual appearance of the custom AI character; and
generating the personality dataset based on the personality features, the voice dataset based on the voice features, and the appearance dataset based on the appearance features.

### Claim 18 (depends on 12)

The non-transitory computer-readable medium of claim 12, wherein the operations further comprise:
receiving the user input through a graphical user interface of a webpage; and
presenting the custom AI character in the webpage.

### Claim 19 (depends on 12)

The non-transitory computer-readable medium of claim 12, wherein the description is provided as natural-language textual input from a user.

### Claim 20 (depends on 12)

The non-transitory computer-readable medium of claim 12, wherein the user input is received as natural-language speech input from a user, and wherein the operations further comprise:
converting the natural-language speech input into a textual input using one or more natural-language models; and
generating the personality dataset, the voice dataset, and the appearance dataset by analyzing the textual input.

### Claim 21

A system comprising:
one or more processors; and
one or more memories including instructions that are executable by the one or more processors for causing the one or more processors to perform operations including:
receiving a user input that includes a description of an artificially intelligent (AI) character;
in response to receiving the user input, automatically constructing the AI character by:
generating a personality dataset based on the description, the personality dataset describing personality characteristics of the AI character; and
generating an appearance dataset based on the description, the appearance dataset describing a visual appearance of the AI character; and
providing the AI character based on the personality dataset and the appearance dataset.
