# US 2023/0267680 A1 · System and method of creating a digital replica

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2023/0267680 A1
- Document ID: US20230267680A1
- Status: Published application
- Kind: A1
- Application number: 18/111,593
- Filed: 2023-02-19
- Published: 2023-08-24
- Earliest claimed: 2022-02-20
- Inventors: Fritz Lamour
- Web page: https://patentgrep.com/patent/US20230267680A1

## CPC

- G06T 17/00: Three-dimensional [3D] modelling for computer graphics
- G06F 21/32: using biometric data, e.g. fingerprints, iris scans or voiceprints
- G06T 13/40: of characters, e.g. humans, animals or virtual beings
- G06V 40/171: {Local features and components; Facial parts (eye characteristics G06V40/18); Occluding parts, e.g. glasses; Geometrical relationships}
- G10L 13/02: Methods for producing synthetic speech; Speech synthesisers
- G10L 15/1815: {Semantic context, e.g. disambiguation of the recognition hypotheses based on word meaning}
- H04L 51/02: using automatic reactions or user delegation, e.g. automatic replies or chatbot-generated messages
- H04L 51/04: Real-time or near real-time messaging, e.g. instant messaging [IM]
- G10L 13/00: Speech synthesis; Text to speech systems
- G10L 17/00: Speaker identification or verification techniques
- H04L 51/10: Multimedia information
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)

## Abstract

A system for creating a digital replica is disclosed. An image class module processes and analyzes images and other visual data related to a specific user, and displays the data to reflect the user's intent. A speech class module synthesizes and transmits speech data related to the user. A digital class module processes and manipulates visual data related to the user. An intelligence class module enables the digital replica to engage in conversation with others. A record class module stores and organizes data related to the user and allows for efficient retrieval of the data as needed.

## Claims

### Claim 1

A system for creating a digital replica, comprising:
a. an image class module for image analysis, image recognition, image processing, and display of user graphical intent;
b. a speech class module for speech signal synthesis, speech storage, speech transmission, speech recognition, and display of user speech intent;
c. a digital class module for digital data processing for visual presentation, creation, and manipulation of graphic objects;
d. an intelligence class module for emulation of systematic intelligence; and
e. a record class module for record storage, organization, indexation, and retrieval through a computerized data process,
wherein the image class module receives input from one or more users through GUI elements provided by the record class module and processes the input, using the digital class module, to analyze, recognize, and display the graphical intent of the user,
wherein the speech class module communicates with the intelligence class module to recognize and display user or systematic speech intent, and
wherein the record class module stores and organizes all data processed by the other modules.

### Claim 2 (depends on 1)

The system of claim 1 wherein a 3D morphable face model of the user and a unique voice font for the user are created.

### Claim 3 (depends on 2)

The system of claim 2 wherein conversations with human users are simulated.

### Claim 4 (depends on 3)

The system of claim 3 further includes machine learning to learn and adapt to the users preferences over time.

### Claim 5 (depends on 4)

The system of claim 4 wherein administrative rights are granted to one or more of the users by identifying and verifying the identity of the users.

### Claim 6 (depends on 5)

The system of claim 5 wherein digital replicas message one another, which allows the digital replicas to send and receive messages to and from one another via speech transmission, digital data processing, and by using the GUI elements.

### Claim 7 (depends on 6)

The system of claim 6 further comprises user-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols.

### Claim 8

A system for engineering a virtual community secured by facial and voice recognition, comprising:
a. a user interface as digital class for interacting with the system and providing input, including facial and voice likeness of a user;
b. a processor for executing various modules and securing the virtual community through real time facial and voice recognition monitoring;
c. a storage device for storing user data, including the facial and voice likenesses, for use in the virtual community; and
d. a communication module for allowing users to interact with one another within the virtual community.

### Claim 9 (depends on 8)

The system of claim 8 further comprises security measures, including encrypted communication and secure authentication protocols, to ensure privacy and safety of the users within the virtual community.

### Claim 10 (depends on 9)

The system of claim 9 wherein users are enrolled in the virtual community by requiring them to provide their facial and voice likenesses for verification and authentication.

### Claim 11 (depends on 10)

The system of claim 10 wherein access to the virtual community is granted to the users whose facial and voice likenesses match the enrolled likenesses.

### Claim 12 (depends on 11)

The system of claim 11 wherein any suspicious or unauthorized access attempts to the virtual community are monitored.

### Claim 13

A method of creating a digital replica, comprising:
a. authenticating and receiving a request associated with a user;
b. capturing a visual representation of the user;
c. extracting details of the user's facial features;
d. generating a digital avatar of the user;
e. creating a voice font of the user using audio samples; and
f. training a computer model to generate speech in the user's voice, which is used to produce personalized responses.

### Claim 14 (depends on 13)

The method of claim 13 wherein the user request is authenticated by the user logging in with a username and password.

### Claim 15 (depends on 14)

The method of claim 14 wherein the digital avatar and the voice font are used to create a customized message or interaction that is tailored to the user's interests or preferences.

### Claim 16 (depends on 15)

The method of claim 15 wherein machine learning is used for learning and adapting to the user's interests or preferences over time.

### Claim 17 (depends on 16)

The method of claim 16 wherein data of the user is stored.
