# US 2024/0004456 A1 · Automated configuration of augmented and virtual reality avatars for user specific behaviors

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2024/0004456 A1
- Document ID: US20240004456A1
- Status: Published application
- Kind: A1
- Application number: 17/853,704
- Filed: 2022-06-29
- Published: 2024-01-04
- Earliest claimed: 2022-06-29
- Assignees: Paypal, Inc.
- Applicants: Paypal, Inc.
- Inventors: Michael Charles Todasco; Clare Patrice Tandy; Maria Mileder; Michael Jim Tien Chan; Vladimir Bacvanski
- Web page: https://patentgrep.com/patent/US20240004456A1

## CPC

- G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)}
- G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)}
- G06T 13/40: of characters, e.g. humans, animals or virtual beings
- G06T 2210/61: Scene description
- G06T 2215/16: Using real world measurements to influence rendering
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

There are provided systems and methods for automated configuration of augmented and virtual reality avatars for user specific behaviors. A user may view a virtual environment and/or capture visual data utilizing a device at a location, where the visual data includes one or more real-world objects, or may interact with a virtual reality environment. An augmented or virtual reality experience may be displayed with virtual objects, graphics, avatars, and/or other virtual visualizations and interactions. A service provider may detect real-time data of the user's behaviors and current events or parameters for the corresponding augmented or virtual reality. Using available avatar customizations and configurations, the service provider may automatically configure avatars for presentation in such digital environments. These customizations may be used to automate avatar configurations and presentations without requiring user inputs and based on real-time data, which may be specifically coded and configured dependent on a digital environment.

## Claims

### Claim 1

A computing system comprising:
a non-transitory memory; and
one or more hardware processors coupled to the non-transitory memory and configured to read instructions from the non-transitory memory to cause the computing system to perform operations comprising:
detecting that a first user is interacting in an augmented reality (AR) environment via a first device of the first user;
determining first user data comprising a preference by the first user for avatar visualizations in the AR environment or an interest of the first user that is associated with the avatar visualizations;
determining, based on the first user data, parameters for a presentation of a first avatar in the AR environment to the first user on the first device;
generating the first avatar for the AR environment based on the parameters; and
customizing the AR environment on the first device based on the first avatar and an environment of the AR environment to the first user on the first device.

### Claim 2 (depends on 1)

The computing system of claim 1, wherein the detecting that the first user is interacting with the AR environment comprises detecting that the first user is queued in a line associated with the environment of the AR environment, and wherein the first avatar comprises at least one virtual avatar representation of additional digital users in the line associated with the environment.

### Claim 3 (depends on 2)

The computing system of claim 2, wherein the operations further comprise:
customizing the AR environment with a second avatar in the environment, wherein the second avatar is associated with a route guidance operation in the environment; and
causing the second avatar to provide routing instructions associated with the line or the environment to the first user in the AR environment.

### Claim 4 (depends on 3)

The computing system of claim 3, wherein the second avatar is presented based at least on the parameters, and wherein the parameters comprise at least one of an appearance of the first avatar or the second avatar, a voice of the first avatar or the second avatar, or an output action of the first avatar or the second avatar.

### Claim 5 (depends on 3)

The computing system of claim 3, wherein the operations further comprise:
determining a change to the route guidance operation based on a line queue associated with the line or another line corresponding to the environment; and
updating the second avatar based on the change to the route guidance operation.

### Claim 6 (depends on 1)

The computing system of claim 1, wherein the first avatar is further generated based on pre-determined avatar models or pre-generated avatar models, and wherein the pre-determined avatar models or the pre-generated avatar models are available via a marketplace provided in conjunction with the computing system.

### Claim 7 (depends on 1)

The computing system of claim 1, wherein the first avatar is further generated for the first user based on a facial image of a first selected person by the first user or a face mashup operation by a machine learning engine.

### Claim 8 (depends on 1)

The computing system of claim 1, wherein the operations further comprise:
generating a second avatar for a second user that has a different appearance and/or a different speech based on a second selected person by the second user.

### Claim 9

A method comprising:
receiving, by a computer system for avatar management in a digital environment, a request to generate an avatar for an entity in the digital environment presentable to users via computing devices;
receiving predefined parameters comprising at an appearance of the avatar in the digital environment, an action for a performance by the avatar in the digital environment, or configurable speech for an output by the avatar in the digital environment;
accessing available avatar model data associated with the request and the predefined parameters; and
generating, based on the predefined parameters and the available avatar model data, the avatar associated with the entity for the digital environment.

### Claim 10 (depends on 9)

The method of claim 9, wherein the predefined parameters further comprise a set range or an adjustable variation of the appearance, the action, or the configurable speech based on a user viewing the avatar or the digital environment presented to the user viewing the avatar.

### Claim 11 (depends on 9)

The method of claim 9, further comprising:
detecting one of the users interacting with the digital environment using one of the computing devices;
rendering the avatar to the one of the users in the digital environment via the one of the computing devices; and
animating the avatar in the digital environment to the one of the users.

### Claim 12 (depends on 11)

The method of claim 11, wherein prior to the rendering, the method further comprises:
determining user interest data for the one of the users, wherein the user interest data comprises a face of interest to the one of the users; and
generating, using an face mashup operation, a facial appearance for the avatar based on the user interest data,
wherein the avatar is rendered with the facial appearance.

### Claim 13 (depends on 11)

The method of claim 11, further comprising:
providing a share from the rendering to another user of the avatar or a royalty for the other user viewing the avatar in the digital environment to the entity.

### Claim 14 (depends on 11)

The method of claim 11, wherein the detecting, the rendering, and the animating require a consent from the one of the users for the digital environment.

### Claim 15 (depends on 9)

The method of claim 9, wherein the digital environment comprises an augmented reality or a virtual reality each having one or more avatars represented with respect to real objects and/or virtual objects in the digital environment, and wherein the computing devices comprise at a mobile smart phone device, a wearable device, a video projector, or a holographic projector.

### Claim 16 (depends on 9)

The method of claim 9, wherein the entity comprises a user or a business, and wherein the request to generate the avatar comprises an advertisement generate request for an advertisement associated with the user or the business.

### Claim 17

A non-transitory machine-readable medium having stored thereon machine-readable instructions executable to cause a machine to perform operations comprising:
receiving, from a computing device of an entity by a service provider system, avatar data comprising an image, a video, or an animation associated with an avatar presentable in an augmented reality (AR) environment to users;
determining parameters for avatar presentations as a digital visualization in the AR environment;
generating the avatar for the entity in the AR environment based on the avatar data and the parameters; and
providing the avatar to the users in the AR environment based on one or more environments for the users in the AR environment.

### Claim 18 (depends on 17)

The non-transitory machine-readable medium of claim 17, wherein the providing the avatar to the users comprises:
offering the avatar for purchases or placement uses by the users in the AR environment via a digital marketplace.

### Claim 19 (depends on 18)

The non-transitory machine-readable medium of claim 18, wherein the operations further comprise:
receiving a usage request for the avatar from a first user of the users in a user environment for a second ser of the users in the AR environment;
processing the usage request on behalf of the one of the users for the avatar;
creating a customization of the avatar for the one of the users in the AR environment based on user data for the one of the users; and
causing the customization of the avatar to be presented in the user environment for the one of the users in the AR environment.

### Claim 20 (depends on 17)

The non-transitory machine-readable medium of claim 17, wherein the parameters for avatar presentation comprise at least one of an avatar body type, an avatar face type, one or more avatar costumes for the avatar, or one or more avatar speech outputs by the avatar.
