# US 2022/0191157 A1 · Modifying an avatar to reflect a user's expression in a messaging platform

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2022/0191157 A1
- Document ID: US20220191157A1
- Status: Published application
- Kind: A1
- Application number: 17/122,076
- Filed: 2020-12-15
- Published: 2022-06-16
- Earliest claimed: 2020-12-15
- Assignees: Microsoft Technology Licensing, LLC
- Applicants: Microsoft Technology Licensing, LLC
- Inventors: Austin Seungmin LEE; Amy Mun HONG; Keiichi MATSUDA; Anthony James AMBRUS; Mathew Julian LAMB; Kenneth Mitchell JAKUBZAK
- Web page: https://patentgrep.com/patent/US20220191157A1

## CPC

- H04L 51/046: Interoperability with other network applications or services
- H04L 51/063: Content adaptation, e.g. replacement of unsuitable content
- H04L 51/10: Multimedia information
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)

## Abstract

Systems and methods are provided for facilitating the presentation of expressive intent and other status information with messaging and other communication applications. The expressive intent is based on expressive effect data associated with the message recipients and/or message senders. The expressive intent can be conveyed through avatars and modified message content. The avatars convey gestures, emotions and other status information and the presentation of the avatars can be reactive to detected state information of the message recipient(s), message sender(s) and/or corresponding messaging device(s).

## Claims

### Claim 1

A system for causing an avatar to be generated and presented with messaging in a manner to convey contextual meaning from a message sending user to a message receiving user, the system comprising:
one or more processors; and
one or more hardware storage devices that store instructions that are executable by the one or more processors to configure the system to:
identify the message sending user using a first device that is associated with the message sending user;
identify the message receiving user using a second device that is associated with the message receiving user;
identify a message created at the first device by the messaging sending user to be sent to the second device associated with the message receiving user;
prior to delivering the message to the second device, determine an expressive intent of the message sending user, the expressive intent being based at least in part on one or more expressive effects detected from the message sending user contemporaneous with creation of the message at the first device;
detect a positioning of the message receiving user relative to the second device; and
cause the message to be presented at the second device to the message receiving user, the message being presented with a display of the avatar, the avatar being displayed in a manner to convey the expressive intent of the message sending user, and by at least causing presentation of the avatar to be based on the detected positioning of the message receiving user relative to the second device,
wherein the avatar and the message are displayed simultaneously with (i) a copy of a previous avatar that is associated with a previous message and (ii) the previous message, and
wherein, while the avatar displays the expressive intent of the message, the copy of the previous avatar simultaneously animates a previous expressive intent that is associated with the previous message.

### Claim 2 (depends on 1)

The system of claim 1, wherein the detected positioning of the message receiving user relative to the second device is positioning information detected prior to presenting the message.

### Claim 3 (depends on 1)

The system of claim 1, wherein the detected positioning of the message receiving user relative to the second device is positioning information detected during presenting the message.

### Claim 4 (depends on 1)

The system of claim 1, wherein the presentation of the avatar includes a positioning of the avatar to face the detected positioning of the message receiving user relative to the second device.

### Claim 5 (depends on 1)

The system of claim 1, wherein the presentation of the avatar and the message includes temporarily pausing the presentation of the message while the message receiving user is in a first position relative to the second device and unpausing the presentation of the message while the message receiving user is in a second positing relative to the second device.

### Claim 6 (depends on 5)

The system of claim 5, wherein the detected positioning corresponds to a gaze direction based on eye positioning of the message receiving user.

### Claim 7 (depends on 1)

The system of claim 1, wherein the message is presented at the second device concurrently with, but separately from, the presentation of the avatar at the second device.

### Claim 8 (depends on 1)

The system of claim 1, wherein the message is presented by the avatar at the second device.

### Claim 9 (depends on 1)

The system of claim 1, wherein the instructions are further executable by the one or more processors to configure the system to:
detect an environmental context associated with a physical location of the first device and the message sending user; and
presenting the avatar with visual elements that convey the environmental context associated with the physical location of the first device and the message sending user.

### Claim 10 (depends on 1)

The system of claim 1, wherein the instructions are further executable by the one or more processors to configure the system to:
detect an environmental context associated with a virtual location corresponding to the message sending user; and
presenting the avatar with visual elements that convey the environmental context associated with the virtual location corresponding to the message sending user.

### Claim 11 (depends on 1)

The system of claim 1, wherein the instructions are further executable by the one or more processors to configure the system to:
detect an event context associated with the message sending user; and
presenting the avatar with visual elements that convey the event context associated with the message sending user during presentation of the message.

### Claim 12 (depends on 1)

The system of claim 1, wherein the instructions are further executable by the one or more processors to configure the system to:
cause the presentation of the avatar in a manner to convey the expressive intent at the second device prior to presenting the message at the second device.

### Claim 13 (depends on 1)

The system of claim 1, wherein the instructions are further executable by the one or more processors to configure the system to:
detect facial expressions of the message sending user, the facial expressions comprising the one or more expressive effects;
identifying a mapping of the facial expressions to one or more stored expressive intent profiles; and
using the one or more stored expressive intent profiles mapped to the facial expressions to control the presentation of the avatar at the second device to convey the expressive intent.

### Claim 14 (depends on 1)

The system of claim 1, wherein the instructions are further executable by the one or more processors to configure the system to:
detect body gestures of the message sending user, the body gestures comprising the one or more expressive effects;
identifying a mapping of the body gestures to one or more stored expressive intent profiles; and
using the one or more stored expressive intent profiles mapped to the body gestures to control the presentation of the avatar at the second device to convey the expressive intent.

### Claim 15 (depends on 1)

The system of claim 1, wherein the instructions are further executable by the one or more processors to configure the system to:
detect one or more voice patterns of the message sending user, the one or more voice patterns comprising the one or more expressive effects;
identifying a mapping of the one or more voice patterns to one or more stored expressive intent profiles; and
using the one or more stored expressive intent profiles mapped to the one or more voice patterns to control the presentation of the avatar at the second device to convey the expressive intent.

### Claim 16 (depends on 1)

The system of claim 1, wherein the instructions are further executable by the one or more processors to configure the system to:
detect one or more language patterns of the message sending user in the message, the one or more language patterns comprising the one or more expressive effects;
identifying a mapping of mapping the one or more language patterns to one or more stored expressive intent profiles; and
using the one or more stored expressive intent profiles mapped to the one or more language patterns to control the presentation of the avatar at the second device to convey the expressive intent.

### Claim 17 (depends on 1)

The system of claim 1, wherein the instructions are further executable by the one or more processors to configure the system to:
detect user input from the message sending user that selects a particular desired expressive intent that is selected from a plurality of selectable desired expressive intents, the detected user input comprising the one or more expressive effects;
identifying a mapping of mapping the particular desired expressive intent to one or more stored expressive intent profiles; and
using the one or more stored expressive intent profiles mapped to the desired expressive intent to control the presentation of the avatar at the second device to convey the expressive intent.

### Claim 18 (depends on 1)

The system of claim 1, wherein the instructions are further executable by the one or more processors to configure the system to:
cause the avatar to convey the expressive intent at the second device audibly.

### Claim 19 (depends on 1)

The system of claim 1, wherein the instructions are further executable by the one or more processors to configure the system to:
cause the avatar to convey the expressive intent at the second device with gestures that are different than the one or more expressive effects detected from the message sending user.

### Claim 20

A method for causing an avatar to be generated and presented with messaging in a manner to convey contextual meaning from a message sending user to a message receiving user, the method comprising:
identifying the message sending user using a first device that is associated with the message sending user;
identifying the message receiving user using a second device that is associated with the message receiving user;
identifying a message created at the first device by the messaging sending user to be sent to the second device associated with the message receiving user;
prior to delivering the message to the second device, determining an expressive intent of the message sending user, the expressive intent being based at least in part on one or more expressive effects detected from the message sending user contemporaneous with creation of the message at the first device;
detecting a positioning of the message receiving user relative to the second device; and
causing the message to be presented at the second device to the message receiving user, the message being presented with a display of the avatar, the avatar being displayed in a manner to convey the expressive intent of the message sending user, and by at least causing presentation of the avatar to be based on the detected positioning of the message receiving user relative to the second device,
wherein the avatar and the message are displayed simultaneously with (i) a copy of a previous avatar that is associated with a previous message and (ii) the previous message, and
wherein, while the avatar displays the expressive intent of the message, the copy of the previous avatar simultaneously animates a previous expressive intent that is associated with the previous message.
