# US 2023/0066231 A1 · Contextual messaging in video conference

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2023/0066231 A1
- Document ID: US20230066231A1
- Status: Published application
- Kind: A1
- Application number: 17/463,010
- Filed: 2021-08-31
- Published: 2023-03-02
- Earliest claimed: 2021-08-31
- Assignees: Microsoft Technology Licensing, LLC
- Applicants: Microsoft Technology Licensing, LLC
- Inventors: Ryen William White; Peter Bailey
- Web page: https://patentgrep.com/patent/US20230066231A1

## CPC

- H04L 51/046: Interoperability with other network applications or services
- H04N 7/147: {Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals (selecting H04Q)}
- G06F 3/0481: based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
- G06V 20/40: in video content (extracting overlay text G06V20/62; video retrieval G06F16/70; processing of video elementary streams in video servers H04N21/234; processing of video elementary streams in video clients H04N21/44)
- H04L 65/403: Arrangements for multi-party communication, e.g. for conferences (data switching systems for conference H04L12/18; arrangements for connecting several subscribers to a common circuit, i.e. affording conference facilities H04M3/56; television conferencing systems H04N7/15)
- H04N 7/15: Conference systems
- G06F 2203/04804: Transparency, e.g. transparent or translucent windows
- G06V 20/44: {Event detection}
- G06V 40/20: Movements or behaviour, e.g. gesture recognition (recognition of facial expressions G06V40/16)
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

Generally discussed herein are devices, systems, and methods for contextual messaging in a conference. A method can include receiving, by a first user interface, data indicating content of a message, a recipient of the message, and a condition that, when satisfied during the conference, causes the message to be visually displayed during the audiovisual conference, while the conference is being held via an audiovisual conference application, monitoring user contextual data for whether the condition is satisfied, responsive to the condition being satisfied, augmenting audiovisual conference data from the audiovisual conference application to include the message resulting in augmented audiovisual data, and providing, to the recipient on a second user interface of the audiovisual conference application, a view of the augmented audiovisual data.

## Claims

### Claim 1

A method for contextual messaging in an audiovisual conference, the method comprising:
receiving, by a first user interface, data indicating content of a message, a recipient of the message, and a condition that, when satisfied during the conference, causes the message to be visually displayed during the audiovisual conference;
while the conference is being held via an audiovisual conference application, monitoring user contextual data for whether the condition is satisfied;
responsive to the condition being satisfied, augmenting audiovisual conference data from the audiovisual conference application to include the message resulting in augmented audiovisual data; and
providing, to the recipient on a second user interface of the audiovisual conference application, a view of the augmented audiovisual data.

### Claim 2 (depends on 1)

The method of claim 1, wherein the data further indicates a location on the second user interface to present the message and the content of the message is presented at the location on the second user interface.

### Claim 3 (depends on 1)

The method of claim 1, wherein the audiovisual conference application is executed on a client or a server.

### Claim 4 (depends on 1)

The method of claim 1, wherein the data further indicates a form of the content of the message, the form including a type of presentation of the content, the type including ticker tape, thought bubble, notification, hyperlink, or text box.

### Claim 5 (depends on 4)

The method of claim 4, wherein the form further includes a visual transparency of the content of the message.

### Claim 6 (depends on 1)

The method of claim 1, wherein the recipient of the data includes a characteristic condition that indicates that only users that satisfy the characteristic condition receive the content of the message.

### Claim 7 (depends on 6)

The method of claim 6, wherein the data further includes a criterion that defines a further characteristic condition that defines which portions of the content of the message are provided to the recipient.

### Claim 8 (depends on 1)

The method of claim 1, wherein the condition includes an event occurring in audiovisual data of the conference, the event including a gesture being performed, a phrase being spoken, a time elapsing, check of user contextual information, or an object appearing.

### Claim 9 (depends on 1)

The method of claim 1, wherein the user contextual information includes a job title, education status, expertise, task status, training status, device type, or current location.

### Claim 10 (depends on 1)

The method of claim 1, further comprising:
receiving, by the first user interface, data indicating content of a second message, a second, different recipient of the second message, and a second condition that, when satisfied, causes the second message to be displayed during the conference;
while the conference is being held via a conference application, monitoring, by the conference application, audiovisual data of the conference for whether the second condition is satisfied;
responsive to the second condition being satisfied, augmenting the audiovisual data to include the second message resulting in second augmented audiovisual data; and
providing, to the second recipient on a third user interface of the conference application, a view of the augmented audiovisual data.

### Claim 11 (depends on 1)

The method of claim 1, wherein the recipient is only a presenter participant.

### Claim 12

A compute device compri sing:
processing circuitry; and
a memory coupled to the processing circuitry, the memory including instructions that, when executed by the processing circuitry, cause the processing circuitry to perform operations for contextual messaging in an audiovisual conference, the operations comprising:
receiving, by a first user interface, data indicating content of a message, a recipient of the message, and a condition that, when satisfied during the conference, causes the message to be visually displayed during the audiovisual conference;
while the conference is being held via an audiovisual conference application, monitoring user contextual data for whether the condition is satisfied;
responsive to the condition being satisfied, augmenting audiovisual conference data from the audiovisual conference application to include the message
resulting in augmented audiovisual data; and
providing, to the recipient on a second user interface of the audiovisual conference application, a view of the augmented audiovisual data.

### Claim 13 (depends on 12)

The compute device of claim 12, wherein the data further indicates a location on the second user interface to present the message and the content of the message is presented at the location on the second user interface.

### Claim 14 (depends on 12)

The compute device of claim 12, wherein the data further indicates a form of the content of the message, the form including a type of presentation of the content, the type including ticker tape, thought bubble, or text box.

### Claim 15 (depends on 14)

The compute device of claim 14, wherein the form further includes a visual transparency of the content of the message.

### Claim 16 (depends on 12)

The compute device of claim 12, wherein the recipient of the data includes a characteristic condition that indicates that only users that satisfy the characteristic condition receive the content of the message.

### Claim 17 (depends on 16)

The compute device of claim 16, wherein the data further includes a criterion that defines a further characteristic condition that defines which portions of the content of the message are provided to the recipient.

### Claim 18

A user interface for an audiovisual conference compatible application, the user interface configured to perform operations comprising:
receiving data indicating content of a message, a recipient of the message, and a condition that, when satisfied during the conference, causes the message to be visually displayed during the audiovisual conference; and
storing the received data such that, while the conference is being held via an audiovisual conference application, the audiovisual conference application monitors for whether the condition is satisfied and responsive to the condition being satisfied, augments the audiovisual data to include the message resulting in augmented audiovisual data.

### Claim 19 (depends on 18)

The user interface of claim 18, wherein the condition includes an event occurring in audiovisual data of the conference, the event including a gesture being performed, a phrase being spoken, a time elapsing, or an object appearing.

### Claim 20 (depends on 18)

The user interface of claim 18, wherein the operations further comprise:
receiving data indicating content of a second message, a second, different recipient of the second message, and a second condition that, when satisfied, causes the second message to be displayed during the conference; and
storing the received data such that, while the conference is being held via an audiovisual conference application, the audiovisual conference application monitors for whether the sconed condition is satisfied and responsive to the second condition being satisfied, augments the audiovisual data to include the second message resulting in second augmented audiovisual data.
