# US 11,909,922 B2 · Automatic reaction-triggering for live presentations

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 11,909,922 B2
- Document ID: US11909922B2
- Status: Granted
- Kind: B2
- Application number: 18/155,918
- Filed: 2023-01-18
- Published: 2023-05-18
- Granted: 2024-02-20
- Earliest claimed: 2020-08-03
- Assignees: Microsoft Technology Licensing, LLC
- Applicants: Microsoft Technology Licensing, LLC
- Inventors: Ji Li; Amit Srivastava; Derek Martin Johnson; Priyanka Vikram Sinha; Konstantin Seleskerov; Gencheng Wu
- Web page: https://patentgrep.com/patent/US11909922B2

## CPC

- G06Q 10/10: Office automation; Time management
- H04M 3/568: {audio processing specific to telephonic conferencing, e.g. spatial distribution, mixing of participants (echo suppression in two-way loud-speaking telephone systems H04M9/02; sound field processing per se H04S7/30)}
- G06N 3/0464: Convolutional networks [CNN, ConvNet]
- G06N 3/08: Learning methods
- G06N 3/0895: Weakly supervised learning, e.g. semi-supervised or self-supervised learning
- G06N 3/09: Supervised learning
- H04L 12/1818: {Conference organisation arrangements, e.g. handling schedules, setting up parameters needed by nodes to attend a conference, booking network resources, notifying involved parties}
- H04L 12/1822: {Conducting the conference, e.g. admission, detection, selection or grouping of participants, correlating users to one or more conference sessions, prioritising transmission}
- H04L 65/4015: {where at least one of the additional parallel sessions is real time or time sensitive, e.g. white board sharing, collaboration or spawning of a subconference}
- H04L 65/403: Arrangements for multi-party communication, e.g. for conferences (data switching systems for conference H04L12/18; arrangements for connecting several subscribers to a common circuit, i.e. affording conference facilities H04M3/56; television conferencing systems H04N7/15)
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- H04M: TELEPHONIC COMMUNICATION (circuits for controlling other apparatus via a telephone cable and not involving telephone switching apparatus G08)
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)

## Abstract

The present disclosure relates to processing operations configured to provide processing that automatically analyzes acoustic signals from attendees of a live presentation and automatically triggers corresponding reaction indications from results of analysis thereof. Exemplary reaction indications provide feedback for live presentations that can be presented in real-time (or near real-time) without requiring a user to manually take action to provide any feedback. As a non-limiting example, reaction indications may be presented in a form that is easy to visualize and understand such as emojis or icons. Another example of a reaction indication is a graphical user interface (GUI) notification that provides a predictive indication of user intent derived from analysis of acoustic signals. Further examples described herein extend to training and application of artificial intelligence (AI) processing, in real-time (or near real-time), that is configured to automatically analyze acoustic features of audio streams and automatically generate exemplary reaction indications.

## Claims

### Claim 1

A computer-implemented method comprising:
providing a presenter graphical user interface (GUI) to a presenter of a live presentation via a cloud-based service, wherein the presenter GUI comprises a first panel comprising electronic data for presentation during the live presentation and a second panel comprising audience data related to audience members of the live presentation;
providing an audience GUI to the audience members accessing the live presentation via the cloud-based service for the audience members to view the live presentation;
receiving a plurality of audio streams via the audience GUI, wherein each audio stream is from one of the audience members;
for each audio stream:
selecting, based on a classification of the respective audience member, a trained artificial intelligence (AI) model from a plurality of trained AI models each trained for a specific classification, wherein the trained AI model is configured to automatically analyze acoustic features of the audio streams,
applying the selected AI model to the audio stream, and
generating reaction indications for the respective audience member, each reaction indication of the reaction indications providing a visual representation of user reactions to a portion of the live presentation based on a result of the analysis of the acoustic features of the audio stream; and
updating the presenter GUI with the reaction indications as the reaction indications are generated during the live presentation.

### Claim 2 (depends on 1)

The computer-implemented method of claim 1, wherein the presenter GUI comprises a selectable GUI feature to toggle reaction indication updates on and off.

### Claim 3 (depends on 1)

The computer-implemented method of claim 1, wherein each of the reaction indications is an emoji that is visually representative of a specific user reaction to the live presentation based on an audio stream associated with a specific user.

### Claim 4 (depends on 3)

The computer-implemented method of claim 3, wherein a presentation of the emoji is based on an intensity of the reaction indication.

### Claim 5 (depends on 4)

The computer-implemented method of claim 4, wherein the intensity is determined based on a volume of the audio stream associated with the specific user.

### Claim 6 (depends on 4)

The computer-implemented method of claim 4, wherein the intensity is determined based on a number of the plurality of audio streams having a same user reaction.

### Claim 7 (depends on 1)

The computer-implemented method of claim 1, wherein each of the reaction indications is an emoji that is visually representative of aggregated user reactions to the live presentation.

### Claim 8 (depends on 1)

The computer-implemented method of claim 1, wherein at least one reaction indication is a notification providing a suggested intent for the respective audience member to aid interaction during the live presentation.

### Claim 9 (depends on 1)

The computer-implemented method of claim 1, wherein the audience GUI comprises a selectable GUI feature to control whether an audio stream of the respective audience member is monitored and included in the reaction indications.

### Claim 10 (depends on 1)

The computer-implemented method of claim 1, wherein the classification is a locational classification.

### Claim 11

A system comprising:
at least one processor; and
a memory, operatively connected with the at least one processor, storing computer-executable instructions that, upon execution by the at least one processor, cause the at least one processor to:
provide a presenter graphical user interface (GUI) to a presenter of a live presentation via a cloud-based service, wherein the presenter GUI comprises a first panel comprising electronic data for presentation during the live presentation and a second panel comprising audience data related to audience members of the live presentation;
provide an audience GUI to the audience members accessing the live presentation via the cloud-based service for the audience members to view the live presentation;
receive a plurality of audio streams via the audience GUI, wherein each audio stream is from one of the audience members;
for each audio stream:
select, based on a classification of the respective audience member, a trained artificial intelligence (AI) model from a plurality of trained AI models each trained for a specific classification, wherein the trained AI model is configured to automatically analyze acoustic features of the audio streams,
apply the selected AI model to the audio stream, and
generate reaction indications for the respective audience member, each reaction indication of the reaction indications providing a visual representation of user reactions to a portion of the live presentation based on a result of the analysis of the acoustic features of the audio stream; and
update the presenter GUI with the reaction indications as the reaction indications are generated during the live presentation.

### Claim 12 (depends on 11)

The system of claim 11, wherein the presenter GUI comprises a selectable GUI feature to toggle reaction indication updates on and off.

### Claim 13 (depends on 11)

The system of claim 11, wherein each of the reaction indications is an emoji that is visually representative of a specific user reaction to the live presentation based on an audio stream associated with a specific user.

### Claim 14 (depends on 13)

The system of claim 13, wherein a presentation of the emoji is based on an intensity of the reaction indication.

### Claim 15 (depends on 14)

The system of claim 14, wherein the intensity is determined based on a volume of the audio stream associated with the specific user.

### Claim 16 (depends on 14)

The system of claim 14, wherein the intensity is determined based on a number of the plurality of audio streams having a same user reaction.

### Claim 17 (depends on 11)

The system of claim 11, wherein each of the reaction indications is an emoji that is visually representative of aggregated user reactions to the live presentation.

### Claim 18 (depends on 11)

The system of claim 11, wherein at least one reaction indication is a notification providing a suggested intent for the respective audience member to aid interaction during the live presentation.

### Claim 19 (depends on 11)

The system of claim 11, wherein the audience GUI comprises a selectable GUI feature to control whether an audio stream of the respective audience member is monitored and included in the reaction indications.

### Claim 20 (depends on 11)

The system of claim 11, wherein the classification is a locational classification.