# US 2025/0097272 A1 · Meeting Visualizer

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0097272 A1
- Document ID: US20250097272A1
- Status: Published application
- Kind: A1
- Application number: 18/471,210
- Filed: 2023-09-20
- Published: 2025-03-20
- Earliest claimed: 2023-09-20
- Assignees: Microsoft Technology Licensing, LLC
- Applicants: Microsoft Technology Licensing, LLC
- Inventors: Candice Allison LAM; Adam Michael GLEISNER; Francois ROUAIX; Sarah Ragab Ismail SALEH; Erez KIKIN-GIL; Ian William MIKUTEL
- Web page: https://patentgrep.com/patent/US20250097272A1

## CPC

- H04L 65/1059: End-user terminal functionalities specially adapted for real-time communication
- G06F 3/167: {Audio in a user interface, e.g. using voice commands for navigating, audio feedback}
- G06F 40/30: Semantic analysis
- G06F 40/35: Discourse or dialogue representation
- G10L 15/00: Speech recognition (G10L17/00 takes precedence)
- G06F 2203/04803: Split screen, i.e. subdividing the display area or the window area into separate subareas
- H04L 51/02: using automatic reactions or user delegation, e.g. automatic replies or chatbot-generated messages
- H04L 65/403: Arrangements for multi-party communication, e.g. for conferences (data switching systems for conference H04L12/18; arrangements for connecting several subscribers to a common circuit, i.e. affording conference facilities H04M3/56; television conferencing systems H04N7/15)
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING

## Abstract

A data processing system implements techniques for automatically generating visualizations of content for meetings on an online communications platform. The visualizations are interactive and encourage participant engagement. The system automatically generates the visualizations based on a transcript of the meeting and other information associated with the meeting as the meeting is taking place. The system determines a meeting category based on this information and suggests a visualization layout based on the meeting category. The system then automatically generates the visualization using a generative language model. The generative language model generates interactive visualization based on the suggested visualization layout and transcript of the meeting and other information associated with the meeting as the meeting. The interactive visualization is then presented to the participants of the online communication session via the online communications platform to enable the participants to collaborate on the interactive visualization.

## Claims

### Claim 1

A data processing system comprising:
a processor; and
a memory storing executable instructions that, when executed, cause the processor alone or in combination with other processors to perform operations of:
detecting an occurrence of a trigger condition during an online communication session among a plurality of client devices associated with participants of the online communication session, the occurrence of the trigger condition indicating that a visualization of content associated with the online communication session should be generated and presented on the client devices associated with the participants of the online communication session;
selecting a candidate visualization layout from a plurality of visualization layouts in a visualization layout datastore based on the meeting category associated with the online communication session;
constructing a prompt for a language model based on the selected candidate visualization layout and a transcript of the online communication session;
providing the prompt as an input to a language model;
obtaining visualization information as an output from the language model, wherein the visualization information is formatted according to the selected candidate layout and includes information based on the transcript, the additional information associated with the online communication session, or both;
causing the plurality of client devices associated with the participants of the online communication session to present an interactive virtual whiteboard populated with the visualization information on a user interface of the plurality of client devices; and
synchronizing the changes to the visualization information among the plurality of client devices during the online communication session.

### Claim 2 (depends on 1)

The data processing system of claim 1, wherein the memory further includes instructions configured to cause the processor alone or in combination with other processors to perform operations of:
analyzing information associated with the online communication session to determine a meeting category associated with the online communication session, wherein analyzing the information associated with the online communication session includes generating a transcript of an audio portion of the online communication session using a transcription model, and analyzing the transcript and additional information associated with the online communication session as an input to a categorization model that outputs the meeting category associated with the online communication session.

### Claim 3 (depends on 1)

The data processing system of claim 1, wherein selecting a candidate visualization layout further comprises:
selecting a set of candidate visualization layouts from a plurality of visualization layouts in a visualization layout datastore based on the meeting category associated with the online communication session;
causing a client device of a participant to the online communication session to present the set of candidate visualization layouts on a user interface of the client device;
receiving an indication from the client device indicating a selected candidate layout from among the plurality of candidate visualization layouts.

### Claim 4 (depends on 1)

The data processing system of claim 1, wherein the user interface provides controls that enable users of the plurality of client devices to make changes to the visualization information.

### Claim 5 (depends on 1)

The data processing system of claim 1, wherein detecting the occurrence of the trigger condition further comprises:
detecting an indication received from a control of the user interface of a communications application on the client device of a participant of the online communication session indicating that the participant has requested that the visualization be created for the online communication session.

### Claim 6 (depends on 1)

The data processing system of claim 1, wherein detecting the occurrence of the trigger condition further comprises:
analyzing natural language prompts using the language model to detect a use of one or more trigger words, phrases, or questions that indicate that the visualization should be created for the online communication session, the natural language prompts being submitted through a user interface of a communication application on the client device of a participant of the online communication session; and
receiving an output from the language model indicating the occurrence of the trigger condition responsive to detecting the use of the one or more trigger words, phrases, or questions in the user prompts.

### Claim 7 (depends on 1)

The data processing system of claim 1, wherein detecting the occurrence of the trigger condition further comprises:
obtaining the transcript and the additional information associated with the online communication session;
analyzing the transcript and additional information associated with the online communication session using the language model to obtain a prediction whether the transcript and the additional information indicate that a visualization recommendation should be made to a participant of the online communication session; and
detecting the occurrence of the trigger condition responsive to the language model outputting the prediction that the visualization recommendation should be made.

### Claim 8 (depends on 1)

The data processing system of claim 1, wherein the additional information associated with the online communication session includes messages from a meeting chat associated with the online communication session, whether screen sharing of content is currently occurring, attendee information for the participants to the online communication session, or a combination thereof.

### Claim 9 (depends on 1)

The data processing system of claim 1, wherein selecting the set of candidate visualization layouts from the plurality of visualization layouts further comprises:
ranking candidate visualization layouts selected for the meeting category based on a frequency with which the candidate visualization layouts are selected for the meeting category; and
selecting highest ranking candidate visualization layouts to include in the set of candidate visualization layouts.

### Claim 10 (depends on 1)

The data processing system of claim 1, wherein causing a client device of a participant to the online communication session to present the candidate visualization layouts further comprises:
causing the client device of the participant to display a candidate visualization layout pane that displays the set of candidate visualization layouts, the candidate visualization pane including a preview of each visualization layout of the set of candidate visualization layouts.

### Claim 11 (depends on 1)

The data processing system of claim 1, wherein the memory further includes instructions configured to cause the processor alone or in combination with other processors to perform operations of:
detecting the occurrence of a second trigger condition during the online communication session, the occurrence of the trigger condition indicating that a change in topic has occurred by analyzing the transcript and messages from a meeting chat associated with the online communication session using the language model;
responsive to detecting the occurrence of the second trigger condition, selecting a set of second candidate visualization layouts from the plurality of visualization layouts in the visualization layout datastore based on the meeting category associated with the online communication session and a current topic; and
causing the client device of the participant to the online communication session to present the set of second candidate visualization layouts on a user interface of the client device.

### Claim 12 (depends on 1)

The data processing system of claim 1, wherein the memory further includes instructions configured to cause the processor alone or in combination with other processors to perform operations of:
detecting that the online communication session is ending; and
automatically saving the visualization information to a persistent datastore accessible to the participants of the online communication session after the online communication session has ended.

### Claim 13 (depends on 1)

The data processing system of claim 1, wherein the language model comprises a Large Language Model (LLM).

### Claim 14

A method implemented in a data processing system for automatically generating visualizations for online communication sessions, the method comprising:
detecting an occurrence of a trigger condition during an online communication session among a plurality of client devices associated with participants of the online communication session, the occurrence of the trigger condition indicating that a visualization of content associated with the online communication session should be generated and presented on the client devices associated with the participants of the online communication session;
analyzing information associated with the online communication session to determine a meeting category associated with the online communication session, wherein analyzing the information associated with the online communication session includes generating a transcript of an audio portion of the online communication session using a transcription model, and analyzing the transcript and additional information associated with the online communication session as an input to a categorization model that outputs the meeting category associated with the online communication session;
selecting a set of candidate visualization layouts from a plurality of visualization layouts in a visualization layout datastore based on the meeting category associated with the online communication session;
causing a client device of a participant to the online communication session to present the set of candidate visualization layouts on a user interface of the client device;
receiving an indication from the client device indicating a selected candidate layout from among the plurality of candidate visualization layouts;
providing the selected candidate layout, the transcript, and the additional information associated with the online communication session as an input to a language model;
obtaining visualization information as an output from the language model, wherein the visualization information is formatted according to the selected candidate layout and includes information based on the transcript, the additional information associated with the online communication session, or both;
causing the plurality of client devices associated with the participants of the online communication session to present the visualization information in an interactive workspace on a user interface of the plurality of client devices, wherein the user interface provides controls that enable users of the plurality of client devices to make changes to the visualization information; and
synchronizing the changes to the visualization information among the plurality of client devices during the online communication session.

### Claim 15 (depends on 14)

The method of claim 14, wherein detecting the occurrence of the trigger condition further comprises:
detecting an indication received from a control of the user interface of a communications application on the client device of a participant of the online communication session indicating that the participant has requested that the visualization be created for the online communication session.

### Claim 16 (depends on 14)

The method of claim 14, wherein detecting the occurrence of the trigger condition further comprises:
analyzing natural language prompts using the language model to detect a use of one or more trigger words, phrases, or questions that indicate that the visualization should be created for the online communication session, the natural language prompts being submitted through a user interface of a communication application on the client device of a participant of the online communication session; and
receiving an output from the language model indicating the occurrence of the trigger condition responsive to detecting the use of the one or more trigger words, phrases, or questions in the user prompts.

### Claim 17 (depends on 14)

The method of claim 14, wherein detecting the occurrence of the trigger condition further comprises:
obtaining the transcript and the additional information associated with the online communication session;
analyzing the transcript and additional information associated with the online communication session using the language model to obtain a prediction whether the transcript and the additional information indicate that a visualization recommendation should be made to a participant of the online communication session; and
detecting the occurrence of the trigger condition responsive to the language model outputting the prediction that the visualization recommendation should be made.

### Claim 18

A data processing system comprising:
a processor; and
a memory storing executable instructions that, when executed, cause the processor alone or in combination with other processors to perform operations of:
establishing an online communication session with a first application on a plurality of client devices of participants to the online communication session;
receiving an indication to generate a visualization of content of the online communication session;
constructing a prompt for a language model based on a transcript of the online communication session;
providing the prompt as an input to a language model;
obtaining visualization information as an output from the language model, wherein the visualization information is formatted according to a layout generated by the language model and includes information based on the transcript;
causing the plurality of client devices associated with the participants of the online communication session to present the visualization information in an interactive workspace on a user interface of the plurality of client devices, wherein the user interface provides controls that enable users of the plurality of client devices to make changes to the visualization information; and
synchronizing the changes to the visualization information among the plurality of client devices during the online communication session.

### Claim 19 (depends on 18)

The data processing system of claim 18, wherein the memory further includes instructions configured to cause the processor alone or in combination with other processors to perform operations of:
analyzing the transcript of the online communication session to determine a meeting category associated with the online communication session; and
wherein constructing the prompt further comprises constructing the prompt for the language model based on the transcript of the online communication session and the meeting category.

### Claim 20 (depends on 18)

The data processing system of claim 18, wherein the constructing the prompt for a language model based on a transcript of the online communication session further comprises:
constructing the prompt to include instructions to the language model to generate a set of candidate visualization layouts based on the transcript in which each of the candidate visualization layouts is formatted according to a different layout generated by the language model and include information based on the transcript,
wherein obtaining the visualization information further comprises receiving the set of candidate visualization layouts, and
wherein receiving the indication to generate the visualization of content of the online communication session further comprises:
causing a client device of a participant to the online communication session to present the set of candidate visualization layouts on a user interface of the client device;
receiving an indication from the client device indicating a selected candidate layout from among the plurality of candidate visualization layouts, and wherein
causing the plurality of client devices associated with the participants of the online communication session to present the visualization information further comprises causing the plurality of client devices to present the selected candidate layout.
