US 2025/0097272 A1Published application

Meeting Visualizer

AssigneeMicrosoft Technology Licensing, LLC

InventorsCandice Allison LAM, Adam Michael GLEISNER, Francois ROUAIX, Sarah Ragab Ismail SALEH, Erez KIKIN-GIL, Ian William MIKUTEL

Life of this patent

Estimating the term…

patentgrep

Loading patent…

Abstract

A data processing system implements techniques for automatically generating visualizations of content for meetings on an online communications platform. The visualizations are interactive and encourage participant engagement. The system automatically generates the visualizations based on a transcript of the meeting and other information associated with the meeting as the meeting is taking place. The system determines a meeting category based on this information and suggests a visualization layout based on the meeting category. The system then automatically generates the visualization using a generative language model. The generative language model generates interactive visualization based on the suggested visualization layout and transcript of the meeting and other information associated with the meeting as the meeting. The interactive visualization is then presented to the participants of the online communication session via the online communications platform to enable the participants to collaborate on the interactive visualization.

Claims20

Dependent claims

A data processing system comprising:

a processor;
and
a memory storing executable instructions that, when executed, cause the processor alone or in combination with other processors to perform operations of:
detecting an occurrence of a trigger condition during an online communication session among a plurality of client devices associated with participants of the online communication session, the occurrence of the trigger condition indicating that a visualization of content associated with the online communication session should be generated and presented on the client devices associated with the participants of the online communication session;
selecting a candidate visualization layout from a plurality of visualization layouts in a visualization layout datastore based on the meeting category associated with the online communication session;
constructing a prompt for a language model based on the selected candidate visualization layout and a transcript of the online communication session;
providing the prompt as an input to a language model;
obtaining visualization information as an output from the language model, wherein the visualization information is formatted according to the selected candidate layout and includes information based on the transcript, the additional information associated with the online communication session, or both;
causing the plurality of client devices associated with the participants of the online communication session to present an interactive virtual whiteboard populated with the visualization information on a user interface of the plurality of client devices;
and
synchronizing the changes to the visualization information among the plurality of client devices during the online communication session.

8 more elements

A method implemented in a data processing system for automatically generating visualizations for online communication sessions, the method comprising:

detecting an occurrence of a trigger condition during an online communication session among a plurality of client devices associated with participants of the online communication session, the occurrence of the trigger condition indicating that a visualization of content associated with the online communication session should be generated and presented on the client devices associated with the participants of the online communication session;
analyzing information associated with the online communication session to determine a meeting category associated with the online communication session, wherein analyzing the information associated with the online communication session includes generating a transcript of an audio portion of the online communication session using a transcription model, and analyzing the transcript and additional information associated with the online communication session as an input to a categorization model that outputs the meeting category associated with the online communication session;
selecting a set of candidate visualization layouts from a plurality of visualization layouts in a visualization layout datastore based on the meeting category associated with the online communication session;
causing a client device of a participant to the online communication session to present the set of candidate visualization layouts on a user interface of the client device;
receiving an indication from the client device indicating a selected candidate layout from among the plurality of candidate visualization layouts;
providing the selected candidate layout, the transcript, and the additional information associated with the online communication session as an input to a language model;
obtaining visualization information as an output from the language model, wherein the visualization information is formatted according to the selected candidate layout and includes information based on the transcript, the additional information associated with the online communication session, or both;
causing the plurality of client devices associated with the participants of the online communication session to present the visualization information in an interactive workspace on a user interface of the plurality of client devices, wherein the user interface provides controls that enable users of the plurality of client devices to make changes to the visualization information;
and
synchronizing the changes to the visualization information among the plurality of client devices during the online communication session.

7 more elements

A data processing system comprising:

a processor;
and
a memory storing executable instructions that, when executed, cause the processor alone or in combination with other processors to perform operations of:
establishing an online communication session with a first application on a plurality of client devices of participants to the online communication session;
receiving an indication to generate a visualization of content of the online communication session;
constructing a prompt for a language model based on a transcript of the online communication session;
providing the prompt as an input to a language model;
obtaining visualization information as an output from the language model, wherein the visualization information is formatted according to a layout generated by the language model and includes information based on the transcript;
causing the plurality of client devices associated with the participants of the online communication session to present the visualization information in an interactive workspace on a user interface of the plurality of client devices, wherein the user interface provides controls that enable users of the plurality of client devices to make changes to the visualization information;
and
synchronizing the changes to the visualization information among the plurality of client devices during the online communication session.

8 more elements

Dependencies are inferred from the claim text.

Facts

Application: 18/471,210Filed 20 Sep 2023
Published: 20 Mar 2025
Term ends: Not estimatedThe source records don’t support an estimate.

Classification11 codes

H04L 65/1059
Architectures or entities: end-user terminal functionalities specially adapted for real-time communication
G06F 3/167
Sound input; Sound output: audio in a user interface, e.g. using voice commands for navigating, audio feedback
G06F 40/30
Handling natural language data: semantic analysis
G06F 40/35
Semantic analysis: discourse or dialogue representation

Family

US 12,771,734 B2Related patent
US 2025/0097272 A1This patent

From the US filing history. Foreign family members aren’t listed.

Timeline

Citations

Open elsewhere

Building an agent or pulling many patents? Use the API or MCP server instead of scraping pages. Get an API key