# US 2026/0017070 A1 · Enhanced controls for the display of real-time text in calls and meetings

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2026/0017070 A1
- Document ID: US20260017070A1
- Status: Published application
- Kind: A1
- Application number: 18/768,962
- Filed: 2024-07-10
- Published: 2026-01-15
- Earliest claimed: 2024-07-10
- Assignees: Microsoft Technology Licensing, LLC
- Applicants: Microsoft Technology Licensing, LLC
- Inventors: Christopher M. SANO; Ralph Georges MAAMARI; Shery Sharonjit SUMAL; Purnima M. RAO; Patrick A. LYONS; Yashu XU
- Web page: https://patentgrep.com/patent/US20260017070A1

## CPC

- G06F 9/451: Execution arrangements for user interfaces
- H04L 12/1822: {Conducting the conference, e.g. admission, detection, selection or grouping of participants, correlating users to one or more conference sessions, prioritising transmission}
- G10L 15/26: Speech to text systems (G10L15/08 takes precedence)
- H04L 12/1813: {for computer conferences, e.g. chat rooms (instant messaging H04L51/04; protocols for multimedia communication H04L65/1101; arrangements for multi-party communication H04L65/403; telephonic conference arrangements H04M3/56; television conference systems H04N7/15)}
- H04L 51/046: Interoperability with other network applications or services
- H04L 65/1089: by adding media; by removing media
- H04L 65/4015: {where at least one of the additional parallel sessions is real time or time sensitive, e.g. white board sharing, collaboration or spawning of a subconference}
- H04L 65/403: Arrangements for multi-party communication, e.g. for conferences (data switching systems for conference H04L12/18; arrangements for connecting several subscribers to a common circuit, i.e. affording conference facilities H04M3/56; television conferencing systems H04N7/15)
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING

## Abstract

The techniques disclosed herein provide enhanced controls for the display of real-time text (RTT) in calls and meetings. RTT is the ability for someone to send a text message on a character-by-character basis to everybody else in a call or meeting. The system disclosed herein integrates RTT, video, and live captions all in one central experience. This integrated experience allows users to participate equitably by making RTT accessible to users regardless of the operating mode they are in and still concurrently access other meeting content, including video streams, chat messages, live captions, transcripts, and artificial intelligence (AI) tools, such as Copilot. In one embodiment, during an online conference, in response to one of the attendees activating a RTT mode, when at least one user minimizes a meeting stage, such as for the purpose of multitasking while listening, the conference application maintains a display area for displaying RTT.

## Claims

### Claim 1

A method, executed by a data processing system, for controlling a user interface of a communication session comprising a display of the real-time text communicated to meeting participants, the method comprising:
during the communication session, invoking a real-time text mode for generating the real-time text, the generation of the real-time text comprising:
communicating individual text characters from a first computing device to a plurality of computing devices of individual meeting participants on a character-by-character basis, wherein each of the individual text characters are separately transmitted from the first computing device to the plurality of computing devices in response to individual character input entries received at the first computing device, and
causing a display of the individual text characters at the plurality of computing devices of individual meeting participants, wherein the individual text characters are each displayed as they are received at each of the plurality of computing devices from the first computing device;
while in the real-time text mode:
causing a display of a first user interface arrangement on the first computing device, wherein the first user interface arrangement comprising a first display region reserved for displaying the real-time text and a second display region reserved for displaying at least one of a video stream or an image shared between computing devices participating in the communication session;
receiving an input to reduce a size of the first user interface arrangement concurrently displaying the real-time text and the at least one of the video stream or the image;
in response to the input to reduce the size of the first user interface arrangement,
maintaining the display of the real-time text while,
reducing the size of the first user interface arrangement, wherein the reduction of the size of the first user interface arrangement reduces a size of the at least one of the video stream or the image or a number of displayed video streams or images.

### Claim 2 (depends on 1)

The method of claim 1, further comprising: determining that the plurality of computing devices includes all of the computing devices of the communication session.

### Claim 3 (depends on 1)

The method of claim 1, wherein maintaining the display of the real-time text while reducing the size of the first user interface arrangement, comprises:
causing a display of a second user interface arrangement comprising the real-time text without the at least one of a video stream or an image, and
generating a modified user interface arrangement having a reduced size relative to a size of the first user interface arrangement, wherein the modified user interface arrangement comprises a fewer number of video streams or images than a number of video streams or images of the first user interface arrangement.

### Claim 4 (depends on 1)

The method of claim 1, wherein maintaining the display of the real-time text while reducing the size of the first user interface arrangement, comprises:
causing a display of a second user interface arrangement comprising the real-time text without the at least one of a video stream or an image, and
generating a modified user interface arrangement having selectable graphical elements for controlling the communication session, wherein the modified user interface arrangement does not include the at least one of the video stream or the image.

### Claim 5 (depends on 1)

The method of claim 1, wherein maintaining the display of the real-time text while reducing the size of the first user interface arrangement, comprises:
causing a display of a second user interface arrangement comprising the real-time text without the at least one of a video stream or an image, and
reducing the size of the first user interface arrangement, comprises removing the display of the first user interface arrangement.

### Claim 6 (depends on 1)

The method of claim 1, further comprising: generating an audio signal comprising a computer-generated voice enunciating the real-time text received at each client device of the communication session.

### Claim 7 (depends on 1)

The method of claim 1, further comprising:
generating a graphical element in proximity to a video rendering, an image, or an identifier to bring visual focus to a user associated with the first computing device receiving the character input for the real-time text;
determining that the character input for the real-time text has stopped for a predetermined period of time; and
in response to determining that the character input for the real-time text has stopped for a predetermined period of time:
removing the graphical element, and
adding the real-time text to a communication stream as a timestamped entry, wherein the entry is restricted from an addition of real-time text characters.

### Claim 8 (depends on 1)

The method of claim 1, further comprising:
activating a live caption mode in response to an input; and
while in live caption mode:
processing a vocal input from a second computing device participating in the communication session, wherein the vocal input is processed to generate live caption text comprising words that are enunciated in the vocal input, and
adding the live caption text to a communication stream that also includes the real-time text.

### Claim 9 (depends on 1)

The method of claim 1, further comprising:
receiving an input to close the display of the real-time text that is maintained after the input to reduce the size of the first user interface arrangement;
in response to the input to close the display of the real-time text, closing a UI displaying the real-time text that is maintained after the input to reduce the size of the first user interface arrangement;
in response to closing the UI displaying the real-time text, monitoring activity of the computing devices of individual meeting participants to detect an input for contributing real-time text; and
in response to detecting the input for contributing real-time text, re-opening the UI displaying the real-time text.

### Claim 10

A system for controlling a user interface of a communication session comprising a display of the real-time text communicated to meeting participants, the system comprising:
one or more processing units; and
a computer-readable storage medium having encoded thereon computer-executable instructions to cause the one or more processing units to:
during the communication session, invoke a real-time text mode for generating the real-time text, the generation of the real-time text comprising:
communicating individual text characters from a first computing device to a plurality of computing devices of individual meeting participants on a character-by-character basis, wherein each of the individual text characters are separately transmitted from the first computing device to the plurality of computing devices in response to individual character input entries received at the first computing device, and
causing a display of the individual text characters at the plurality of computing devices of individual meeting participants, wherein the individual text characters are each displayed as they are received at each of the plurality of computing devices from the first computing device;
while in the real-time text mode:
cause a display of a first user interface arrangement on the first computing device, wherein the first user interface arrangement comprising a first display region reserved for displaying the real-time text and a second display region reserved for displaying at least one of a video stream or an image shared between computing devices participating in the communication session;
receive an input to reduce a size of the first user interface arrangement concurrently displaying the real-time text and the at least one of the video stream or the image;
in response to the input to reduce the size of the first user interface arrangement,
maintain the display of the real-time text while,
reduce the size of the first user interface arrangement, wherein the reduction of the size of the first user interface arrangement reduces a size of the at least one of the video stream or the image or a number of displayed video streams or images.

### Claim 11 (depends on 10)

The system of claim 10, wherein maintaining the display of the real-time text and reducing the size of the first user interface arrangement, comprises:
causing a display of a second user interface arrangement comprising the real-time text without the at least one of a video stream or an image, and
generating a modified user interface arrangement having a reduced size relative to a size of the first user interface arrangement, wherein the modified user interface arrangement comprises a fewer number of video streams or images than a number of video streams or images of the first user interface arrangement.

### Claim 12 (depends on 10)

The system of claim 10, wherein maintaining the display of the real-time text while reducing the size of the first user interface arrangement, comprises:
causing a display of a second user interface arrangement comprising the real-time text without the at least one of a video stream or an image, and
generating a modified user interface arrangement having selectable graphical elements for controlling the communication session, wherein the modified user interface arrangement does not include the at least one of the video stream or the image.

### Claim 13 (depends on 10)

The system of claim 10, wherein maintaining the display of the real-time text while reducing the size of the first user interface arrangement, comprises:
causing a display of a second user interface arrangement comprising the real-time text without the at least one of a video stream or an image, and
reducing the size of the first user interface arrangement, comprises removing the display of the first user interface arrangement.

### Claim 14 (depends on 10)

The system of claim 10, wherein the instructions further cause the one or more processing units to: generate an audio signal comprising a computer-generated voice enunciating the real-time text received at each client device of the communication session.

### Claim 15 (depends on 10)

The system of claim 10, wherein the instructions further cause the one or more processing units to:
generate a graphical element in proximity to a video rendering, an image, or an identifier to bring visual focus to a user associated with the first computing device receiving the character input for the real-time text;
determine that the character input for the real-time text has stopped for a predetermined period of time; and
in response to determining that the character input for the real-time text has stopped for a predetermined period of time:
remove the graphical element, and
add the real-time text to a communication stream as a timestamped entry, wherein the entry is restricted from an addition of real-time text characters.

### Claim 16

A computer-readable storage medium having encoded thereon computer-executable instructions that cause a data processing system to control a user interface of a communication session comprising a display of the real-time text communicated to meeting participants, the computer-executable instructions causing the one or more processing units of the data processing system to:
during the communication session, invoke a real-time text mode for generating the real-time text, the generation of the real-time text comprising:
communicating individual text characters from a first computing device to a plurality of computing devices of individual meeting participants on a character-by-character basis, wherein each of the individual text characters are separately transmitted from the first computing device to the plurality of computing devices in response to individual character input entries received at the first computing device, and
causing a display of the individual text characters at the plurality of computing devices of individual meeting participants, wherein the individual text characters are each displayed as they are received at each of the plurality of computing devices from the first computing device;
while in the real-time text mode:
cause a display of a first user interface arrangement on the first computing device, wherein the first user interface arrangement comprising a first display region reserved for displaying the real-time text and a second display region reserved for displaying at least one of a video stream or an image shared between computing devices participating in the communication session;
receive an input to reduce a size of the first user interface arrangement concurrently displaying the real-time text and the at least one of the video stream or the image;
in response to the input to reduce the size of the first user interface arrangement,
maintain the display of the real-time text while,
reduce the size of the first user interface arrangement, wherein the reduction of the size of the first user interface arrangement reduces a size of the at least one of the video stream or the image or a number of displayed video streams or images.

### Claim 17 (depends on 16)

The computer-readable storage medium of claim 16, wherein maintaining the display of the real-time text and reducing the size of the first user interface arrangement, comprises:
causing a display of a second user interface arrangement comprising the real-time text without the at least one of a video stream or an image, and
generating a modified user interface arrangement having a reduced size relative to a size of the first user interface arrangement, wherein the modified user interface arrangement comprises a fewer number of video streams or images than a number of video streams or images of the first user interface arrangement.

### Claim 18 (depends on 16)

The computer-readable storage medium of claim 16, wherein maintaining the display of the real-time text while reducing the size of the first user interface arrangement, comprises:
causing a display of a second user interface arrangement comprising the real-time text without the at least one of a video stream or an image, and
generating a modified user interface arrangement having selectable graphical elements for controlling the communication session, wherein the modified user interface arrangement does not include the at least one of the video stream or the image.

### Claim 19 (depends on 16)

The computer-readable storage medium of claim 16, wherein maintaining the display of the real-time text while reducing the size of the first user interface arrangement, comprises:
causing a display of a second user interface arrangement comprising the real-time text without the at least one of a video stream or an image, and
reducing the size of the first user interface arrangement, comprises removing the display of the first user interface arrangement.

### Claim 20 (depends on 16)

The computer-readable storage medium of claim 16, wherein the instructions further cause the one or more processing units to: generate an audio signal comprising a computer-generated voice enunciating the real-time text received at each client device of the communication session.
