# US 2024/0205277 A1 · Automated media event detection and corrective actions for communication sessions

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2024/0205277 A1
- Document ID: US20240205277A1
- Status: Published application
- Kind: A1
- Application number: 18/085,131
- Filed: 2022-12-20
- Published: 2024-06-20
- Earliest claimed: 2022-12-20
- Assignees: Microsoft Technology Licensing, LLC
- Applicants: Microsoft Technology Licensing, LLC
- Inventors: Christopher M. Sano; Brett D. Humphrey
- Web page: https://patentgrep.com/patent/US20240205277A1

## CPC

- H04L 65/1083: In-session procedures
- H04L 65/403: Arrangements for multi-party communication, e.g. for conferences (data switching systems for conference H04L12/18; arrangements for connecting several subscribers to a common circuit, i.e. affording conference facilities H04M3/56; television conferencing systems H04N7/15)
- G06F 3/167: {Audio in a user interface, e.g. using voice commands for navigating, audio feedback}
- H04L 65/1089: by adding media; by removing media
- H04L 67/306: User profiles
- H04L 67/535: {Tracking the activity of the user (network monitoring arrangements H04L43/00; recording of computer activity G06F11/34)}
- H04L 67/02: based on web technology, e.g. hypertext transfer protocol [HTTP]
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

Disclosed in some examples, are methods, systems, and machine-readable mediums which provide for an automated communication session assistant that assists participants in planning and conducting communication sessions that respect one or more media customization settings of other participants. Users of the network-based communication service may register, and store in a user profile, one or more media customization settings. These media customization settings may correlate to one or more rules in a rule data store. Each rule may specify one or more media events that may impact one or more media customization settings of participants. The rules may also describe curative actions, such as prompts to participants and the like.

## Claims

### Claim 1

A method of taking corrective action in response to an event in a communication session of a communication system, the method comprising:
using a hardware processor:
identifying a first setting of a participant in the communication system in a participant profile data structure corresponding to the participant, the participant using a first device in the communication session, the first setting entered by the participant and related to either a physical characteristic of the participant;
selecting a data structure based upon the first setting, the data structure comprising a description of a first media event, an associated first curing action to take in response to detection of the first media event, and a severity level, the first media event comprising one or more of:
an audio prompt to view a visual element, a visual element that does not have an associated audio explanation, or an audio element that does not have an associated visual description;
scanning media of the communication session during the communication session for the first media event, the media of the communication session being audio, video, or shared content of the communication session;
identifying the first media event in the media of the communication session; and
responsive to identifying the first media event:
identifying, based upon an analysis of media of the communication session, a second device where the media indicating the event originated, the second device one of a plurality of devices participating in the communication session, the first and second devices different;
identifying a frequency for which curing actions have been taken during the communication session that are directed to the second device;
determining whether to execute the first curing action based upon the frequency and the severity level of the first setting; and
responsive to determining to execute the first curing action, executing the first curing action targeted at the second device, but not executing the first curing action respective to other of the plurality of devices participating in the communication session.

### Claim 2 (depends on 1)

The method of claim 1, further comprising: after the communication session, presenting a prompt on the second device indicating a plurality of events triggered as a result of media originating from the second device, the plurality of events including at least one event where a second curing action was not executed due to the frequency for which curing actions have been taken during the communication session.

### Claim 3 (depends on 1)

The method of claim 1, further comprising:
providing, prior to the communication session, a report identifying settings of a plurality of participants in the communication session.

### Claim 4 (depends on 3)

The method of claim 3, further comprising:
prior to the communication session, scanning a document included in an invitation to the communication session for a compatibility issue between media in the document and the settings of the plurality of participants in the communication session.

### Claim 5 (depends on 1)

The method of claim 1, further comprising:
identifying a second setting of a second participant in the communication system in a second participant profile data structure corresponding to the second participant, the second participant using a third device in the communication session;
selecting a second data structure based upon the second setting, the second data structure comprising a description of a second media event, and an associated second curing action to take in response to detection of the second media event, the second media event comprising an audio element without subtitles;
wherein scanning the media of the communication session during the communication session comprises scanning for both the first media event and the second media event;
identifying the second media event in the media of the communication session; and
responsive to identifying the second media event:
executing the second associated curing action by automatically creating subtitles.

### Claim 6 (depends on 1)

The method of claim 1, further comprising:
providing a reminder to a second participant of the communication session during the communication session of the first setting.

### Claim 7 (depends on 1)

The method of claim 1, further comprising:
calculating a number of media events detected during a plurality of communication sessions of an organization over a specified period of time; and
providing a report to a computing device describing the number of media events detected during the plurality of communication sessions of the organization.

### Claim 8

A computing device for taking corrective action in response to an event in a communication session of a communication system, the computing device comprising:
a hardware processor;
a memory, the memory storing instructions, which when executed by the hardware processor causes the device to perform operations comprising:
identifying a first setting of a participant in the communication system in a participant profile data structure corresponding to the participant, the participant using a first device in the communication session, the first setting entered by the participant and related to a physical characteristic of the participant;
selecting a data structure based upon the first setting, the data structure comprising a description of a first media event, an associated first curing action to take in response to detection of the first media event, and a severity level, the first media event comprising one or more of:
an audio prompt to view a visual element, a visual element that does not have an associated audio explanation, or an audio element that does not have an associated visual description;
scanning media of the communication session during the communication session for the first media event, the media of the communication session being audio, video, or shared content of the communication session;
identifying the first media event in the media of the communication session; and
responsive to identifying the first media event:
identifying, based upon an analysis of media of the communication session, a second device where the media indicating the event originated, the second device one of a plurality of devices participating in the communication session, the first and second devices different;
identifying a frequency for which curing actions have been taken during the communication session that are directed to the second device;
determining whether to execute the first curing action based upon the frequency and the severity level of the first setting; and
responsive to determining to execute the first curing action, executing the first curing action targeted at the second device, but not executing the first curing action respective to other of the plurality of devices participating in the communication session.

### Claim 9 (depends on 8)

The computing device of claim 8, wherein the operations further comprise: after the communication session, presenting a prompt on the second device indicating a plurality of events triggered as a result of media originating from the second device, the plurality of events including at least one event where a second curing action was not executed due to the frequency for which curing actions have been taken during the communication session.

### Claim 10 (depends on 8)

The computing device of claim 8, wherein the operations further comprise:
providing, prior to the communication session, a report identifying settings of a plurality of participants in the communication session.

### Claim 11 (depends on 10)

The computing device of claim 10, wherein the operations further comprise:
prior to the communication session, scanning a document included in an invitation to the communication session for a compatibility issue between media in the document and the settings of the plurality of participants in the communication session.

### Claim 12 (depends on 8)

The computing device of claim 8, wherein the operations further comprise:
identifying a second setting of a second participant in the communication system in a second participant profile data structure corresponding to the second participant, the second participant using a third device in the communication session;
selecting a second data structure based upon the second setting, the second data structure comprising a description of a second media event, and an associated second curing action to take in response to detection of the second media event, the second media event comprising an audio element without subtitles;
wherein scanning the media of the communication session during the communication session comprises scanning for both the first media event and the second media event;
identifying the second media event in the media of the communication session; and
responsive to identifying the second media event:
executing the second associated curing action by automatically creating subtitles.

### Claim 13 (depends on 8)

The computing device of claim 8, wherein the operations further comprise:
providing a reminder to a second participant of the communication session during the communication session of the first setting.

### Claim 14 (depends on 8)

The computing device of claim 8, wherein the operations further comprise:
calculating a number of media events detected during a plurality of communication sessions of an organization over a specified period of time; and
providing a report to a computing device describing the number of media events detected during the plurality of communication sessions of the organization.

### Claim 15

A device for taking corrective action in response to an event in a communication session of a communication system, the device comprising:
means for identifying a first setting of a participant in the communication system in a participant profile data structure corresponding to the participant, the participant using a first device in the communication session, the first setting entered by the participant and related to either a physical characteristic of the participant;
means for selecting a data structure based upon the first setting, the data structure comprising a description of a first media event, an associated first curing action to take in response to detection of the first media event, and a severity level, the first media event comprising one or more of:
an audio prompt to view a visual element, a visual element that does not have an associated audio explanation, or an audio element that does not have an associated visual description;
means for scanning media of the communication session during the communication session for the first media event, the media of the communication session being audio, video, or shared content of the communication session;
means for identifying the first media event in the media of the communication session; and
responsive to identifying the first media event:
means for identifying, based upon an analysis of media of the communication session, a second device where the media indicating the event originated, the second device one of a plurality of devices participating in the communication session, the first and second devices different;
means for identifying a frequency for which curing actions have been taken during the communication session that are directed to the second device;
means for determining whether to execute the first curing action based upon the frequency and the severity level of the first setting; and
responsive to determining to execute the first curing action, means for executing the first curing action targeted at the second device, but not executing the first curing action respective to other of the plurality of devices participating in the communication session.

### Claim 16 (depends on 15)

The device of claim 15, further comprising: after the communication session, means for presenting a prompt on the second device indicating a plurality of events triggered as a result of media originating from the second device, the plurality of events including at least one event where a second curing action was not executed due to the frequency for which curing actions have been taken during the communication session.

### Claim 17 (depends on 15)

The device of claim 15, further comprising:
means for providing, prior to the communication session, a report identifying settings of a plurality of participants in the communication session.

### Claim 18 (depends on 17)

The device of claim 17, further comprising:
prior to the communication session, means for scanning a document included in an invitation to the communication session for a compatibility issue between media in the document and the settings of the plurality of participants in the communication session.

### Claim 19 (depends on 15)

The device of claim 15, further comprising:
means for identifying a second setting of a second participant in the communication system in a second participant profile data structure corresponding to the second participant, the second participant using a third device in the communication session;
means for selecting a second data structure based upon the second setting, the second data structure comprising a description of a second media event, and an associated second curing action to take in response to detection of the second media event, the second media event comprising an audio element without subtitles;
wherein the means for scanning the media of the communication session during the communication session comprises means for scanning for both the first media event and the second media event;
means for identifying the second media event in the media of the communication session; and
responsive to identifying the second media event:
means for executing the second associated curing action by automatically creating subtitles.

### Claim 20 (depends on 15)

The device of claim 15, further comprising:
means for providing a reminder to a second participant of the communication session during the communication session of the first setting.
