# US 2021/0264929 A1 · Dynamic creation and insertion of content

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0264929 A1
- Document ID: US20210264929A1
- Status: Published application
- Kind: A1
- Application number: 16/797,190
- Filed: 2020-02-21
- Published: 2021-08-26
- Earliest claimed: 2020-02-21
- Assignees: International Business Machines Corporation
- Applicants: International Business Machines Corporation
- Inventors: Samuel Osebe; Charles Muchiri Wachira; Komminist Weldemariam; Celia Cintas
- Web page: https://patentgrep.com/patent/US20210264929A1

## CPC

- G10L 21/0364: for improving intelligibility
- H04L 65/1089: by adding media; by removing media
- G06Q 10/10: Office automation; Time management
- G06V 20/40: in video content (extracting overlay text G06V20/62; video retrieval G06F16/70; processing of video elementary streams in video servers H04N21/234; processing of video elementary streams in video clients H04N21/44)
- G06V 40/20: Movements or behaviour, e.g. gesture recognition (recognition of facial expressions G06V40/16)
- G10L 13/00: Speech synthesis; Text to speech systems
- G10L 15/22: Procedures used during a speech recognition process, e.g. man-machine dialogue
- G10L 15/24: Speech recognition using non-acoustical features
- G10L 21/003: Changing voice quality, e.g. pitch or formants
- G10L 21/007: characterised by the process used
- G10L 25/63: for estimating an emotional state
- G10L 25/90: Pitch determination of speech signals
- H04H 60/33: Arrangements for monitoring the users' behaviour or opinions
- H04L 12/1822: {Conducting the conference, e.g. admission, detection, selection or grouping of participants, correlating users to one or more conference sessions, prioritising transmission}
- H04L 65/403: Arrangements for multi-party communication, e.g. for conferences (data switching systems for conference H04L12/18; arrangements for connecting several subscribers to a common circuit, i.e. affording conference facilities H04M3/56; television conferencing systems H04N7/15)
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- H04H: BROADCAST COMMUNICATION (multiplex communication H04J; pictorial communication aspects of broadcast systems H04N)

## Abstract

In an aspect, during a presentation of a presentation material, viewers of the presentation material can be monitored. Based on the monitoring, new content can be determined for insertion into the presentation material. The new content can be automatically inserted to the presentation material in real time. In another aspect, during the presentation, a presenter of the presentation material can be monitored. The presenter's speech can be intercepted and analyzed to detect a level of confidence. Based on the detected level of confidence, the presenter's speech can be adjusted and the adjusted speech can be played back automatically, for example, in lieu of the presenter's original speech that is intercepted.

## Claims

### Claim 1

A method comprising:
monitoring a viewer of a presentation material during a presentation;
based on the monitoring, determining new content for insertion into the presentation material; and
automatically inserting the new content to the presentation material.

### Claim 2 (depends on 1)

The method of claim 1, wherein the automatically inserting the new content to the presentation material includes automatically inserting the new content while the presentation material is being presented.

### Claim 3 (depends on 1)

The method of claim 1, wherein the monitoring of the viewer including receiving data streams at least one device to monitor the viewer.

### Claim 4 (depends on 3)

The method of claim 3, wherein the data streams include an audio data stream representing sounds of the viewer made during the presentation.

### Claim 5 (depends on 3)

The method of claim 3, wherein the data streams include a video data stream representing video images of the viewer taken during the presentation.

### Claim 6 (depends on 1)

The method of claim 1, further including:
monitoring a state of a presenter of the presentation material during the presentation;
intercepting the presenter's speech;
determining whether the intercepted presenter's speech is below a threshold confidence level; and
responsive to determining that the intercepted presenter's speech is below the threshold level, automatically adjusting the presenter's speech by voice synthesis and outputting the adjusted presenter's speech to the viewer.

### Claim 7 (depends on 6)

The method of claim 6, wherein the determining whether the intercepted presenter's speech is below a threshold level includes detecting pitch and tremor levels in the presenter's speech, and determining whether the presenter's pitch and tremor levels are below the threshold confidence level.

### Claim 8

A computer program product comprising a computer readable storage medium having program instructions embodied therewith, the program instructions executable by a device to cause the device to:
monitor a viewer of a presentation material during a presentation;
based on the monitoring, determine new content for insertion into the presentation material; and
automatically insert the new content to the presentation material.

### Claim 9 (depends on 8)

The computer program product of claim 8, wherein the device caused to automatically insert the new content to the presentation material includes the device caused to automatically insert the new content while the presentation material is being presented.

### Claim 10 (depends on 8)

The computer program product of claim 8, wherein the device is caused to receive data streams from at least one device for monitoring the viewer.

### Claim 11 (depends on 10)

The computer program product of claim 10, wherein the data streams include an audio data stream representing sounds of the viewer made during the presentation.

### Claim 12 (depends on 10)

The computer program product of claim 10, wherein the data streams include a video data stream representing video images of the viewer taken during the presentation.

### Claim 13 (depends on 8)

The computer program product of claim 8, wherein the device is further caused to:
monitor a state of a presenter of the presentation material during the presentation;
intercept the presenter's speech;
determine whether the intercepted presenter's speech is below a threshold confidence level; and
responsive to determining that the intercepted presenter's speech is below the threshold level, automatically adjust the presenter's speech by voice synthesis and output the adjusted presenter's speech to the viewer.

### Claim 14 (depends on 13)

The computer program product of claim 13, wherein the device caused to determine whether the intercepted presenter's speech is below a threshold level includes the device caused to detect pitch and tremor levels in the presenter's speech, and determine whether the presenter's pitch and tremor levels are below the threshold confidence level.

### Claim 15

A system comprising:
a hardware processor;
a memory device;
the hardware processor configured to at least:
monitor a viewer of a presentation material during a presentation;
based on the monitoring, determine new content for insertion into the presentation material; and
automatically insert the new content to the presentation material.

### Claim 16 (depends on 15)

The system of claim 15, wherein the automatically inserting the new content to the presentation material includes automatically inserting the new content while the presentation material is being presented.

### Claim 17 (depends on 15)

The system of claim 15, wherein the hardware processor is configured to receive data streams from at least one device to monitor the viewer.

### Claim 18 (depends on 17)

The system of claim 17, wherein the data streams include an audio data stream representing sounds of the viewer made during the presentation.

### Claim 19 (depends on 17)

The system of claim 17, wherein the data streams include a video data stream representing video images of the viewer taken during the presentation.

### Claim 20 (depends on 15)

The system of claim 15, wherein the hardware processor is further configured to:
monitor a state of a presenter of the presentation material during the presentation;
intercept the presenter's speech;
determine whether the intercepted presenter's speech is below a threshold confidence level; and
responsive to determining that the intercepted presenter's speech is below the threshold level, automatically adjust the presenter's speech by voice synthesis and output the adjusted presenter's speech to the viewer.
