# US 2014/0198174 A1 · Augmenting Web Conferences via Text Extracted from Audio Content

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2014/0198174 A1
- Document ID: US20140198174A1
- Status: Published application
- Kind: A1
- Application number: 13/742,449
- Filed: 2013-01-16
- Published: 2014-07-17
- Earliest claimed: 2013-01-16
- Assignees: Adobe Systems Incorporated
- Applicants: Adobe Systems Incorporated
- Inventors: Antonio Sanso
- Web page: https://patentgrep.com/patent/US20140198174A1

## CPC

- H04N 7/15: Conference systems
- G06Q 30/0269: {based on user profile or attribute}
- H04L 12/1827: {Network arrangements for conference optimisation or adaptation}
- H04L 65/403: Arrangements for multi-party communication, e.g. for conferences (data switching systems for conference H04L12/18; arrangements for connecting several subscribers to a common circuit, i.e. affording conference facilities H04M3/56; television conferencing systems H04N7/15)
- G10L 15/26: Speech to text systems (G10L15/08 takes precedence)
- G10L 2015/223: {Execution procedure of a spoken command}
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING

## Abstract

Systems and methods for augmenting web conference sessions with multimedia content based on text extracted from audio content transmitted during the web conference. In one embodiment, a conference application or other application can receive audio content from at least one client participating in a web conference. The web conference can connect multiple clients for live sharing of audio and video. The conference application can also extract at least one text item from the audio content. The conference application can also generate augmented electronic content by combining electronic content received via the web conference with additional electronic content based on the at least one text item. The conference application can also provide the augmented electronic content via the web conference.

## Claims

### Claim 1

A method comprising:
receiving, by a processing device configured to host a web conference, audio content from at least one client participating in the web conference;
extracting, by the processing device, at least one text item from the audio content;
generating, by the processing device, augmented electronic content by combining electronic content received via the web conference with additional electronic content based on the at least one text item; and
providing, by the processing device, the augmented electronic content via the web conference.

### Claim 2 (depends on 1)

The method of claim 1, wherein the audio content is received in real time during the web conference.

### Claim 3 (depends on 1)

The method of claim 1, wherein extracting the at least one text item comprises applying a speech recognition algorithm to the audio content.

### Claim 4 (depends on 1)

The method of claim 1, wherein the at least one text item comprises at least one keyword and wherein the additional electronic content comprises electronic content corresponding to the at least one keyword.

### Claim 5 (depends on 1)

The method of claim 1, wherein the at least one text item comprises at least one command and wherein the additional electronic content comprises electronic content retrieved in response to the at least one command.

### Claim 6 (depends on 1)

The method of claim 1, wherein the at least one text item comprises a transcription of the audio content and further comprising analyzing the transcription to generate additional data describing one or more qualitative criteria of the audio content, wherein the additional electronic content comprises the additional data describing the quality of the audio content.

### Claim 7 (depends on 1)

The method of claim 1, wherein the at least one text item comprises a transcription of the audio content and further comprising:
comparing, by the processing device, information in the transcription to reference data;
determining an accuracy for the information in the transcription based on the reference data; and
generating additional data describing the accuracy for the information in the transcription, wherein the additional electronic content comprises the additional data describing the accuracy for the information in the transcription.

### Claim 8 (depends on 1)

The method of claim 1, further comprising:
receiving, by the processing device, video content from the at least one client; and
extracting, by the processing device, at least one image from the video content;
wherein the augmented electronic content is generated by combining the electronic content received via the web conference with the additional electronic content based on the at least one text item extracted from the audio content and the at least one image extracted from the video content.

### Claim 9 (depends on 1)

The method of claim 1, wherein the additional electronic content comprises video content.

### Claim 10 (depends on 1)

The method of claim 1, wherein the additional electronic content comprises audio content.

### Claim 11 (depends on 1)

The method of claim 1, wherein the additional electronic content comprises text content.

### Claim 12

A non-transitory computer-readable medium embodying program code executable by a processing device, the non-transitory computer-readable medium comprising:
program code for receiving audio content from at least one client participating in a web conference, the web conference connecting multiple clients for live sharing of audio and video;
program code for extracting at least one text item from the audio content;
program code for generating augmented electronic content by combining electronic content received via the web conference with additional electronic content based on the at least one text item; and
program code for providing the augmented electronic content via the web conference.

### Claim 13 (depends on 12)

The non-transitory computer-readable medium of claim 12, further comprising program code for receiving the audio content in real time during the web conference.

### Claim 14 (depends on 12)

The non-transitory computer-readable medium of claim 12, wherein the program code for extracting the at least one text item comprises program code for applying a speech recognition algorithm to the audio content.

### Claim 15 (depends on 12)

The non-transitory computer-readable medium of claim 12, wherein the at least one text item comprises at least one keyword and wherein the additional electronic content comprises electronic content corresponding to the at least one keyword.

### Claim 16 (depends on 12)

The non-transitory computer-readable medium of claim 12, wherein the at least one text item comprises at least one command and wherein the additional electronic content comprises electronic content retrieved in response to the at least one command.

### Claim 17 (depends on 12)

The non-transitory computer-readable medium of claim 12, wherein the at least one text item comprises a transcription of the audio content and further comprising program code for analyzing the transcription to generate additional data describing one or more qualitative criteria of the audio content, wherein the additional electronic content comprises the additional data describing the quality of the audio content.

### Claim 18 (depends on 12)

The non-transitory computer-readable medium of claim 12, wherein the at least one text item comprises a transcription of the audio content and further comprising:
program code for comparing information in the transcription to reference data;
program code for determining an accuracy for the information in the transcription based on the reference data; and
program code for generating additional data describing the accuracy for the information in the transcription, wherein the additional electronic content comprises the additional data describing the accuracy for the information in the transcription.

### Claim 19 (depends on 12)

The non-transitory computer-readable medium of claim 12, further comprising:
program code for receiving video content from the at least one client; and
program code for extracting at least one image from the video content;
wherein the augmented electronic content is generated by combining the electronic content received via the web conference with the additional electronic content based on the at least one text item extracted from the audio content and the at least one image extracted from the video content.

### Claim 20

A system comprising:
a processor configured to execute instructions stored in a non-transitory computer-readable medium providing a conference application;
wherein the conference application comprises one or more modules configured to perform operations comprising:
receiving audio content from at least one client participating in a web conference, the web conference connecting multiple clients for live sharing of audio and video;
extracting at least one text item from the audio content;
generating augmented electronic content by combining electronic content received via the web conference with additional electronic content based on the at least one text item; and
providing the augmented electronic content via the web conference.

### Claim 21 (depends on 20)

The system of claim 20, wherein the audio content is received in real time during the web conference.

### Claim 22 (depends on 20)

The system of claim 20, wherein extracting the at least one text item comprises applying a speech recognition algorithm to the audio content.

### Claim 23 (depends on 20)

The system of claim 20, wherein the at least one text item comprises at least one keyword and wherein the additional electronic content comprises electronic content corresponding to the at least one keyword.