# US 10,311,893 B2 · Speaker association with a visual representation of spoken content

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 10,311,893 B2
- Document ID: US10311893B2
- Status: Granted
- Kind: B2
- Application number: 15/657,554
- Filed: 2017-07-24
- Published: 2017-11-09
- Granted: 2019-06-04
- Earliest claimed: 2011-06-17
- Assignees: AT&T Intellectual Property I, L.P.
- Applicants: At&T Intellectual Property I, L.P.
- Inventors: David C. Gibbon; Andrea Basso; Lee Begeja; Sumit Kumar; Zhu Liu; Bernard S. Renger; Behzad Shahraray; Eric Zavesky
- Web page: https://patentgrep.com/patent/US10311893B2

## CPC

- G10L 21/10: Transforming into visible information
- G06F 3/167: {Audio in a user interface, e.g. using voice commands for navigating, audio feedback}
- G06F 16/61: Indexing; Data structures therefor; Storage structures
- G06F 16/683: using metadata automatically derived from the content
- G06F 16/686: {using information manually generated, e.g. tags, keywords, comments, title or artist information, time, location or usage information, user ratings}
- G10L 15/26: Speech to text systems (G10L15/08 takes precedence)
- G11B 27/28: by using information signals recorded by the same method as the main recording {(G11B27/22 takes precedence)}
- G11B 27/34: Indicating arrangements {(indicating means incorporated in magazine or cassette G11B23/046 and G11B23/0875; indicating measured values in general G01D)}
- H04L 65/403: Arrangements for multi-party communication, e.g. for conferences (data switching systems for conference H04L12/18; arrangements for connecting several subscribers to a common circuit, i.e. affording conference facilities H04M3/56; television conferencing systems H04N7/15)
- H04L 67/306: User profiles
- G06F 16/9535: Search customisation based on user profiles and personalisation
- G10L 15/07: to the speaker
- G10L 17/00: Speaker identification or verification techniques
- G10L 2015/0631: {Creating reference templates; Clustering}
- H04M 2201/40: using speech recognition
- H04N 5/76: Television signal recording
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G11B: INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER (recording measured values in a way that does not require playback through a transducer G01D9/00; recording or playback apparatus using mechanically marked tape, e.g. punched paper tape, or using unit records, e.g. punched or magnetically marked cards G06K; transferring data from one type of record carrier to another G06K1/18; circuits for coupling output of reproducer to radio receiver H04B1/20; gramophone pick-ups or like acoustic electromechanical transducers or circuits therefor H04R)
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)
- H04M: TELEPHONIC COMMUNICATION (circuits for controlling other apparatus via a telephone cable and not involving telephone switching apparatus G08)
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

Speaker content generated in an audio conference is selectively and visually represented. A profile for each audience member who participates in the audio conference is obtained. Speaker content spoken during the audio conference is monitored. Different weights are applied to words included in the speaker content according to a parameter of the profile for each of the audience members. A relation between the speaker content to the profile for each of the audience members is determined. Visual representations of the speaker content are presented to selective members among the audience members based on the determined relation.

## Claims

### Claim 1

A method of visually representing speaker content generated in an audio conference, the method comprising:
obtaining a profile for each of a plurality of audience members who participates in the audio conference through a respective communication device;
monitoring, using a computer with a processor and memory, the speaker content spoken during the audio conference;
applying different weights to different words included in the speaker content according to a parameter of the profile for each of the plurality of audience members;
determining a relation of the speaker content to the profile for each of the plurality of audience members based on the applying of the different weights; and
presenting, at a point in time, visual representations of the speaker content to selective members among the plurality of audience members based on the determining,
wherein the visual representations presented include a selective visual representation of the speaker content related to the parameter of the profile, such that the speaker content that is unrelated to the parameter of the profile is omitted from being visually represented.

### Claim 2 (depends on 1)

The method of claim 1,
wherein the visual representations are presented in an order in which the speaker content is presented in the audio conference.

### Claim 3 (depends on 1)

The method of claim 1,
wherein the visual representations include an indication of a relative timing at which the speaker content is presented in the audio conference.

### Claim 4 (depends on 1)

The method of claim 1,
wherein the visual representations presented include a visual representation of speaker content provided by a selected speaker.

### Claim 5 (depends on 1)

The method of claim 1,
wherein the visual representations presented are filtered using criteria provided by a respective audience member.

### Claim 6 (depends on 1)

The method of claim 1,
wherein the parameter includes a topic of interest.

### Claim 7 (depends on 1)

The method of claim 1,
wherein the parameter includes a speaker of interest.

### Claim 8 (depends on 1)

The method of claim 1,
wherein the parameter includes a topic of disinterest.

### Claim 9 (depends on 1)

The method of claim 1,
wherein the parameter includes a speaker of disinterest.

### Claim 10 (depends on 1)

The method of claim 1,
wherein the parameter includes a timeframe within the audio conference.

### Claim 11 (depends on 1)

The method of claim 1,
wherein the visual representations presented include interactive content.

### Claim 12 (depends on 1)

The method of claim 1,
wherein the visual representations presented are further based on an input by an audience member.

### Claim 13 (depends on 1)

The method of claim 1,
wherein the presenting comprises identifying first select portions of the speaker content to visually represent and identifying second select portions of the speaker content to hide from being visually represented.

### Claim 14 (depends on 1)

The method of claim 1,
wherein the visual representations are displayed chronologically in an order of the speaker content visually represented.

### Claim 15 (depends on 1)

The method of claim 1,
wherein the visual representations also include data descriptive of one of the plurality of audience members who speaks the speaker content being visually represented.

### Claim 16 (depends on 1)

The method of claim 1, further comprising:
obtaining profile information of the respective communication device used by each of the plurality of audience members,
wherein the visual representations of the speaker content are generated based on the profile information of the respective communication device.

### Claim 17 (depends on 1)

The method of claim 1,
wherein the visual representations include a non-text visual graphic.

### Claim 18 (depends on 1)

The method of claim 1,
wherein the profile includes information provided by an audience member and information about the audience member obtained externally from a source other than the audience member.

### Claim 19

At least one non-transitory computer readable medium that stores a set of executable instructions for visually representing speaker content generated in an audio conference, the executable instructions, when executed by a processor, causing a computer to perform a process comprising:
obtaining a profile for each of a plurality of audience members who participates in an audio conference through a respective communication device;
monitoring speaker content spoken during the audio conference;
applying different weights to different words included in the speaker content according to a parameter of the profile for each of the plurality of audience members;
determining a relation of the speaker content to the profile for each of the plurality of audience members based on the applying of the different weights; and
presenting, at a point in time, visual representations of the speaker content to selective members among the plurality of audience members based on the determining,
wherein the visual representations presented include a selective visual representation of the speaker content related to the parameter of the profile, such that the speaker content that is unrelated to the parameter of the profile is omitted from being visually represented.

### Claim 20

At least one computer for visually representing speaker content generated in an audio conference, the at least one computer comprising:
a memory;
a tangible processor that stores a set of executable instructions for selectively and visually representing speaker content generated in an audio conference;
wherein the executable instructions, when processed by the tangible processor, perform a process comprising:
obtaining a profile for each of a plurality of audience members who participates in an audio conference through a respective communication device;
monitoring speaker content spoken during the audio conference;
applying different weights to different words included in the speaker content according to a parameter of the profile for each of the plurality of audience members;
determining a relation of the speaker content to the profile for each of the plurality of audience members based on the applying of the different weights; and
presenting, at a point in time, visual representations of the speaker content to selective members among the plurality of audience members based on the determining,
wherein the visual representations presented include a selective visual representation of the speaker content related to the parameter of the profile, such that the speaker content that is unrelated to the parameter of the profile is omitted from being visually represented.
