# US 11,310,463 B2 · System and method for providing and interacting with coordinated presentations

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 11,310,463 B2
- Document ID: US11310463B2
- Status: Granted
- Kind: B2
- Application number: 17/001,047
- Filed: 2020-08-24
- Published: 2021-02-18
- Granted: 2022-04-19
- Earliest claimed: 2013-06-26
- Assignees: Touchcast LLC
- Applicants: Touchcast LLC
- Inventors: Edo Segal
- Web page: https://patentgrep.com/patent/US11310463B2

## CPC

- G06F 1/1686: {the I/O peripheral being an integrated camera}
- H04N 7/15: Conference systems
- G06F 1/1694: {the I/O peripheral being a single or a set of motion sensors for pointer control or gesture input obtained by sensing movements of the portable computer}
- G06F 3/0482: Interaction with lists of selectable items, e.g. menus
- G06F 3/04847: Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
- G06F 3/165: {Management of the audio stream, e.g. setting of volume, audio stream path}
- G06F 3/167: {Audio in a user interface, e.g. using voice commands for navigating, audio feedback}
- G11B 27/031: Electronic editing of digitised analogue information signals, e.g. audio or video signals
- H04N 5/2222: {Prompting}
- H04N 5/262: Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects {; Cameras specially adapted for the electronic generation of special effects}
- H04N 7/152: {Multipoint control units therefor}
- H04N 21/251: {Learning process for intelligent management, e.g. learning user preferences for recommending movies (details of learning user preferences for the retrieval of video data in a video database G06F16/739; computer systems using learning methods G06N3/08)}
- H04N 21/2668: Creating a channel for a dedicated end-user group, e.g. insertion of targeted commercials based on end-user profiles {(information retrieval from the Internet by querying with filtering and personalisation G06F16/9535; arrangements for replacing or switching information during the broadcast H04H20/10; push services over packet-switching network H04L12/1859; adaptation of message content in packet-switching networks H04L51/063)}
- H04N 21/42203: {sound input device, e.g. microphone}
- H04N 21/4223: Cameras (H04N23/00 takes precedence)
- H04N 21/4316: {for displaying supplemental content in a region of the screen, e.g. an advertisement in a separate window}
- H04N 21/47: End-user applications
- H04N 21/47205: {for manipulating displayed content, e.g. interacting with MPEG-4 objects, editing locally}
- H04N 21/4722: for requesting additional data associated with the content
- H04N 21/4782: Web browsing {, e.g. WebTV}
- H04N 21/4788: communicating with other users, e.g. chatting {(arrangements for providing for computer conferences, e.g. chat rooms, to substation in data switching networks H04L12/1813; distributed application using peer-to-peer [P2P] networks H04L67/104)}
- H04N 21/6587: Control parameters, e.g. trick play commands, viewpoint selection
- G06F 3/04883: for inputting data by handwriting, e.g. gesture or text
- H04N 21/478: Supplemental services, e.g. displaying phone caller identification, shopping application
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G11B: INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER (recording measured values in a way that does not require playback through a transducer G01D9/00; recording or playback apparatus using mechanically marked tape, e.g. punched paper tape, or using unit records, e.g. punched or magnetically marked cards G06K; transferring data from one type of record carrier to another G06K1/18; circuits for coupling output of reproducer to radio receiver H04B1/20; gramophone pick-ups or like acoustic electromechanical transducers or circuits therefor H04R)

## Abstract

A system and method provide customizable interactive audio/video content to each of a plurality of computing devices. When executing at least some code stored in the memory, a processor generates a coordinated presentation by integrating in the memory, via a video mixer, one or more images from a camera with content selected by at least one user. Further the at least one processor is configured to process the coordinated presentation to provide an abridged version of the coordinated presentation at at least one of the remote devices.

## Claims

### Claim 1

A system for providing respectively customizable interactive audio/video content to each of a plurality of computing devices, the system comprising:
at least one processor;
a memory that is accessible by the at least one processor;
a camera that is accessible by the at least one processor and that is configured to capture one or more images;
a display that is accessible by the at least one processor and that is configured to display content;
a touch-screen interface accessible by the at least one processor and that is configured to receive input from a user; and
a video mixer module stored in the memory that is configured to mix graphical content;
wherein, when executing at least some code stored in the memory, the at least one processor is configured to:
generate a coordinated presentation by integrating in the memory, via the video mixer, one or more images from the camera with content selected by at least one user, wherein the coordinated presentation is configured to enable respective interaction at each of a plurality of remote devices, such that results of a respective interaction at a particular remote device are viewable at the particular remote device but are not viewable at other of the remote devices, wherein the coordinated presentation is further configured to be transmitted to the one or more remote devices;
process the coordinated presentation to provide an abridged version of the coordinated presentation at at least one of the remote devices, wherein the coordinated presentation is processed by:
analyzing images from the camera to detect a person's sentiment;
categorizing content in the images from the analyzed images; and
generating metadata representing the categorized content,
wherein the metadata are usable to locate the categorized content in the images.

### Claim 2 (depends on 1)

The system of claim 1, wherein the abridged version is provided in a graphical user interface configured with a timeline.

### Claim 3 (depends on 1)

The system of claim 1, wherein the coordinated presentation is processed by the at least one processor by:
determining a plurality of events in the coordinated presentation;
indexing each of the plurality of events; and
providing, in a timeline configured in a graphical user interface, the abridged version of the coordinated presentation as a function of the indexed events.

### Claim 4 (depends on 3)

The system of claim 3, wherein the at least one processor is configured to assign a weight to at least one of the indexed events.

### Claim 5 (depends on 3)

The system of claim 3, wherein at least one processor is configured to adjust the length of the abridged version of the coordinated presentation as a function of the indexed events.

### Claim 6 (depends on 3)

The system of claim 3, wherein the events are detected by the at least one processor as a function of changes in content in the coordinated presentation.

### Claim 7 (depends on 6)

The system of claim 6, wherein the changes represent changes in the content selected by the at least one user.

### Claim 8 (depends on 7)

The system of claim 7, wherein the changes in the content include at least one of:
display of a presentation slide;
display of a person;
user interaction of content in the coordinated presentation;
user behavior within the coordinated presentation;
biometrics of at least one user within the coordinated presentation; and
a discussion of users in the coordinated presentation.

### Claim 9 (depends on 1)

The system of claim 1, wherein the coordinated presentation includes an videoconference session between a plurality of user computing devices.

### Claim 10 (depends on 1)

The system of claim 1, wherein the at least one processor is configured to provide a dashboard interface for users to define respective portions of the coordinated presentation that are to be provided or skipped in the abridged version of the coordinated presentation.

### Claim 11

A method for providing respectively customizable interactive audio/video content to each of a plurality of computing devices, the method comprising:
accessing, by at least one processor, a memory that stores code for configuring the at least one processor;
generating, by the at least one processor, a coordinated presentation by integrating in the memory, via a video mixer, one or more images from a camera with content selected by at least one user, wherein the coordinated presentation is configured to enable respective interaction at each of a plurality of remote devices, such that results of a respective interaction at a particular remote device are viewable at the particular remote device but are not viewable at other of the remote devices, wherein the coordinated presentation is further configured to be transmitted to the one or more remote devices;
processing, by the at least one processor, the coordinated presentation to provide an abridged version of the coordinated presentation at at least one of the remote devices, wherein the coordinated presentation is processed by:
analyzing images from the camera to detect a person's sentiment;
categorizing content in the images from the analyzed images; and
generating metadata representing the categorized content,
wherein the metadata are usable to locate the categorized content in the images.

### Claim 12 (depends on 11)

The method of claim 11, wherein the abridged version is provided in a graphical user interface configured with a timeline.

### Claim 13 (depends on 1)

The method of claim 1, further comprising:
determining, by the at least one processor, a plurality of events in the coordinated presentation;
indexing, by the at least one processor, each of the plurality of events; and
providing, by the at least one processor, in a timeline configured in a graphical user interface, the abridged version of the coordinated presentation as a function of the indexed events.

### Claim 14 (depends on 13)

The method of claim 13, further comprising assigning, by the at least one processor, a weight to at least one of the indexed events.

### Claim 15 (depends on 13)

The method of claim 13, further comprising adjusting, by the at least one processor, the length of the abridged version of the coordinated presentation as a function of the indexed events.

### Claim 16 (depends on 13)

The method of claim 13, detecting, by the at least one processor, the events as a function of changes in content in the coordinated presentation.

### Claim 17 (depends on 16)

The method of claim 16, wherein the changes represent changes in the content selected by the at least one user.

### Claim 18 (depends on 17)

The method of claim 17, wherein the changes in the content include at least one of:
display of a presentation slide;
display of a person;
user interaction of content in the coordinated presentation;
user behavior within the coordinated presentation;
biometrics of at least one user within the coordinated presentation; and
a discussion of users in the coordinated presentation.

### Claim 19 (depends on 11)

The method of claim 11, wherein the coordinated presentation includes an videoconference session between a plurality of user computing devices.

### Claim 20 (depends on 11)

The method of claim 11, further comprising providing, by the at least one processor, a dashboard interface for users to define respective portions of the coordinated presentation that are to be provided or skipped in the abridged version of the coordinated presentation.
