# US 2020/0221191 A1 · Agglomerated video highlights with custom speckling

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2020/0221191 A1
- Document ID: US20200221191A1
- Status: Published application
- Kind: A1
- Application number: 16/240,319
- Filed: 2019-01-04
- Published: 2020-07-09
- Earliest claimed: 2019-01-04
- Assignees: International Business Machines Corporation
- Applicants: International Business Machines Corporation
- Inventors: Aaron K. BAUGHMAN; Mauro MARZORATI; Gray CANNON; Craig M. TRIM
- Web page: https://patentgrep.com/patent/US20200221191A1

## CPC

- H04N 21/8549: Creating video summaries, e.g. movie trailer {(retrieval in video databases by using presentations in form of a video summary G06F16/739)}
- G06F 16/483: using metadata automatically derived from the content
- G06F 16/487: using geographical or spatial information, e.g. location
- G06F 16/7834: {using audio features}
- G06F 16/786: {using motion, e.g. object motion or camera motion}
- G11B 27/031: Electronic editing of digitised analogue information signals, e.g. audio or video signals
- G11B 27/034: on discs (G11B27/036, G11B27/038 take precedence)
- G11B 27/102: {Programmed access in sequence to addressed parts of tracks of operating record carriers (access by moving the head G11B3/08, G11B5/54, G11B7/085, G11B21/022; by moving the record carrier G11B15/005, G11B17/005, by driving of both record carrier and head G11B15/1816)}
- G11B 27/28: by using information signals recorded by the same method as the main recording {(G11B27/22 takes precedence)}
- H04N 21/23418: {involving operations for analysing video streams, e.g. detecting features or characteristics (television picture signal circuitry for scene change detection H04N5/147; filtering for image enhancement G06T5/00; methods or arrangements for recognising scenes G06V20/00; arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59)}
- H04N 21/2743: Video hosting of uploaded data from client
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G11B: INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER (recording measured values in a way that does not require playback through a transducer G01D9/00; recording or playback apparatus using mechanically marked tape, e.g. punched paper tape, or using unit records, e.g. punched or magnetically marked cards G06K; transferring data from one type of record carrier to another G06K1/18; circuits for coupling output of reproducer to radio receiver H04B1/20; gramophone pick-ups or like acoustic electromechanical transducers or circuits therefor H04R)

## Abstract

Presentation of video highlights is disclosed. A data processing system receives from multiple users, multimedia files with user-generated video(s), the multimedia files being produced and enhanced by the users. The data processing system generates a speckle excitement vector of the multimedia files based on identifying feature(s) of the user-generated video(s). The processing and distribution system determines a cognitive state of each of the users based, in part, on the speckle excitement vector of each of the multimedia files. The processing and distribution system alters characteristic(s) of the user-generated video(s) of the multimedia files based on the cognitive state of each of the users that results in altered video(s). The processing and distribution system compiles the altered video(s) into a digital file that includes automatically-produced multimedia content. The processing and distribution system makes the digital file available for viewing.

## Claims

### Claim 1

A computer-implemented method of presenting video highlights, the computer-implemented method comprising:
receiving, by a processing and distribution system, from at least two users, at least two multimedia files each comprising at least one user-generated video, and wherein the at least two multimedia files are produced and enhanced by the at least two users;
generating, by the processing and distribution system, a speckle excitement vector of each of the at least two multimedia files based on at least one identifying feature of the at least one user-generated video;
determining, by the processing and distribution system, a cognitive state of each of the at least two users based, in part, on the speckle excitement vector of each of the at least two multimedia files, wherein the speckle excitement vector comprises at least one data-sorting system for cognitively categorizing at least one aspect of the cognitive state of each of the at least two users within a measurement system, wherein the at least one aspect is represented by a measurable value;
altering, by the processing and distribution system, one or more characteristic of the at least one user-generated video of each of the at least two multimedia files based on the cognitive state of the at least two users, resulting in one or more altered video;
compiling, by the processing and distribution system, the one or more altered video into a digital file comprising automatically-produced multimedia content; and
making, by the processing and distribution system, the digital file available for viewing.

### Claim 2 (depends on 1)

The computer-implemented method of claim 1, wherein the at least two multimedia files are received by the processing and distribution system contemporaneously.

### Claim 3

(canceled)

### Claim 4 (depends on 1)

The computer-implemented method of claim 1, wherein the at least one identifying feature comprises one or more of the following selected from the group consisting of a gesture, sound, speech, and background sound feature.

### Claim 5 (depends on 1)

The computer-implemented method of claim 1, wherein the cognitive state of each of the at least two users is determined in real-time.

### Claim 6 (depends on 1)

The computer-implemented method of claim 1, wherein the one or more altered video parallels the cognitive state of each of the at least two users.

### Claim 7 (depends on 1)

The computer-implemented method of claim 1, further comprising sequencing, by the processing and distribution system, the one or more altered video into a playlist based on one or more selected criterion.

### Claim 8 (depends on 7)

The computer-implemented method of claim 7, wherein the one or more selected criterion comprises one or more of the following selected from the group consisting of a theme, chronological sequence, location, and environment.

### Claim 9 (depends on 1)

The computer-implemented method of claim 1, further comprising making available, by the processing and distribution system, the digital file independently of one or more social media platforms.

### Claim 10 (depends on 1)

The computer-implemented method of claim 1, wherein the cognitive state is based on one or more of the following selected from the group consisting of an outcome of applying natural language understanding and biometric information of the at least two users.

### Claim 11

A system for presenting video highlights, the system comprising:
a memory; and
at least one processor in communication with the memory, the memory storing program code executable by the at least one processor to perform a method, the method comprising:
receiving, by a processing and distribution system, from at least two users, at least two multimedia files each comprising at least one user-generated video, and wherein the at least two multimedia files are produced and enhanced by the at least two users;
generating, by the processing and distribution system, a speckle excitement vector of each of the at least two multimedia files based on at least one identifying feature of the at least one user-generated video;
determining, by the processing and distribution system, a cognitive state of each of the at least two users based, in part, on the speckle excitement vector of each of the at least two multimedia files, wherein the speckle excitement vector comprises at least one data-sorting system for cognitively categorizing at least one aspect of the cognitive state of each of the at least two users within a measurement system, wherein the at least one aspect is represented by a measurable value;
altering, by the processing and distribution system, one or more characteristic of the at least one user-generated video of each of the at least two multimedia files based on the cognitive state of the at least two users, resulting in one or more altered video;
compiling, by the processing and distribution system, the one or more altered video into a digital file comprising automatically-produced multimedia content; and
making, by the processing and distribution system, the digital file available for viewing.

### Claim 12 (depends on 11)

The system of claim 11, wherein the cognitive state is based on one or more of the following selected from the group consisting of an outcome of applying natural language understanding and biometric information of the at least two users.

### Claim 13

(canceled)

### Claim 14 (depends on 11)

The system of claim 11, wherein the at least one identifying feature comprises one or more of the following selected from the group consisting of a gesture, sound, speech, and background sound feature.

### Claim 15 (depends on 11)

The system of claim 11, wherein the cognitive state for each of the at least two users is determined in real-time.

### Claim 16

A computer program product for presenting video highlights, the computer program product comprising:
a storage medium readable by a processor and storing instructions executable by the processor for performing a method of presenting video highlights, the method comprising:
receiving, by a processing and distribution system, from at least two users, at least two multimedia files each comprising at least one user-generated video, and wherein the at least two multimedia files are produced and enhanced by the at least two users;
generating, by the processing and distribution system, a speckle excitement vector of each of the at least two multimedia files based on at least one identifying feature of the at least one user-generated video;
determining, by the processing and distribution system, a cognitive state of each of the at least two users based, in part, on the speckle excitement vector of each of the at least two multimedia files, wherein the speckle excitement vector comprises at least one data-sorting system for cognitively categorizing at least one aspect of the cognitive state of each of the at least two users within a measurement system, wherein the at least one aspect is represented by a measurable value;
altering, by the processing and distribution system, one or more characteristic of the at least one user-generated video of each of the at least two multimedia files based on the cognitive state of the at least two users, resulting in one or more altered video;
compiling, by the processing and distribution system, the one or more altered video into a digital file comprising automatically-produced multimedia content; and
making, by the processing and distribution system, the digital file available for viewing.

### Claim 17 (depends on 16)

The computer program product of claim 16, wherein the cognitive state is based on one or more of the following selected from the group consisting of an outcome of applying natural language understanding and biometric information of the at least two users.

### Claim 18

(canceled)

### Claim 19 (depends on 16)

The computer program product of claim 16, wherein the at least one identifying feature comprises one or more of the following selected from the group consisting of a gesture, sound, speech, and background sound feature.

### Claim 20 (depends on 16)

The computer program product of claim 16, wherein the cognitive state for each of the at least two users is determined in real-time.

### Claim 21 (depends on 11)

The system of claim 11, further comprising sequencing, by the processing and distribution system, the one or more altered video into a playlist based on one or more selected criterion.

### Claim 22 (depends on 21)

The system of claim 21, wherein the one or more selected criterion comprises one or more of the following selected from the group consisting of a theme, chronological sequence, location, and environment.

### Claim 23 (depends on 16)

The computer program product of claim 16, further comprising sequencing, by the processing and distribution system, the one or more altered video into a playlist based on one or more selected criterion.
