# US 2020/0288200 A1 · Automatic rating of crowd-stream caller video

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2020/0288200 A1
- Document ID: US20200288200A1
- Status: Published application
- Kind: A1
- Application number: 16/401,420
- Filed: 2019-05-02
- Published: 2020-09-10
- Earliest claimed: 2019-03-08
- Assignees: Kiswe Mobile Inc.
- Applicants: Kiswe Mobile Inc.
- Inventors: Yung-Lung Ho; Wim Sweldens; Tom Cuypers; Bert De Decker
- Web page: https://patentgrep.com/patent/US20200288200A1

## CPC

- H04N 21/4622: {Retrieving content or additional data from different sources, e.g. from a broadcast channel and the Internet (web site content organization and management for information retrieval from the Internet G06F16/958; transmission by internet of broadcast information H04H60/82; stock exchange data over packet-switching network H04L12/1804; push services including data channel over packet-switching network H04L12/1859)}
- H04N 21/21805: {enabling multiple viewpoints, e.g. using a plurality of cameras}
- H04N 21/2187: Live feed
- H04N 21/23439: {for generating different versions}
- H04N 21/25841: {involving the geographical location of the client (retrieval from the Internet by querying based on geographical locations G06F16/9537; arrangements for identifying locations of receiving stations in broadcast systems H04H60/51; location of the user terminal in data switching networks H04L67/52; services making use of the location of users or terminals in wireless networks H04W4/02; locating users or terminals in wireless networks H04W64/00)}
- H04N 21/2665: Gathering content from different sources, e.g. Internet and satellite
- H04N 21/2743: Video hosting of uploaded data from client
- H04N 21/41407: {embedded in a portable device, e.g. video client on a mobile phone, PDA, laptop (constructional details of equipment or arrangements specially adapted for portable computer application G06F1/1626; arrangements specially adapted for mobile receivers in broadcast systems H04H20/57)}
- H04N 21/4223: Cameras (H04N23/00 takes precedence)
- H04N 21/4524: {involving the geographical location of the client (retrieval from the Internet by querying based on geographical locations G06F16/9537; systems specially adapted for using geographical information in broadcast systems H04H60/70; protocols in which the network application is adapted for the location of the user terminal in communication control or processing H04L67/52; services making use of the location of users or terminals in wireless networks H04W4/02; locating users or terminals in wireless networks H04W64/00)}
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

A method comprises receiving video streams from a plurality of mobile devices associated with respective distinct users of a crowd-stream video application, evaluating the received video streams relative to an event of interest, selecting particular ones of the video streams for use in generation of crowd-stream video output based at least in part on results of the evaluating, generating the crowd-stream video output utilizing at least portions of the selected video streams, and providing the crowd-stream video output to one or more servers of a content delivery network for delivery to one or more viewer devices. The video streams illustratively comprise live video streams of the event of interest captured by respective ones of the mobile devices. In some embodiments, evaluating the received video streams relative to an event of interest comprises evaluating the received video streams in terms of at least vantage point relative to the event of interest.

## Claims

### Claim 1

A method comprising:
receiving video streams from a plurality of mobile devices associated with respective distinct users of a crowd-stream video application;
evaluating the received video streams relative to an event of interest;
selecting particular ones of the video streams for use in generation of crowd-stream video output based at least in part on results of the evaluating;
generating the crowd-stream video output utilizing at least portions of the selected video streams; and
providing the crowd-stream video output to one or more servers of a content delivery network for delivery to one or more viewer devices;
wherein the method is implemented in at least one processing device comprising a processor coupled to a memory.

### Claim 2 (depends on 1)

The method of claim 1 wherein the video streams comprise live video streams of the event of interest captured by respective ones of the mobile devices.

### Claim 3 (depends on 1)

The method of claim 1 wherein one or more of the users of the crowd-stream video application each access the application by establishing a connection to a host website via a corresponding one of the mobile devices.

### Claim 4 (depends on 1)

The method of claim 1 further comprising:
obtaining location information from one or more of the mobile devices; and
determining a location of the event of interest based at least in part on the obtained location information.

### Claim 5 (depends on 4)

The method of claim 4 wherein determining a location of the event of interest based at least in part on the obtained location information comprises:
utilizing the obtained location information to generate an estimate of the location of the event of interest;
performing at least one automated Internet search to obtain information characterizing the event of interest; and
updating the estimate of the location based at least in part on the information obtained from the one or more automated Internet searches.

### Claim 6 (depends on 4)

The method of claim 4 wherein determining a location of the event of interest based at least in part on the obtained location information comprises one of:
utilizing location information from a single one of the mobile devices to determine the location of the event of interest; and
utilizing location information from multiple ones of the mobile devices to define an event zone for the event of interest.

### Claim 7 (depends on 4)

The method of claim 4 wherein determining a location of the event of interest based at least in part on the obtained location information comprises:
obtaining respective positions and pointing vectors for each of multiple ones of the mobile devices; and
determining the location of the event of interest in a triangulation process utilizing the obtained positions and pointing vectors.

### Claim 8 (depends on 1)

The method of claim 1 further comprising:
obtaining at least one of device orientation information, focus distance information and scene recognition information from one or more of the mobile devices; and
determining one or more characteristics of the event of interest based at least in part on the obtained at least one of device orientation information, focus distance information and scene recognition information.

### Claim 9 (depends on 1)

The method of claim 1 further comprising providing one or more instructions to at least one of the mobile devices relating to capture of its corresponding video stream.

### Claim 10 (depends on 1)

The method of claim 1 wherein evaluating the received video streams relative to an event of interest comprises evaluating the received video streams in terms of at least vantage point relative to the event of interest.

### Claim 11 (depends on 10)

The method of claim 10 wherein evaluating the received video streams relative to an event of interest further comprises evaluating the received video streams in terms of vantage point and in terms of at least one of image quality and subject relevancy.

### Claim 12 (depends on 1)

The method of claim 1 wherein evaluating the received video streams relative to an event of interest comprises applying at least one artificial intelligence algorithm to automatically rank the video streams based at least in part on one or more metrics computed for each of at least a subset of the received video streams.

### Claim 13 (depends on 1)

The method of claim 1 wherein selecting particular ones of the video streams for use in generation of crowd-stream video output based at least in part on results of the evaluating comprises:
ranking the received video streams based at least in part on results of the evaluating; and
selecting particular ones of the ranked video streams for use the generation of the crowd-stream video output based at least in part on the ranking.

### Claim 14 (depends on 1)

The method of claim 1 wherein selecting particular ones of the video streams for use in generation of crowd-stream video output based at least in part on results of the evaluating comprises:
placing at least a subset of the users into a queue based at least in part on the results of the evaluating; and
selecting users from the queue in a predefined order.

### Claim 15 (depends on 1)

The method of claim 1 wherein the selecting is performed at least in part in at least one of a moderator station and a host station each coupled to a media server cluster that is configured to communicate with the mobile devices.

### Claim 16 (depends on 1)

The method of claim 1 further comprising:
providing the evaluation results to at least one of a moderator station and a host station; and
receiving selection information from at least one of the moderator station and the host station responsive to providing the evaluation results;
wherein the selecting of particular ones of the video streams for use in generation of the crowd-stream video output comprises selecting the particular ones of the video streams based at least in part on the received selection information.

### Claim 17 (depends on 1)

The method of claim 1 wherein generating the crowd-stream video output utilizing at least portions of the selected video streams comprises combining portions of each of the selected video streams into a composite video stream.

### Claim 18 (depends on 14)

The method of claim 14 wherein generating the crowd-stream video output utilizing at least portions of the selected video streams comprises inserting at least portions of the video streams of the selected users into the crowd-stream video output as those users are selected from the queue.

### Claim 19 (depends on 1)

The method of claim 1 wherein generating the crowd-stream video output utilizing at least portions of the selected video streams comprises performing one or more image enhancement operations on at least a given one of the selected video streams prior to incorporating at least portions of the given selected video stream into the crowd-stream video output, wherein the one or more image enhancement operations comprise at least one of:
an image stabilization operation;
a color correction operation;
a cropping operation;
a noise suppression operation;
a blur filtering operation;
an audio alteration operation; and
a replacement operation to replace one or more persons with associated avatars.

### Claim 20 (depends on 1)

The method of claim 1 wherein providing the crowd-stream video output to one or more servers of a content delivery network for delivery to one or more viewer devices further comprises uploading the crowd-stream video output to at least one server of at least one social media platform.

### Claim 21

An article of manufacture comprising a non-transitory computer-readable storage medium having computer program code embodied therein, wherein the computer program code when executed in at least one processing device causes said at least one processing device:
to receive video streams from a plurality of mobile devices associated with respective distinct users of a crowd-stream video application;
to evaluate the received video streams relative to an event of interest;
to select particular ones of the video streams for use in generation of crowd-stream video output based at least in part on results of the evaluating;
to generate the crowd-stream video output utilizing at least portions of the selected video streams; and
to provide the crowd-stream video output to one or more servers of a content delivery network for delivery to one or more viewer devices.

### Claim 22 (depends on 21)

The article of manufacture of claim 21 wherein evaluating the received video streams relative to an event of interest comprises evaluating the received video streams in terms of at least vantage point relative to the event of interest.

### Claim 23

An apparatus comprising:
at least one processing device comprising a processor coupled to a memory;
wherein said at least one processing device is configured:
to receive video streams from a plurality of mobile devices associated with respective distinct users of a crowd-stream video application;
to evaluate the received video streams relative to an event of interest;
to select particular ones of the video streams for use in generation of crowd-stream video output based at least in part on results of the evaluating;
to generate the crowd-stream video output utilizing at least portions of the selected video streams; and
to provide the crowd-stream video output to one or more servers of a content delivery network for delivery to one or more viewer devices.

### Claim 24 (depends on 23)

The apparatus of claim 23 wherein evaluating the received video streams relative to an event of interest comprises evaluating the received video streams in terms of at least vantage point relative to the event of interest.
