# US 2013/0294749 A1 · Systems and Methods for Generation of Composite Video From Multiple Asynchronously Recorded Input Streams

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2013/0294749 A1
- Document ID: US20130294749A1
- Status: Published application
- Kind: A1
- Application number: 13/868,301
- Filed: 2013-04-23
- Published: 2013-11-07
- Earliest claimed: 2012-05-03
- Assignees: Panopto, Inc.
- Applicants: Panopto, Inc.
- Inventors: Eric Burns
- Web page: https://patentgrep.com/patent/US20130294749A1

## CPC

- H04N 9/87: Regeneration of colour television signals (H04N9/80 takes precedence)
- G09G 5/14: Display of multiple viewports
- H04N 5/445: for displaying additional information (H04N5/50 takes precedence)
- H04N 5/783: Adaptations for reproducing at a rate different from the recording rate
- H04N 21/2187: Live feed
- H04N 21/2365: Multiplexing of several video streams
- H04N 21/2665: Gathering content from different sources, e.g. Internet and satellite
- H04N 21/2743: Video hosting of uploaded data from client
- H04N 21/41407: {embedded in a portable device, e.g. video client on a mobile phone, PDA, laptop (constructional details of equipment or arrangements specially adapted for portable computer application G06F1/1626; arrangements specially adapted for mobile receivers in broadcast systems H04H20/57)}
- H04N 21/4223: Cameras (H04N23/00 takes precedence)
- H04N 21/4347: {Demultiplexing of several video streams}
- H04N 21/4788: communicating with other users, e.g. chatting {(arrangements for providing for computer conferences, e.g. chat rooms, to substation in data switching networks H04L12/1813; distributed application using peer-to-peer [P2P] networks H04L67/104)}
- H04N 21/6543: for forcing some client operations, e.g. recording {(remote booting in general G06F9/4416)}
- H04N 21/8153: {comprising still images, e.g. texture, background image}
- H04N 21/8456: {by decomposing the content in the time domain, e.g. in time segments}
- G09G 2370/20: Details of the management of multiple sources of image data
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00)

## Abstract

Systems and methods are provided for generating a composite video based on a plurality of asynchronously recorded input video streams. A plurality of segments of the input video streams are identified. A number of the input video streams that were recording during the particular segment are determined. A video display configuration for the particular segment is determined based on the number of video streams that were recording, where the video display configuration includes a display sub-region for each of the number of video streams that was recording. A composite video is generated, where the composite video includes a portion of video associated with each of the segments, where the composite video portion associated with the particular segment is formatted according to the video display configuration and displays the video streams that were recording during the particular segment in the display sub-regions of the video display configuration.

## Claims

### Claim 1

A computer-implemented method of generating a composite video based on a plurality of asynchronously recorded input video streams, comprising:
identifying a plurality of segments of the input video streams, wherein a particular segment begins when one of the input video streams starts or stops recording, and wherein the particular segment ends when one of the input video streams starts or stops recording;
determining a number of the input video streams that were recording during the particular segment;
determining a video display configuration for the particular segment based on the number of video streams that were recording, wherein the video display configuration includes a display sub-region for each of the number of video streams that was recording; and
generating a composite video, wherein the composite video includes a portion of video associated with each of the segments, wherein the composite video portion associated with the particular segment is formatted according to the video display configuration and displays the video streams that were recording during the particular segment in the display sub-regions of the video display configuration.

### Claim 2 (depends on 1)

The method of claim 1, further comprising:
time aligning the plurality of input video streams prior to identifying the plurality of segments.

### Claim 3 (depends on 2)

The method of claim 2, wherein aligning an input video stream includes:
determining a clock skew between a time measurement associated with a first video stream and a master time measurement; and
aligning the first video stream with a master timeline based on the clock skew.

### Claim 4 (depends on 1)

The method of claim 1, wherein a number of rows of display sub-regions of the video display configuration is determined according to:
Round_up(√{square root over (n)});
wherein n is the number of input video streams that were recording during the particular segment.

### Claim 5 (depends on 1)

The method of claim 1, wherein the video streams that were recording during the particular segment are assigned to display sub-regions based on which of the video streams that were recording had been recording the longest.

### Claim 6 (depends on 1)

The method of claim 1, wherein the video streams that were recording during the particular segment are assigned to display sub-regions based on which of the video streams began recording first.

### Claim 7 (depends on 1)

The method of claim 1, wherein the input video streams are recorded over a duration, wherein at least one of the video streams starts recording and stops recording multiple times during the duration.

### Claim 8 (depends on 1)

The method of claim 1, wherein the composite video includes a first portion, wherein the first portion includes a first video display configuration having x number of display sub-regions;
wherein the composite video includes a second portion, wherein the second portion includes a second video display configuration having y number of display sub-regions, wherein x is not equal to y.

### Claim 9 (depends on 1)

The method of claim 1, wherein the input video streams are transmitted to a server from a plurality of mobile video capture devices;
wherein the server is configured to generate the composite video using the input video streams.

### Claim 10 (depends on 9)

The method of claim 9, wherein the mobile video capture devices are mobile telephones.

### Claim 11 (depends on 9)

The method of claim 9, wherein the mobile video capture devices include one or more of a tablet computer, a dedicated video recording device, a camera, a camcorder, or a smart phone.

### Claim 12 (depends on 9)

The method of claim 9, wherein the input video streams are transmitted to the server after the input video streams are recorded.

### Claim 13 (depends on 9)

The method of claim 9, wherein the input video streams are transmitted to the server contemporaneously with the recording of the input video streams.

### Claim 14 (depends on 13)

The method of claim 13, wherein the server generates and transmits the composite video contemporaneously with the recording of the input video streams.

### Claim 15 (depends on 1)

The method of claim 1, wherein the steps of the method are performed using a downloadable application.

### Claim 16 (depends on 1)

The method of claim 1, wherein the steps of the method are performed using one or more data processors.

### Claim 17 (depends on 1)

The method of claim 1, wherein at least one of the input video streams is transmitted to a server from a still-frame camera, and wherein the still-frame camera transmits a still photo image as a video stream.

### Claim 18

A computer-implemented system for generating a composite video based on a plurality of asynchronously recorded input video streams, comprising:
one or more computer memories for storing a timeline data structure, wherein the timeline data structure includes:
identifications of stop and start times for the plurality of asynchronously recorded input video streams with respect to a global timeline;
a data processor configured to:
identify a plurality of segments of the input video streams, wherein a particular segment begins when one of the input video streams starts or stops recording, and wherein the particular segment ends when one of the input video streams starts or stops recording;
determining a number of the input video streams that were recording during the particular segment;
determining a video display configuration for the particular segment based on the number of video streams that were recording, wherein the video display configuration includes a display region for each of the number of video streams that was recording; and
wherein the one or more computer memories is further configured to store a composite video data structure, wherein the composite video data structure is configured to store data sufficient to identify video display configurations for each of the plurality of segments including the particular segment.

### Claim 19

A computer-implemented system for generating a composite video based on a plurality of asynchronously recorded input video streams, comprising:
one or more data processors;
one or more computer-readable mediums encoded with instructions for commanding the one or more data processors to execute steps that include:
identifying a plurality of segments of the input video streams, wherein a particular segment begins when one of the input video streams starts or stops recording, and wherein the particular segment ends when one of the input video streams starts or stops recording;
determining a number of the input video streams that were recording during the particular segment;
determining a video display configuration for the particular segment based on the number of video streams that were recording, wherein the video display configuration includes a display sub-region for each of the number of video streams that was recording; and
generating a composite video, wherein the composite video includes a portion of video associated with each of the segments, wherein the composite video portion associated with the particular segment is formatted according to the video display configuration and displays the video streams that were recording during the particular segment in the display sub-regions of the video display configuration.

### Claim 20

A non-transitory computer-readable medium encoded with instructions for commanding one or more data processors to execute steps for generating a composite video based on a plurality of asynchronously recorded input video streams, the steps comprising:
identifying a plurality of segments of the input video streams, wherein a particular segment begins when one of the input video streams starts or stops recording, and wherein the particular segment ends when one of the input video streams starts or stops recording;
determining a number of the input video streams that were recording during the particular segment;
determining a video display configuration for the particular segment based on the number of video streams that were recording, wherein the video display configuration includes a display sub-region for each of the number of video streams that was recording; and
generating a composite video, wherein the composite video includes a portion of video associated with each of the segments, wherein the composite video portion associated with the particular segment is formatted according to the video display configuration and displays the video streams that were recording during the particular segment in the display sub-regions of the video display configuration.
