# US 2015/0147045 A1 · Computer ecosystem with automatically curated video montage

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2015/0147045 A1
- Document ID: US20150147045A1
- Status: Published application
- Kind: A1
- Application number: 14/090,112
- Filed: 2013-11-26
- Published: 2015-05-28
- Earliest claimed: 2013-11-26
- Assignees: Sony Corporation
- Applicants: Sony Corporation
- Inventors: MARC STEVEN BIRNKRANT
- Web page: https://patentgrep.com/patent/US20150147045A1

## CPC

- G11B 27/031: Electronic editing of digitised analogue information signals, e.g. audio or video signals
- G06V 20/47: {Detecting features for summarising video content}
- G11B: INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER (recording measured values in a way that does not require playback through a transducer G01D9/00; recording or playback apparatus using mechanically marked tape, e.g. punched paper tape, or using unit records, e.g. punched or magnetically marked cards G06K; transferring data from one type of record carrier to another G06K1/18; circuits for coupling output of reproducer to radio receiver H04B1/20; gramophone pick-ups or like acoustic electromechanical transducers or circuits therefor H04R)
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

Electronic images of a video stream are programmatically analyzed and metadata associated with the images automatically populated with contextually relevant tags and markers for later referencing the images for curated entertainment. Specifically, a user can specify parameters for a video montage that leverages the metadata for automatic video montage creation based on the metadata.

## Claims

### Claim 1

A device comprising:
at least one computer readable storage medium bearing instructions executable by a processor;
at least one processor configured for accessing the computer readable storage medium to execute the instructions to configure the processor for:
recognizing at least one feature in respective electronic images of plural digital video streams;
for each image, automatically associating the image with an original metadata indicating the at least one feature;
for at least some segments of the plural video streams, associating the segments with respective indicia of scene excitement derived at least in part on motion vector analysis of the segments, and/or on object recognition on images in the segments;
receiving a user specification for a video montage, the specification including at least a montage subject;
based on the user specification, selecting plural segments from plural video streams, the selecting plural segments further being responsive to a determination that each selected segment satisfies an excitement threshold based at least in part on the respective index of scene excitement to render plural selected segments; and
assembling the plural selected segments from plural video streams into a montage video stream.

### Claim 2 (depends on 1)

The device of claim 1, wherein the processor when executing the instructions is further configured for:
presenting on a display a user interface (UI) permitting a user to specify parameters for a video montage to be created from video files in one or more libraries of video files, the UI including:
a first selector by which a user can specify a theme or subject of the montage.

### Claim 3 (depends on 2)

The device of claim 2, wherein the processor when executing the instructions is further configured for presenting the UI with:
a second selector by which a user can enter a desired length of the montage.

### Claim 4 (depends on 1)

The device of claim 1, wherein the processor when executing the instructions is further configured for presenting the UI with:
a third selector allowing a user to select only video clips for the montage that indicate excitement in the video clips.

### Claim 5 (depends on 2)

The device of claim 2, wherein the UI presented by the processor when executing the instructions includes:
a music selector allowing a user to enter a music track identification to associate a music track with the montage.

### Claim 6 (depends on 2)

The device of claim 2, wherein the UI presented by the processor when executing the instructions includes:
a music selector allowing a user to indicate that the processor is to select a music track to associate with the montage.

### Claim 7 (depends on 2)

The device of claim 2, wherein the UI presented by the processor when executing the instructions includes:
an order selector allowing a user to specify whether the video clips are to be in chronological order in the montage or assembled in the montage in a temporally manner.

### Claim 8 (depends on 1)

The device of claim 1, wherein index of scene excitement is associated with motion vectors of a segment.

### Claim 9 (depends on 1)

The device of claim 1, wherein index of scene excitement is associated with emotion in a segment as indicated by a face recognition algorithm.

### Claim 10

Method, comprising:
presenting on a display a user interface (UI) permitting a user to specify parameters for a video montage to be created from video files in one or more libraries of video files;
receiving via the UT the parameters, the parameters including at least a montage subject;
based on the parameters, selecting plural segments from plural video streams; and
assembling the plural selected segments from plural video streams into a montage video stream.

### Claim 11 (depends on 10)

The method of claim 10, the selecting plural segments further being responsive to a determination that each selected segment satisfies an excitement threshold based at least in part on the respective index of scene excitement to render plural selected segments

### Claim 12 (depends on 10)

The method of claim 10, wherein the parameters include a desired length of the montage.

### Claim 13 (depends on 10)

The method of claim 10, wherein the parameters include a music track selection of a music track with the montage.

### Claim 14 (depends on 10)

The method of claim 10, wherein the parameters include an instruction for a processor to select one or more music tracks to accompany the montage.

### Claim 15 (depends on 10)

The method of claim 10, wherein the parameters include a clip order parameter indicating chronological assembly or random assembly of video clips into the montage.

### Claim 16

System comprising:
at least one computer readable storage medium bearing instructions executable by a processor which is configured for accessing the computer readable storage medium to execute the instructions to configure the processor for:
presenting on a display a user interface (UI) permitting a user to specify parameters for a video montage to be created from video files in one or more libraries of video files, the UI including:
a first selector by which a user can specify a theme or subject of the montage;
a second selector by which a user can enter a desired length of the montage; and
a third selector allowing a user to select only video clips for the montage that indicate excitement in the video clips.

### Claim 17 (depends on 16)

The system of claim 16, wherein the UI presented by the processor when executing the instructions includes:
a music selector allowing a user to enter a music track identification to associate a music track with the montage.

### Claim 18 (depends on 16)

The system of claim 16, wherein the UI presented by the processor when executing the instructions includes:
a music selector allowing a user to indicate that the processor is to select a music track to associate with the montage.

### Claim 19 (depends on 16)

The system of claim 16, wherein the UI presented by the processor when executing the instructions includes:
an order selector allowing a user to specify whether the video clips are to be in chronological order in the montage or assembled in the montage in a temporally manner.

### Claim 20 (depends on 16)

The system of claim 16, wherein the instructions when executed by the processor configured the processor for:
recognizing at least one feature in respective electronic images of plural digital video streams;
for each image, automatically associating the image with an original metadata indicating the at least one feature;
based on the parameters, selecting plural segments from plural video streams; and
assembling the plural selected segments from plural video streams into a montage video stream.
