# US 2008/0304807 A1 · Assembling Video Content

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2008/0304807 A1
- Document ID: US20080304807A1
- Status: Published application
- Kind: A1
- Application number: 11/760,691
- Filed: 2007-06-08
- Published: 2008-12-11
- Earliest claimed: 2007-06-08
- Assignees: Apple Inc.
- Inventors: Gary Johnson; Mike Marinkovich; Greg Lindley; Alan Cannistraro; Evan Doll
- Web page: https://patentgrep.com/patent/US20080304807A1

## CPC

- G06F 16/743: {a collection of video files or sequences}
- G06F 3/0482: Interaction with lists of selectable items, e.g. menus
- G06F 3/04842: Selection of displayed objects or displayed text elements (G06F3/0482 takes precedence)
- G06F 3/04847: Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
- G06F 16/70: of video data
- G06F 16/738: Presentation of query results
- G06F 16/739: {in form of a video summary, e.g. the video summary being a video sequence, a composite still image or having synthesized frames}
- G06F 16/78: Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
- G06F 16/7834: {using audio features}
- G06F 16/7837: {using objects detected or recognised in the video content}
- G06F 16/784: {the detected or recognised objects being people}
- G06F 16/7844: {using original textual content or text extracted from visual content or transcript of audio data}
- G06F 16/787: using geographical or spatial information, e.g. location
- H04N 21/854: Content authoring
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

A computer-implemented method involves accessing a library of video segments, receiving a user instruction to assemble a movie related to an organizing element that includes a video segment from the library of video segments, relating the organizing element to a video segment in the library of video segments, determining, based on relating the organizing element to the video segment in the library of video segments, whether the video segment should be added to a list of selected segments used to assemble the movie, selectively adding the video segment to the list of selected segments in response to determining that the video segment should be added, and assembling the movie using the list of selected segments.

## Claims

### Claim 1

A computer-implemented method comprising:
accessing a library of video segments;
receiving a user instruction to assemble a movie related to an organizing element that includes a video segment from the library of video segments;
relating the organizing element to a video segment in the library of video segments;
determining, based on relating the organizing element to the video segment in the library of video segments, whether the video segment should be added to a list of selected segments used to assemble the movie;
selectively adding the video segment to the list of selected segments in response to determining that the video segment should be added; and
assembling the movie using the list of selected segments.

### Claim 2 (depends on 1)

The method of claim 1 wherein receiving the user instruction to assemble a movie related to an organizing element includes:
receiving, from a user, an event description describing an activity which the user is interested in adding to the list of selected segments; and
using the event description as the organizing element.

### Claim 3 (depends on 2)

The method of claim 2 further comprising:
prompting the user to identify an example of the activity;
enabling the user to navigate in the library of video segments to launch one of the video segments;
enabling the user to designate visual elements, within the launched video segments, that indicate that the activity is occurring; and
using the visual elements to identify that the activity is occurring in other video segments in the library of video segments.

### Claim 4 (depends on 3)

The method of claim 3 wherein enabling the user to designate visual elements includes:
analyzing the spatial imagery within a launched video segment;
identifying one or more objects in the launched video segment;
graphically designating the one or more objects in the launched video segment;
enabling the user to select one or more of the graphically-designated objects; and
using the selected objects as the visual elements that identify the activity is occurring in the other video segments in the library of video segments.

### Claim 5 (depends on 3)

The method of claim 3 further comprising:
presenting the user with a list of activities associated with default elements for each of the activities, the default elements related to previously-defined visual elements that are descriptive of the activity;
enabling the user to select one of the activities; and
using the default elements for the selected activity to identify that the activity is occurring in other video segments in the library of video segments.

### Claim 6 (depends on 5)

The method of claim 5 further comprising:
launching a video segment from the library of video segments;
identifying instances of the default elements appearing in the video segment;
prompting the user to confirm that the identified instances are responsive to the user's interests; and
adding content related to the identified instances to the list of selected segments.

### Claim 7 (depends on 1)

The method of claim 1 wherein receiving the user instruction to assemble a movie related to an organizing element includes:
receiving, from a user, a person description describing an individual for which the user is interested in adding to the list of selected movies; and
using the person description as the organizing element.

### Claim 8 (depends on 7)

The method of claim 7 further comprising:
prompting the user to identify an example of the individual;
enabling the user to navigate in the library of video segments to launch one of the video segments;
enabling the user to designate visual elements, within the launched video segments, that indicate that the individual is appearing; and
using the visual elements to identify that the individual is appearing in other video segments in the library of video segments.

### Claim 9 (depends on 1)

The method of claim 1 wherein receiving the user instruction to assemble a movie related to an organizing element includes:
receiving, from a user, an exclamatory description entered as text describing audio content that is based on the text for which the user is interested in adding to the list of selected movies; and
using the exclamatory description as the organizing element.

### Claim 10 (depends on 1)

The method of claim 1 wherein receiving the user instruction to assemble a movie related to an organizing element includes:
receiving, from a user, an individual audio profile describing an individual whom the user is interested in adding to the list of selected movies; and
using the individual audio profile as the organizing element.

### Claim 11 (depends on 10)

The method of claim 10 further comprising:
prompting the user to identify an example of the individual speaking;
enabling the user to navigate in the library of video segments to launch one of the video segments;
enabling the user to indicate audio designators for portions of time, within the launched video segments, that indicate that when individual is speaking; and
using the audio designators to identify other instances of content when the individual is speaking in other video segments in the library of video segments.

### Claim 12 (depends on 1)

The method of claim 1 further comprising:
presenting the list of selected segments to a user before assembling the movie; and
enabling the user to further specify which of the selected segments from the list of selected segments should be used to assemble the movie.

### Claim 13 (depends on 1)

The method of claim 1 further comprising:
enabling the user to designate two different types of organizing elements selected from the group that includes event descriptions, visual elements, exclamatory descriptions, and individual audio profiles;
presenting, before assembling the movie, the list of selected segments;
for each of the selected segments in the list of video segments, presenting an indication of which of the different types of organizing element is related to the video segment; and
enabling the user to further specify which of the selected segments from the list of selected segments should be used to assemble the movie.

### Claim 14 (depends on 1)

The method of claim 1 wherein adding the video segment to the list of selected segments includes adding an excerpt from a larger portion of video content, the excerpt related to the organizing element.

### Claim 15 (depends on 14)

The method of claim 14 wherein adding the excerpt includes:
adding introductory content occurring in advance of desired content; and
adding trailing content that follows the desired content, wherein the introductory content and the trailing content are not required to be responsive to the organizing element.

### Claim 16 (depends on 14)

The method of claim 14 further comprising not adding those portions of content from the video segment that are not related to the organizing element.

### Claim 17 (depends on 1)

The method of claim 1 further comprising:
identifying a first instance of content in a video segment related to the organizing element;
identifying a second instance of content in the video segment related to the organizing element; and
adding the first and second instances of content to the list of selected segments as separate and distinct video segments.

### Claim 18

A system comprising:
a library of video segments;
a computer system configured to execute one or more processes to perform operations including:
(i) access the library of video segments;
(ii) receive a user instruction to assemble a movie related to an organizing element that includes a video segment from the library of video segments;
(iii) relate the organizing element to a video segment in the library of video segments;
(iv) determine, based on relating the organizing element to the video segment in the library of video segments, whether the video segment should be added to a list of selected segments used to assemble the movie;
(v) selectively add the video segment to the list of selected segments in response to determining that the video segment should be added; and
(vi) assemble the movie using the list of selected segments.

### Claim 19

A system comprising:
a library of video segments;
means for accessing the library of video segments;
means for receiving a user instruction to assemble a movie related to an organizing element that includes a video segment from the library of video segments;
means for relating the organizing element to a video segment in the library of video segments;
means for determining, based on relating the organizing element to the video segment in the library of video segments, whether the video segment should be added to a list of selected segments used to assemble the movie;
means for selectively adding the video segment to the list of selected segments in response to determining that the video segment should be added; and
means for assembling the movie using the list of selected segments.
