# US 2012/0251082 A1 · Method, apparatus and system for generating media content

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2012/0251082 A1
- Document ID: US20120251082A1
- Status: Published application
- Kind: A1
- Application number: 13/074,749
- Filed: 2011-03-29
- Published: 2012-10-04
- Earliest claimed: 2011-03-29
- Assignees: Sony Europe Limited; Sony Corporation
- Inventors: Kurt DE VOS; Philip Marivoet; Vanessa Schelkens; Daniel Clarke
- Web page: https://patentgrep.com/patent/US20120251082A1

## CPC

- H04N 5/765: Interface circuits between an apparatus for recording and another apparatus
- H04N 9/8205: {involving the multiplexing of an additional signal and the colour video signal}
- H04N 9/8211: {the additional signal being a sound signal (H04N9/835 takes precedence)}
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

A method of generating media content is described which comprises capturing still or moving image content items at a capture device and uploading the captured image content items and image content metadata indicating a time of capture of each of the image content items to a network. A playback log indicating playback times of audio content items listened to by the user of the capture device is stored. One or more of the captured image content items is correlated with one or more portions of the playback log based on the time of capture indicated by the metadata relating to the one or more captured content items and the playback times indicated by the playback log. A media output is generated as a collection of a plurality of the captured image content items stored at the network accompanied by audio content related to the portion of the playback log which is correlated with the captured image content items in the collection. In this way, a media output can be generated at a network, such as a cloud network, from user generated image content and commercial audio content which the user who captured the image content was listening to at the time the image content was captured.

## Claims

### Claim 1

A method of generating media content, comprising:
receiving, at a network, still or moving image content items captured by a capture device, and image content metadata indicating a time of capture of each of the image content items;
storing a playback log indicating playback times of audio content items listened to by the user of the capture device;
correlating one or more of the captured image content items with one or more portions of the playback log based on the time of capture indicated by the metadata relating to the one or more captured content items and the playback times indicated by the playback log; and
generating a media output as a collection of a plurality of the captured image content items stored at the network accompanied by audio content related to the portion of the playback log which is correlated with the captured image content items in the collection.

### Claim 2 (depends on 1)

A method according to claim 1, comprising:
selecting the audio content to accompany the captured image content items of the collection in dependence on a category of audio item indicated in the portion of the playback log correlated with the captured image content items in the collection.

### Claim 3 (depends on 1)

A method according to claim 1, comprising:
selecting the audio content to accompany the captured image content items of the collection from the audio content items listened to by the user over one or more periods of time during which the image content items were captured based on the correlation between the image content metadata and the playback log.

### Claim 4 (depends on 1)

A method according to claim 1, comprising:
providing the media output to a playback device of a different user for playback.

### Claim 5 (depends on 4)

A method according to claim 4, comprising:
obtaining said media at said viewing device via an internet link operable to set up an Internet connection between the viewing device and the network.

### Claim 6 (depends on 1)

A method according to claim 1, comprising:
selecting a plurality of the uploaded captured content items for inclusion in the collection of image content items; wherein
said selected content items are correlated with one or more portions of the playback log corresponding to the time of capture indicated by the metadata relating to the one or more selected content items; and
said media is generated as a collection of the selected image content items stored at the network accompanied by audio content related to the portion of the playback log which is correlated with the selected image content items in the collection.

### Claim 7 (depends on 1)

A method according to claim 1, wherein the collection of selected image content items is a sequence of the selected image content items.

### Claim 8 (depends on 6)

A method according to claim 6, wherein said step of selecting is conducted by specifying one or more of a subject tag, a geographical location, a time window and a still/moving image type as selection constraints, and by comparing the selection constraints with the image content metadata to identify image content items for selection.

### Claim 9 (depends on 1)

A method according to claim 1, comprising:
analysing the picture data of uploaded image content items and categorising the image content items based on the analysis; and
preferentially selecting audio content items listened to by the user which have a category which matches the categorisation of the image content items in the collection to accompany the collection of image content items.

### Claim 10 (depends on 9)

A method according to claim 9, comprising:
analysing the audio characteristics of audio content items and categorising the audio content items based on the analysis to form said category of the audio content items.

### Claim 11 (depends on 1)

A method according to claim 1, comprising:
analysing the metadata relating to uploaded image content items and categorising the image content items based on the analysis; and
preferentially selecting audio content items listened to by the user which have a category which matches the categorisation of the image content items in the collection to accompany the collection of image content items.

### Claim 12 (depends on 1)

A method according to claim 1, comprising:
selecting audio content items to accompany the collection of image content items in dependence on a time of day at which the image content items were captured.

### Claim 13 (depends on 12)

A method according to claim 12, comprising:
categorising the image content items by time of day based on the time of capture of the image content items indicated by said image metadata; and
preferentially selecting audio content items which have a time categorisation which matches the time categorisation of the image content items in the collection to accompany the collection of image content items.

### Claim 14 (depends on 1)

A method according to claim 1, comprising:
selecting audio content items to accompany the collection of image content items in dependence on metadata associated with the image content items.

### Claim 15 (depends on 1)

A method according to claim 1, comprising:
streaming audio content from the network to the user; and
generating the playback log at the network in dependence on the audio content streamed to the user.

### Claim 16 (depends on 1)

A method according to claim 1, comprising:
playing audio content to the user at a playback device;
generating the playback log at the playback device in dependence on the audio content played on the playback device; and
receiving, at the network, the playback log.

### Claim 17 (depends on 1)

A method according to claim 1, comprising:
applying an image processing effect to one or more of the image content items; and
selecting an audio content item to accompany the collection of image content items in dependence on a type of image processing effect applied to the image content item.

### Claim 18 (depends on 1)

A method according to claim 1, wherein:
the image content items comprise a moving image content item; and
the method comprises:
detecting an amount of motion in the moving image content item; and
selecting one or more audio content items to accompany the moving image content item in the media in dependence on an amount of motion detected in the moving image content items.

### Claim 19 (depends on 1)

A method according to claim 1, wherein:
the image content items comprise one or more moving image content items; and
the method comprises:
editing the one or more moving image content items; and
aligning a transition between two subsequent audio content items at or near a cut point in the edited moving image content items.

### Claim 20 (depends on 1)

A method according to claim 1, comprising:
receiving, at the network, still or moving image content items captured at one or more other capture devices and image content metadata indicating a time of capture of each of the image content items;
storing a playback log indicating playback times of audio content items listened to by the users of each of the one or more other capture devices;
correlating one or more of the image content items captured by the capture device and the one or more other capture devices with one or more portions of the playback logs associated with the users of the capture device and the one or more other capture devices based on the time of capture indicated by the metadata relating to the content items captured by the users of the capture device and the one or more other capture devices and the playback times indicated by the playback log; and
generating the media as a collection of a plurality of the image content items captured by the capture device and the one or more other capture devices accompanied by audio content related to the portions of the playback logs which are correlated with the captured image content items in the collection.

### Claim 21

A media content generation system, comprising:
a network;
a capture device for capturing still or moving image content items and uploading the captured image content items and image content metadata indicating a time of capture of each of the image content items to a network; and
an audio device for playing audio content items received from the network;
the network comprising:
a playback manager which stores a playback log indicating playback times of audio content items played by the audio device;
a correlation engine for correlating one or more of the captured image content items with one or more portions of the playback log based on the time of capture indicated by the metadata relating to the one or more captured content items and the playback times indicated by the playback log; and
a media generation engine for generating media as a collection of a plurality of the captured image content items stored at the network accompanied by audio content related to the portion of the playback log which is correlated with the captured image content items in the collection.

### Claim 22 (depends on 21)

A media content generation system according to claim 21, wherein both the capture device and the audio device are associated with the same user.

### Claim 23

A server side apparatus, comprising a processor configured to:
interface with an image repository to obtain selected still or moving image content items captured by a capture device and uploaded to the image repository, and image content metadata indicating a time of capture of each of the selected image content items;
interface with a playback log indicating playback times of audio content items played on a playback device associated with the capture device;
correlate one or more of the captured image content items with one or more portions of the playback log based on the time of capture indicated by the metadata relating to the one or more captured content items and the playback times indicated by the playback log; and
generate a media output as a collection of a plurality of the captured image content items stored at the network accompanied by audio content related to the portion of the playback log which is correlated with the captured image content items in the collection.

### Claim 24

A non-transitory computer readable medium comprising computer readable instructions that, when executed on a computer, cause the computer to carry out a method of generating media content, the method comprising:
receiving, at a network, still or moving image content items captured by a capture device, and image content metadata indicating a time of capture of each of the image content items;
storing a playback log indicating playback times of audio content items listened to by the user of the capture device;
correlating one or more of the captured image content items with one or more portions of the playback log based on the time of capture indicated by the metadata relating to the one or more captured content items and the playback times indicated by the playback log; and
generating a media output as a collection of a plurality of the captured image content items stored at the network accompanied by audio content related to the portion of the playback log which is correlated with the captured image content items in the collection.
