# US 2015/0104147 A1 · Digest video generation apparatus

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2015/0104147 A1
- Document ID: US20150104147A1
- Status: Published application
- Kind: A1
- Application number: 14/053,240
- Filed: 2013-10-14
- Published: 2015-04-16
- Earliest claimed: 2013-10-14
- Assignees: Sony Corporation
- Applicants: Sony Corporation
- Inventors: Junichi KOSAKA; Tatsuya HAMA; Kenichi YONEDA; Takamoto TSUDA; Yukiko AKIYAMA
- Web page: https://patentgrep.com/patent/US20150104147A1

## CPC

- G06F 16/783: using metadata automatically derived from the content
- G06F 16/4393: {Multimedia presentations, e.g. slide shows, multimedia albums}
- G06F 16/738: Presentation of query results
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

A terminal device includes circuitry configured to acquire designated image data stored in a memory. The circuitry may sort the designated image data based on a time at which the designated image data was captured. The circuitry may divide the sorted image data into a plurality of time slots and calculate, based on features of the designated image data corresponding to each time slot of the plurality of time slots, a time slot score for each of the plurality of time slots. The circuitry may allocate, based on the time slot score, a portion of a digest video to each of the plurality of time slots. The circuitry may generate, for each time slot, a local digest video by assigning an amount of the designated image data to the local digest video corresponding to the time slot, and generate the digest video by connecting the generated local digest videos.

## Claims

### Claim 1

A terminal device comprising:
circuitry configured to
acquire designated image data stored in a memory;
sort the designated image data based on a time at which the designated image data was captured;
divide the sorted image data into a plurality of time slots;
calculate, based on features of the designated image data corresponding to each time slot of the plurality of time slots, a time slot score for each of the plurality of time slots;
allocate, based on the time slot score, a portion of a digest video to each of the plurality of time slots;
generate, for each time slot, a local digest video by assigning an amount of the designated image data included in the time slot to the local digest video corresponding to the time slot; and
generate the digest video by connecting the local digest videos generated for each of the plurality of time slots.

### Claim 2 (depends on 1)

The terminal device of claim 1, wherein
the local digest video generation includes:
dividing each of the plurality of time slots into a plurality of sub-time slots;
calculating, based on features of the designated image data corresponding to each sub-time slot of the plurality of sub-time slots, a sub-time slot score for each of the plurality of sub-time slots, and
assigning, based on the sub-time slot score, the amount of the designated image data included in each time slot to the local digest video corresponding to the time slot.

### Claim 3 (depends on 2)

The terminal device of claim 2, wherein
the circuitry is configured to:
calculate, for each time slot of the plurality of time slots, a sub-time slot score ratio represented by each sub-time slot's score relative to a total sub-time slot score for the plurality of sub-time slots included in the time slot; and
assign, based on the sub-time slot score ratio, the amount of the designated imaged data included in each time slot to the local digest video corresponding to the time slot.

### Claim 4 (depends on 2)

The terminal device of claim 2, wherein:
the circuitry is configured to acquire, as metadata corresponding to the designated image data, user comments corresponding to the image data, and
the circuitry is configured to calculate the sub-time slot score for each of the plurality of sub-time slots included in each of the plurality of time slots based on one or more of a quantity of image data files included in the time slot, a length of the image data included in the time slot, a sound level of audio corresponding to the image data included in the time slot, a number of faces detected in the image data included in the time slot, and a number of user comments corresponding to the image data.

### Claim 5 (depends on 2)

The terminal device of claim 2, wherein:
the circuitry is configured to determine, for each sub-time slot of the plurality of sub-time slots included in the plurality of time slots, when the sub-time slot score is below a threshold value, and
the circuitry is configured to exclude the image data corresponding to the sub-time slot having the score below the threshold when generating the local digest video.

### Claim 6 (depends on 1)

The terminal device of claim 1, wherein
the circuitry is configured to calculate, based on the time slot score, a score ratio for each time slot, wherein the score ratio represents a relative measure of each time slot's score with respect to a total score for the plurality of time slots, and to allocate, based on the score ratio, the portion of the digest video to each of the plurality of time slots.

### Claim 7 (depends on 1)

The terminal device of claim 1, wherein:
the circuitry is configured to extract metadata from the designated image data, and
the circuitry is configured to calculate the time slot score for each of the plurality of time slots based on the metadata corresponding to the image data included in each respective time slot.

### Claim 8 (depends on 1)

The terminal device of claim 1, wherein
the circuitry is configured to calculate the time slot score for each of the plurality of time slots based on one or more of a quantity of image data files included in the time slot, a length of the image data included in the time slot, a sound level of audio corresponding to the image data included in the time slot, and a number of faces detected in the image data included in the time slot.

### Claim 9 (depends on 1)

The terminal device of claim 1, wherein
the circuitry is configured to determine when the time slot score for each time slot of the plurality of time slots is outside a range defined by a minimum threshold value and a maximum threshold value and, in response to determining the time slot score is outside the range, the circuitry adjusts the time slot score to fall within the range.

### Claim 10 (depends on 1)

The terminal device of claim 1, wherein
the circuitry is configured to acquire, as metadata corresponding to the designated image data, user comments corresponding to the image data.

### Claim 11 (depends on 10)

The terminal device of claim 10, wherein
the circuitry is configured to determine whether the user comments correspond to a positive affinity or a negative affinity for the image data.

### Claim 12 (depends on 1)

The terminal device of claim 1, wherein
the memory is included in a server accessed on a network.

### Claim 13 (depends on 12)

The terminal device of claim 12, wherein:
the image data stored on the server is viewable by a plurality of terminal devices connected to the network,
the server determines, for the image data stored on the server, a number of view requests of the designated image data, and
the circuitry is configured to acquire the determined number of view requests from the server, and to calculate the time slot score for each of the plurality of time slots based on the number of view requests for the image data included in the time slot.

### Claim 14

An information processing system comprising:
a server configured to store image data uploaded from one or more external devices;
a digest video creating device configured to acquire designated image data from the image data stored on the server, and to create a digest video of the image data from the acquired designated image data; and
a terminal device configured to acquire the digest video created by the digest video creating device and display the acquired digest video on a display, wherein
the digest video creating device includes circuitry configured to:
sort the designated image data based on a time at which the designated image data was captured;
divide the sorted image data into a plurality of time slots;
calculate, based on features of the designated image data corresponding to each time slot of the plurality of time slots, a time slot score for each of the plurality of time slots;
allocate, based on the time slot score, a portion of a digest video to each of the plurality of time slots;
generate, for each time slot, a local digest video by assigning an amount of the designated image data included in the time slot to the local digest video corresponding to the time slot; and
generate the digest video by connecting the local digest videos generated for each of the plurality of time slots.

### Claim 15 (depends on 14)

The information processing system of claim 14, wherein
the local digest video generation includes:
dividing each of the plurality of time slots into a plurality of sub-time slots;
calculating, based on features of the designated image data corresponding to each sub-time slot of the plurality of sub-time slots, a sub-time slot score for each of the plurality of sub-time slots, and
assigning, based on the sub-time slot score, the amount of the designated image data included in each time slot to the local digest video corresponding to the time slot.

### Claim 16 (depends on 15)

The information processing system of claim 15, wherein
the circuitry is configured to:
calculate, for each time slot of the plurality of time slots, a sub-time slot score ratio represented by each sub-time slot's score relative to a total sub-time slot score for the plurality of sub-time slots included in the time slot; and
assign, based on the sub-time slot score ratio, the amount of the designated imaged data included in each time slot to the local digest video corresponding to the time slot.

### Claim 17 (depends on 15)

The information processing system of claim 15, wherein:
the circuitry is configured to acquire, from the server as metadata corresponding to the designated image data, user comments corresponding to the image data, and
the circuitry is configured to calculate the sub-time slot score for each of the plurality of sub-time slots included in each of the plurality of time slots based on one or more of a quantity of image data files included in the time slot, a length of the image data included in the time slot, a sound level of audio corresponding to the image data included in the time slot, a number of faces detected in the image data included in the time slot, and a number of user comments corresponding to the image data.

### Claim 18 (depends on 15)

The information processing system of claim 15, wherein:
the circuitry is configured to determine, for each sub-time slot of the plurality of sub-time slots included in the plurality of time slots, when the sub-time slot score is below a threshold value, and
the circuitry is configured to exclude the image data corresponding to the sub-time slot having the score below the threshold when generating the local digest video.

### Claim 19 (depends on 14)

The information processing system of claim 14, wherein
the circuitry is configured to calculate, based on the time slot score, a score ratio for each time slot, wherein the score ratio represents a relative measure of each time slot's score with respect to a total score for the plurality of time slots, and to allocate, based on the score ratio, the portion of the digest video to each of the plurality of time slots.

### Claim 20

A non-transitory computer readable medium having instructions stored therein that one executed by one or more processors, cause the one or more processors to perform a method of generating a digest video, the method comprising:
acquiring designated image data stored in a memory;
sorting the designated image data based on a time at which the designated image data was captured;
dividing the sorted image data into a plurality of time slots;
calculating, based on features of the designated image data corresponding to each time slot of the plurality of time slots, a time slot score for each of the plurality of time slots;
allocating, based on the time slot score, a portion of a digest video to each of the plurality of time slots;
generating, for each time slot, a local digest video by assigning an amount of the designated image data included in the time slot to the local digest video corresponding to the time slot; and
generating the digest video by connecting the local digest videos generated for each of the plurality of time slots.
