US 2012/0233168 A1Published application

Sound and image segment sorting device and method

AssigneeNEC Corporation

InventorsMakoto Terao, Takafumi Koshinaka

Life of this patent

Estimating the term…

Loading patent…

Abstract

A sound segment sorting unit (103) sorts the sound segments of a video. An image segment sorting unit (104) sorts the image segments of the video. A multiple sorting result generation unit (105) generates a plurality of sound segment sorting results and/or a plurality of image segment sorting results. A sorting result pair generation unit (106) generates a plurality of sorting result pairs of the sorting results as the candidates of the optimum segment sorting result of the video. A sorting result output unit (108) compares the sorting result comparative scores of the sorting result pairs calculated by a sorting result comparative score calculation unit (107) and thus outputs a sound segment sorting result and an image segment sorting result having good correspondence. This allows to accurately sort, for each object, a plurality of sound segments and a plurality of image segments contained in the video without adjusting parameters in advance.

Claims17

Dependent claims

A sound and image segment sorting device comprising:

a sound segment sorting unit that sorts a plurality of sound segments contained in a video into at least one sound cluster based on an arbitrary operation condition so as to generate a sound segment sorting result;
an image segment sorting unit that sorts a plurality of image segments contained in the video into at least one image cluster based on an arbitrary operation condition so as to generate an image segment sorting result;
a multiple sorting result generation unit that generates a plurality of sound segment sorting results and/or a plurality of image segment sorting results by applying a plurality of different operation conditions to at least one of said sound segment sorting unit and said image segment sorting unit;
a sorting result pair generation unit that generates a plurality of sorting result pairs each including one sound segment sorting result and one image segment sorting result based on the plurality of sound segment sorting results and the plurality of image segment sorting results obtained by said multiple sorting result generation unit;
a sorting result comparative score calculation unit that calculates, for each sorting result pair, a sorting result comparative score representing a fitness between a sound segment sorting result and an image segment sorting result included in the sorting result pair;
and
a sorting result output unit that selects a sorting result pair having a high fitness based on the sorting result comparative score and outputs a sound segment sorting result and an image segment sorting result included in the sorting result pair.

4 more elements

Dependencies are inferred from the claim text.