US 6,807,303 B1 · Method and apparatus for retrieving multimedia data using shape information

Abstract

A method and apparatus for retrieving multimedia data using shape information. The multimedia data retrieval apparatus comprises a shape information feature extractor for receiving shape information of a query image and extracting a feature of the received shape information using a shape information descriptor based on eigen vectors of a multilayer covariance matrix, an image feature extractor for extracting a feature of each image data in the same manner as the shape information feature extractor, a multimedia database creator for creating a multimedia database on the basis of the features extracted by the image feature extractor, a similarity comparator for comparing the feature of the query image extracted by the shape information feature extractor with the features of the image data in the multimedia database to calculate similarities therebetween, and a compared result output unit for outputting the results calculated by the similarity comparator. Multimedia data can accurately and rapidly be retrieved by defining and using a shape information descriptor with a consistency against rotation, scaling and translation of the shape information.

Claims36

Dependent claims

A method for retrieving multimedia data using shape information, comprising the steps of:

a) receiving shape information of a query image and extracting a feature of the received shape information using a shape information descriptor based on eigen vectors of a multilayer covariance matrix, said shape information descriptor comprising a ratio of magnitudes of said eigen vectors, an angle of any one of said eigen vectors, a center point in a given region and a compactness in the given region;
b) extracting a feature of each image data in the same manner as said step a);
c) creating a multimedia database on the basis of said features extracted at said step b);
d) comparing said feature of said query image with said features of said image data in said multimedia database to calculate similarities there between;
and
e) outputting the results calculated at said step d).

3 more elements

An apparatus for retrieving multimedia data using shape information, comprising:

shape information feature extraction means for receiving shape information of a query image and extracting a feature of the received shape information using a shape information descriptor based on eigen vectors of a multi-layer covariance matrix, said feature extraction means comprising a first calculator for calculating a ratio of magnitudes of said eigen vectors, a second calculator for calculating an angle of any one of said eigen vectors, a third calculator for calculating a center point in a given region, and a fourth calculator for calculating a compactness in the given region;
image feature extraction means for extracting a feature of each image data in the same manner as said shape information feature extraction means;
multimedia database creation means for creating a multimedia database on the basis of said features extracted by said image feature extraction means;
similarity comparison means for comparing said feature of said query image extracted by said shape information feature extraction means with said features of said image data in said multimedia database to calculate similarities therebetween;
and
compared result output means for outputting the results calculated by said similarity comparison means.

3 more elements

Dependencies are inferred from the claim text.

Method and apparatus for retrieving multimedia data using shape information

Life of this patent

Method and apparatus for retrieving multimedia data using shape information

Life of this patent

Abstract

Claims36