Method of extracting shape variation descriptor for retrieving image sequence
AssigneesWhoi-Yul Kim, Kt Corporation
InventorsWhoi-Yul Kim, Min-Seok Choi, Young-Min Kong
Life of this patent
Estimating the term…
Abstract
A method for extracting a shape variation descriptor from image sequence data for content-based image retrieval is disclosed. The method for extracting the shape variation descriptor from image sequence data for content-based image retrieval, image sequence data representing variation of object through a plurality of frames, the method includes the steps of creating a frame including variation information and shape information by accumulating the plurality of frames, the centroid of object regions in each frame aligned; and extracting shape descriptor from the frame.
Claims30
A method for extracting a shape variation descriptor in order to retrieve content-based image sequence data that express motions of an object, comprising the steps of:
- (a) selecting a predetermined number of the frames from the image sequence data;
- (b) transforming the frame into an object frame including information about only the object that is separated from a background of the frame;
- (c) aligning the object into a predetermined location of the frame and generating an aligned frame;
- (d) superposing a number of the aligned frames so as to generate one frame, that is, a shape variation map (SVM) including information about motions of the object and information about shapes of the object;
- and
- (e) extracting the shape variation descriptor with respect to one SVM.
A method for retrieving image sequence data on a basis of a static shape variation and a dynamic shape variation, the method comprising the steps of:
- a) receiving a query image;
- and
- b) retrieving one of images stored in a database based on a similarity between a query image defined by equations as:
- 24 D SSV ( Q , D ) ∑ i [LeftDoubleBracketingBar] M SSV , Q [ i ] - M SSV , D [ i ] [RightDoubleBracketingBar] D DSV ( Q , D ) ∑ i [LeftDoubleBracketingBar] M DSV , Q [ i ] - M DSV , D [ i ] [RightDoubleBracketingBar]
- where, Distance(Q,D) MSSV,Q[i] MSSV,D[I], MDSV,Q[i], and MDSV,D[i] represent a similarity, an ith characteristic of the query image abbreviated as static shape variation[i], an ith characteristic of the comparative image stored at the database abbreviated as static shape variation[i], an ith characteristic of the query image abbreviated as dynamic shape variation[i] and an ith characteristic of the comparative image abbreviated as dynamic shape variation[i], respectively.
A computer readable recording medium storing instructions for executing a method for extracting a shape variation descriptor of a content-based retrieval system, the method comprising the steps of:
- (a) selecting a predetermined number of the frames from the image sequence data;
- (b) transforming the frame into an object frame that includes information about only the object that is separated from a background of the frame;
- (c) aligning the object into a predetermined location of the frame and generating an aligned frame;
- (d) superposing a number of the aligned frames so as to generate one frame, that is, a shape variation map(SVM) including information about the object motion and information about the object shape;
- and
- (e) extracting the shape variation descriptor with respect to one SVM.
A computer readable recording medium storing instructions for executing a method for retrieving image sequence data on a basis of a static shape variation and a dynamic shape variation in a processor of a content-based retrieval system, the method comprising the steps of:
- a) receiving a query image;
- and
- b) retrieving one of images stored in a database based on a similarity between a query image defined by equations as:
- 30 D SSV ( Q , D ) ∑ i [LeftDoubleBracketingBar] M SSV , Q [ i ] - M SSV , D [ i ] [RightDoubleBracketingBar] D DSV ( Q , D ) ∑ i [LeftDoubleBracketingBar] M DSV , Q [ i ] - M DSV , D [ i ] [RightDoubleBracketingBar]
- where, Distance(Q,D), MSSV,Q[i], MSSV,D[i], MDSV,Q[i], and MDSV,D[i] represent a similarity, an ith characteristic of the query image abbreviated as static shape variation[i], an ith characteristic of the comparative image stored at the database abbreviated as static shape variation[i], an ith characteristic of the query image abbreviated as dynamic shape variation[i] and an ith characteristic of the comparative image abbreviated as dynamic shape variation[i], respectively.
Dependencies are inferred from the claim text.