Apparatus for multimedia integrated retrieval and storage medium storing a multimedia integrated retrieval program

A storage medium device storing a multimedia integrated search program that causes a computer to execute:

• gathering a plurality of pieces of media data through a network;
• calculating a feature value of single media data representing a type of media from among the plurality of pieces of media data gathered in the gathering;
• storing the feature value in association with the single media data in a media information storage unit that stores composite media data representing a plurality of types of media among the plurality of pieces of media data, in association with the single media data included in the composite media data;
• receiving, from a user, a retrieval instruction to retrieve the single media data;
• referencing the media information storage unit, and identifying another piece of single media data corresponding to the single media data using the feature value of the single media data, according to the retrieval instruction;
• generating, in a first generation operation, first structural body data that includes a first node indicative of the single media data, a second node indicative of the another piece of single media data, and a first link connecting the first node to the second node;
• referencing the media information storage unit and determining whether another piece of composite media data including the another piece of single media data is present;
• if the another piece of composite media data is present, generating, in a second generation operation, second structural body data that includes, with the first structural body data, a third node indicative of the another piece of composite media data, and a second link connecting the third node to the second node;
• and
• displaying the second structural body data.

A storage medium device storing a multimedia integrated search program that causes a computer to execute:

• gathering a plurality of pieces of media data through a network;
• calculating a feature value of single media data representing a type of media from among the plurality of pieces of media data that is gathered;
• storing the feature value in association with the single media data in a media information storage unit that stores composite media data representing a plurality of types of media among the plurality of pieces of media data, in association with the single media data included in the composite media data;
• receiving, from a user, a retrieval instruction to retrieve first single media data;
• referencing the media information storage unit, and identifying, in a first identification operation, second single media data corresponding to the single media data using the feature value of the first single media data corresponding to the retrieval instruction;
• receiving, from the user, another retrieval instruction to retrieve third single media data;
• referencing the media information storage unit, and identifying, in a second identification operation, fourth single media data corresponding to the third single media data using a feature value of the third single media data corresponding to the another retrieval instruction;
• referencing the media information storage unit and determining whether another piece of composite media data including the second single media data and the fourth single media data is present;
• generating, if the another piece of composite media data is present, structural body data that includes a node indicative of the second single media data, a node indicative of the fourth single media data, a node indicative of the another piece of composite media data, a link connecting the node indicative of the second single media data to the node indicative of the another piece of composite media data, and a link connecting the node indicative of the fourth single media data to the node indicative of the another piece of composite media data;
• and
• displaying the structural body data.