System and method of presenting multi-device video based on mpeg-4 single media

A method for presenting real-sense effect of multi-device video based on MPEG-4 single media comprising:

• receiving MPEG-4 media, document, and action script defining actions required for the presentation of the MPEG-4 media;
• extracting objects from the MPEG-4 media;
• analyzing behavior patterns of the objects;
• recognizing situation of the analyzed behavior patterns of the objects by using an ontology profile;
• generating real-sense metadata to control one or more real-sense effect devices based on the recognized situation;
• generating the real-sense metadata, the ontology profile, the MPEG-4 media, the document and the action script into a single media;
• transmitting the single media through broadcasting media;
• receiving the single media;
• extracting the real-sense metadata from the single media;
• selecting any of real-sense effect devices based on the real-sense effect metadata;
• generating a command to control the selected real-sense effect devices based on the real-sense effect metadata and the ontology profile;
• and
• reproducing the single media by controlling the selected real-sense effect devices in response to the control command.