Apparatus and method for providing mixed reality contents for learning through story-based virtual experience

A method for providing mixed reality contents for learning through a story-based virtual experience, comprising:

• capturing a user image of a user within an actual environment;
• setting an action zone within a virtual world in which a 3D image of the virtual world having the story is synthesized with the user image and setting a corner coordinate of the action zone as a reference point for the action zone within the 3D image of the virtual world;
• tracking a user position from the user image and calculating the tracked user position as four rectangular corner coordinates;
• converting the four rectangular corner coordinates into a 3D coordinate;
• matching the 3D coordinate to the corner coordinate of the action zone;
• and
• displaying a synthesized image of the user and the virtual world that is based on matching the 3D coordinate to the corner coordinate of the action zone.