Real-time dynamic non-planar projection apparatus and method

A real-time dynamic non-planar projection method, comprising:

• preprocessing, by a preprocessing unit, data related to a static part of a screen image to be projected onto a non-planar surface;
• classifying, by a real-time projection unit, non-planar objects in the screen image to be projected onto the non-planar surface into a rigid body and a non-rigid body using data output from the preprocessing unit;
• and
• respectively rendering, by the real-time projection unit, the rigid body and the non-rigid body depending on a viewer's current viewpoint, and projecting rendered results onto the non-planar surface via projection mapping,
• wherein classifying the non-planar object comprises:
• extracting a depth map from the non-planar object in real time;
• separating a depth as a group of connected meaningful units from the depth map;
• comparing a depth of a previous frame and a depth of a current frame of the separated group with each other and calculating a difference between the depths;
• and
• comparing the calculated difference with a preprocessed rigid body mesh of a mesh group of a foreground separated from a background and then determining whether the separated group is a rigid body.

A real-time dynamic non-planar projection method, comprising:

• preprocessing, by a preprocessing unit, data related to a static part of a screen image to be projected onto a non-planar surface;
• classifying, by a real-time projection unit, non-planar objects in the screen image to be projected onto the non-planar surface into a rigid body and a non-rigid body using data output from the preprocessing unit;
• and
• respectively rendering, by the real-time projection unit, the rigid body and the non-rigid body depending on a viewer's current viewpoint, and projecting rendered results onto the non-planar surface via projection mapping,
• wherein preprocessing the data comprises:
• previously obtaining and storing mesh values for a background of the screen image to be projected onto the non-planar surface;
• previously obtaining and storing mesh values for a rigid body in a foreground other than the background;
• and
• calibrating intrinsic parameters and extrinsic parameters of a projector that will project the screen image onto the non-planar surface.