Apparatus and method for three-dimensional information augmented video see-through display, and rectification apparatus

A three-dimensional information augmented video see-through display method, comprising:

• obtaining at least two real images from at least two camera modules;
• performing rectification on the at least two real images;
• correcting at least two composite images obtained by combining a virtual image to the at least two real images, based on a lens distortion compensation value indicating a value for compensating for a distortion of a wide angle lens for at least two real images;
• and
• performing side-by-side image processing on the two composting images to generate a three-dimensional image for virtual reality VR or augmented reality AR,
• wherein the step of performing rectification comprises changing the two real images which are photographed from the at least two camera modules, based on adjusting an epipolar geometry through a field programmable gate array FPGA module to make an optical axis and a reference point be parallel and intersect at infinity.

A rectification apparatus, comprising:

• a camera interface module which obtains at least two real images from at least two camera modules;
• and
• a rectification module which performs rectification on the at least two real images;
• wherein the rectification module determines a current coordinate conversion target pixel group configured by at least one consecutive pixel requiring the same coordinate conversion, among a plurality of pixels included in the at least two real images, based on current reference target break point information on a previously stored break point look-up table and converts the coordinate of the current coordinate conversion target pixel group based on current coordinate conversion information including a differential value from the current target coordinate to which the current coordinate conversion target pixel group is converted, and
• wherein the rectification module performs rectification to change the two real images which are photographed from the at least two camera modules, based on adjusting an epipolar geometry through a field programable gate array FPGA module to make an optical axis and a reference point be parallel and intersect at infinity.