US 8,077,906 B2 · Apparatus for extracting camera motion, system and method for supporting augmented reality in ocean scene using the same

Abstract

A system and method for supporting augmented reality in an ocean scene is provided. According to the system and method, camera rotation information is extracted from horizontal line information of a sea extracted from an original image including a focal length and at least two first natural feature point tracking data existing on a sea plane and a plane parallel to the sea plane, using long-distance background features; camera movement is sequentially calculated from the camera rotation information and at least two natural feature point tracking data existing on the sea plane of the original image; and a computer graphics object is placed on a ground plane by importing camera position data, and a rendering is performed as moving the camera. Accordingly, the camera rotation and the camera movement can be accurately calculated, assuming that the camera focal length information is known at the time of capturing a moving image with a sea image for a background, and thus the CG/real scene synthesis with the sea for a background can be accomplished more realistically and accurately during the production of videos such as movie and drama.

Claims9

Dependent claims

An apparatus for extracting a camera motion, comprising:

a camera rotation information extraction means for acquiring a tilt and a yaw of a camera by extracting a horizontal line of a sea from an original image and focal length data provided by the camera, and acquiring a pan of the camera using the acquired yaw and long-distance background features of a vanishing point calculated from at least two first natural feature point tracking data existing in the original image;
and
a camera movement calculation means for calculating the camera movement from rotation angles obtained from the tilt, yaw, and pan of the camera and at least two second natural feature point tracking data existing on a sea plane of the original image,
wherein the camera rotation information extraction means extracts camera rotation from horizontal line information of a sea and at least two natural feature point tracking data existing on a plane parallel to a sea plane, by utilizing prior knowledge about a background geometry, on the assumption that the focal length of the camera is known, and
wherein the apparatus for extracting camera motion calculates tilt, yaw from horizontal line information, calculates pan from the prior calculated tilt, yaw and first natural feature point tracking data, and calculates camera translation from the prior calculated tilt, yaw and second natural feature point tracking data, where the aforementioned each camera movement parameter is calculated sequentially.

2 more elements

A system for supporting augmented reality in an ocean scene using an apparatus for extracting a camera motion, the system comprising:

a host computer configured to receive from a camera an original image, and focal length data;
a camera rotation information extraction means for extracting camera rotation information from horizontal line information of a sea extracted from the focal length data provided by a camera and an original image from the camera and at least two first natural feature point tracking data existing on a plane parallel to a sea plane, using long-distance background features;
a camera movement calculation means for calculating camera movement from the camera rotation information and at least two second natural feature point tracking data existing on the sea plane of the original image;
and
a means for placing a computer graphics object on a ground plane by importing camera position data, and performing a rendering according to the movement of the camera,
wherein the camera rotation information extraction means extracts camera rotation from horizontal line information of a sea and at least two natural feature point tracking data existing on a plane parallel to a sea plane, by utilizing prior knowledge about background geometry, on the assumption that the focal length of the camera is known,
wherein the apparatus for extracting a camera motion calculates tilt, yaw from horizontal line information, calculates pan from the prior calculated tilt, yaw and first natural feature point tracking data, and calculates camera translation from the prior calculated tilt, yaw and second natural feature point tracking data, where the aforementioned each camera movement parameter is calculated sequentially.

4 more elements

A method of supporting augmented reality in an ocean scene using an apparatus for extracting a camera motion, the method comprising:

(a) receiving focal length data and an original image from a camera;
(b) extracting camera rotation information from horizontal line information of a sea extracted from the original image and at least two first natural feature point tracking data existing on a sea plane and a plane parallel to the sea plane, using long-distance background features;
(c) calculating camera movement from the camera rotation information and at least two second natural feature point tracking data existing on the sea plane of the original image;
and
(d) placing a computer graphics object on a ground plane by importing camera position data, and performing a rendering according to the movement of the camera,
wherein the step (b) comprises:
extracting the horizontal line information from the input image;
calculating a normal vector n of the sea plane from position of the horizontal line and acquiring a tilt and a yaw of the camera therefrom;
and
calculating vanishing point on horizontal line using the tilt and the yaw of the camera and the externally inputted natural feature point tracking data and acquiring a pan of the camera from the vanishing point information and the acquired tilt and yaw,
wherein the horizontal line extracted at the step (b) is a vanishing line against the sea plane, and obtains the normal vector n of the sea plane with respect to the camera, and
wherein the tilt and the yaw of the camera is obtained from the normal vector component of the ground plane using the following Equation (3),
θ
x
⁡
(
tilt
)
=
arc
⁢
⁢
sin
(
-
n
z
n
y
2
+
n
z
2
)
(
3
)
θ
z
⁡
(
yaw
)
=
arc
⁢
⁢
sin
(
-
n
x
n
x
2
+
n
y
2
+
n
z
2
)
wherein nx, ny, and nz are each component of the normal vectors.

63 more elements

Dependencies are inferred from the claim text.

Apparatus for extracting camera motion, system and method for supporting augmented reality in ocean scene using the same

Life of this patent

Apparatus for extracting camera motion, system and method for supporting augmented reality in ocean scene using the same

Life of this patent

Abstract

Claims9