US 2019/0164346 A1 · METHOD AND APPARATUS FOR PROVIDING REALISTIC 2D/3D AR EXPERIENCE SERVICE BASED ON VIDEO IMAGE

Abstract

The present invention relates to a method and apparatus for providing a realistic 2D/3D AR experience service based on a video. Particularly, the present invention provides a method of providing a realistic AR service with high quality based on AR by using a 2D video image and 3D information in association thereto at the same time, filming a cybernaut and AR content by using two sensors having viewpoints different from each other, and arranging 2D/3D content being an object to be matched within the AR content and which has a 3D position different to a position of the cybernaut in association with a dynamic 3D position of the cybernaut and with a dynamic viewpoint of a service sensor.

Claims19

Dependent claims

A method of providing an augmented reality (AR) service, the method comprising:

obtaining 3D information and 2D video image information of a first object;
obtaining 2D video image information and 3D interaction information of AR content based on the first object;
combining the 2D video image information of the first object with the 2D video image information of the AR content;
and
displaying the combined 2D video image information,
wherein a 3D space information of the first object is determined based on the 3D information and the 2D video image information of the first object,
wherein a 3D space information of the AR content is adjusted based on the determined 3D position of the first object, and
wherein the 2D video image information of the AR content is combined with the 2D video image information of the first object based on the adjusted 3D space information of the AR content.

5 more elements

An apparatus for providing an AR service, the apparatus comprising:

a live RGBD processing unit;
an AR content processing unit;
a 3D interaction processing unit;
and
an AR rendering processing unit, wherein
3D information and 2D video image information of a first object is obtained by the live RGBD processing unit, wherein a 3D space information of the first object is determined based on the 3D information and the 2D video image information of the first object,
2D video image information and 3D interaction information of AR content is obtained by the AR content processing unit, wherein a 3D space information of the AR content is adjusted based on the determined 3D space information of the first object, and
the 2D video image information of the first object and the 2D video image information of the AR content are combined by the AR rendering processing unit,
wherein the 2D video image information of the AR content is combined with the 2D video image information of the first object based on the adjusted 3D space information of the AR content.

6 more elements

Dependencies are inferred from the claim text.

Method and apparatus for providing realistic 2d/3d ar experience service based on video image

Life of this patent

Method and apparatus for providing realistic 2d/3d ar experience service based on video image

Life of this patent

Abstract

Claims19