System and method for mobile augmented reality

A method for realizing augmented reality using a visual sensor and a computing device in communication with the visual sensor, the method comprising:

• capturing images of an environment by the visual sensor;
• identifying, by the computing device, two-dimensional (2D) objects in the captured images;
• constructing, by the computing device, a three-dimensional (3D) map of the environment using the captured images;
• defining, by the computing device, 3D objects in the 3D map by mapping the 2D objects identified in the captured images to the corresponding feature points in the 3D map;
• measuring dimension and recognizing function and style of the 2D objects;
• projecting the 2D objects to the 3D map to define dimension, function and style of the 3D objects in the 3D map corresponding to the 2D objects;
• recommending a product that is not present in the environment based on the dimension, function and style of the 3D objects;
• and
• placing and rendering, by the computing device, a 3D model of the product to the 3D map based on the 3D objects defined in the 3D map,
• wherein the step of recommending a product comprises:
• determining a plurality of products based on a category of the environment;
• selecting a first subset of products from the plurality of products based on the style of the 3D objects;
• selecting a second subset of products from the first subset of products with a function complementary to the function of the 3D objects;
• and
• determining at least one product from the second subset of products that has a size fitting an empty space around the 3D objects.

A non-transitory computer readable medium storing computer executable code, wherein the computer executable code, when executed at a processor of a computing device, is configured to:

• receive images captured by a visual sensor;
• identify two-dimensional (2D) objects in the captured images;
• construct a three-dimensional (3D) map of the environment using the captured images;
• define 3D objects in the 3D map by mapping the 2D objects identified in the captured images to the corresponding feature points in the 3D map;
• measure dimension and recognize function and style of the 2D objects;
• project the 2D objects to the 3D map to define dimension, function and style of the 3D objects in the 3D map corresponding to the 2D objects;
• recommend a product that is not present in the environment based on the dimension, function and style of the 3D objects;
• and
• place and render a 3D model of the product to the 3D map based on the 3D objects defined in the 3D map,
• wherein the computer executable code is further configured to recommend a product by:
• determining a plurality of products based on a category of the environment;
• selecting a first subset of products from the plurality of products based on the style of the 3D objects;
• selecting a second subset of products from the first subset of products with a function complementary to the function of the 3D objects;
• and
• determining at least one product from the second subset of products that has a size fitting an empty space around the 3D objects.