Methods and systems for three-dimensional rendering of a virtual augmented replica of a product image merged with a model image of a human-body feature
AssigneeAR (ES) Technologies Ltd.
InventorsAlex Eikelis, Rami Shtainer, Darya Frolova, Alex Sadikov, Dmitry Pundik
Life of this patent
Estimating the term…
Abstract
A system for rendering a merged virtual 3D augmented replica of a 3D product image and a 3D model image of a body part. A 3D modeling engine transforms an acquired 2D image of a body part into a 3D augmented replica thereof. A GUI enables the merging, displaying and manipulating of the 3D product image and the 3D augmented replica of a body part.
Claims39
A system for rendering a virtual 3D augmented replica, the system comprising:
- a. a 2D model manager adapted to store an acquired 2D model image of a body part;
- b. a 3D modeling engine adapted to transform said 2D model image of said body part into the virtual 3D augmented replica thereof, said 3D modeling engine configured to model at least one diffuse-reflectance parameter of at least one image pixel of said 2D model image, wherein said at least one diffuse-reflectance parameter is correlated to a representative depth value of said at least one image pixel, and wherein said representative depth value is selected from at least one smooth region of said 2D model image and applied for albedo environmental-color diffuse-reflection removal to at least one distorted region of said 2D model image, in order to generate the virtual 3D augmented replica thereof.
A method for rendering a virtual 3D augmented replica, the method comprising the steps of:
- a. receiving a 2D image of a body part;
- b. providing a parameterized anatomical model of said body part;
- c. constructing a virtual 3D replica that corresponds to said 2D image of the body part by modeling at least one diffuse-reflectance parameter of at least one image pixel of said 2D image, wherein said at least one diffuse-reflectance parameter is correlated to a representative depth value of said at least one image pixel, and wherein said representative depth value is selected from at least one smooth region of said 2D model image and applied for albedo environmental-color diffuse-reflection removal to at least one distorted region of said 2D model image, in order to generate said virtual 3D replica;
- d. adjusting values of parameters of said parameterized anatomical model to conform said parameterized anatomical model to said virtual 3D replica, thereby providing the virtual 3D augmented replica of said body part;
- and
- e. outputting the 3D virtual augmented replica to a medium.
A system for rendering a virtual 3D augmented replica, the system comprising:
- a. a 2D model manager adapted to store an acquired 2D model image of a body part;
- b. a parameterized anatomical model of said body part;
- c. a virtual 3D replica generator adapted to construct a virtual 3D replica that corresponds to said acquired 2D model image, said virtual 3D replica generator configured to model at least one diffuse-reflectance parameter of at least one image pixel of said 2D image, wherein said at least one diffuse-reflectance parameter is correlated to a representative depth value of said at least one image pixel, and wherein said representative depth value is selected from at least one smooth region of said 2D model image and applied for albedo environmental-color diffuse-reflection removal to at least one distorted region of said 2D model image, in order to generate said virtual 3D replica;
- d. a 3D modeling engine configured to adjust the values of the parameters of said parameterized anatomical model to conform said parameterized anatomical model to said virtual 3D replica, thereby providing the virtual 3D augmented replica of said body part;
- and
- e. a medium adapted to output the virtual 3D augmented replica.
A system for rendering a merged virtual 3D augmented replica, the system comprising:
- a. a 2D/3D product database of product 2D images and product 3D images;
- b. a 2D model manager adapted to store an acquired 2D model image of a body part;
- c. a 3D modeling engine adapted to transform said 2D model image of said body part into a virtual 3D augmented replica thereof;
- and
- d. a graphic user interface adapted to merge a selected product 3D image from said product database with said virtual 3D augmented replica to provide the merged virtual 3D augmented replica, said graphic user interface is operable to display and manipulate the merged virtual 3D augmented replica, said graphic user interface adapted to utilize at least one product lighting attribute, said at least one product lighting attribute selected from the group consisting of:
- respective discrete light-source information, reflectance information, and ambient-light information, in said selected product 3D image, in order to augment at least one replica lighting attribute of said virtual 3D augmented replica in the merged virtual 3D augmented replica, and wherein:
- i. upon a given measurement of said selected product 3D image in the merged virtual 3D augmented replica not corresponding to a reciprocal measurement of said virtual 3D augmented replica, applying at least one reciprocal pressure point on said virtual 3D augmented replica in the merged virtual 3D augmented replica, wherein said at least one reciprocal pressure point is based on real-world physics.
A method for rendering a merged virtual 3D augmented replica, the method comprising the steps of:
- a. providing a 2D/3D product database of product 2D images and product 3D images;
- b. storing an acquired 2D model image of a body part;
- c. transforming said 2D model image of said body part into a virtual 3D augmented replica thereof;
- and
- d. merging a selected product 3D image from said product database with said virtual 3D augmented replica to provide the merged virtual 3D augmented replica, said step of merging utilizing at least one product lighting attribute, said at least one product lighting attribute selected from the group consisting of:
- respective discrete light-source information, reflectance information, and ambient-light information, in said selected product 3D image, in order to augment at least one replica lighting attribute of said virtual 3D augmented replica in the merged virtual 3D augmented replica, and wherein:
- i. upon a given measurement of said selected product 3D image in the merged virtual 3D augmented replica not corresponding to a reciprocal measurement of said virtual 3D augmented replica, applying at least one reciprocal pressure point on said virtual 3D augmented replica in the merged virtual 3D augmented replica, wherein said at least one reciprocal pressure point is based on real-world physics.
Dependencies are inferred from the claim text.