Methods and systems for determining user interaction based data in a virtual environment transmitted by three dimensional assets

A non-transitory computer readable medium comprising instructions which when executed by at least one processing system comprising at least one hardware processing core, executes a method for determining and recording data related to user interaction in a virtual three dimensional (3D) environment, comprising:

• receiving data related to user interaction with a 3D digital asset in the virtual 3D environment, wherein the data related to user interaction with the 3D digital asset is received from a client computer, the client computer:
• displaying the 3D digital asset in the virtual 3D environment via a graphical user interface,
• determining whether the 3D digital asset is drawn on a culling mask of a camera in the virtual 3D environment, wherein the 3D digital asset comprises a collidable mesh,
• using ray casting, draw a line between the camera and the 3D digital asset,
• determining that the line collides with the collidable mesh of the 3D digital asset,
• using a screen bounding function of a 3D engine, determining a proportion of the 3D digital asset covering the graphical user interface when it is determined that the line collides with the collidable mesh,
• based on the proportion, obtaining a percentage of the graphical user interface that is covered by the 3D digital asset, and
• based on the percentage, generating the data related to user interaction with the 3D digital asset in the virtual 3D environment, wherein the client computer transmits the data related to user interaction to the at least one processing system;
• and
• generating metrics related to user interaction, including tapping, touching, moving, time spent, viewing, requesting detailed description related to the 3D digital asset in the virtual 3D environment.

A method for determining and recording data related to user interaction in a virtual three dimensional (3D) environment, comprising:

• receiving, by a computing device, data related to user interaction with a 3D digital asset in the virtual 3D environment, wherein the data related to user interaction with the 3D digital asset is received from a client computer, the client computer:
• displaying the 3D digital asset in the virtual 3D environment via a graphical user interface,
• determining whether the 3D digital asset is drawn on a culling mask of a camera in the virtual 3D environment, wherein the 3D digital asset comprises a collidable mesh,
• using ray casting, drawing a line between the camera and the 3D digital asset,
• determining that the line collides with the collidable mesh of the 3D digital asset,
• using a screen bounding function of a 3D engine, determining a proportion of the 3D digital asset covering the graphical user interface when it is determined that the line collides with the collidable mesh,
• based on the proportion, obtaining a percentage of the graphical user interface that is covered by the 3D digital asset, and
• based on the percentage, generating the data related to user interaction with the 3D digital asset in the virtual 3D environment, wherein the client computer transmits the data related to user interaction to the computing device;
• and
• generating, by the computing device, metrics related to user interaction, including tapping, touching, moving, time spent, viewing, requesting detailed description related to the 3D digital asset in the virtual 3D environment.