Image data processing method, device and security inspection system based on VR or AR

An image data processing device for security inspection, comprising:

• a communication interface, configured to receive three-dimensional (3D) scanned data of a containing apparatus in which objects are contained;
• and
• a processor, configured to reconstruct, based on the received 3D scanned data, a 3D image of the containing apparatus and the objects contained in the containing apparatus for display in a virtual space,
• wherein the communication interface is further configured to receive positioning information and action information of a user to be mapped to the virtual space, wherein the positioning information of the user is provided by positioning a location of the user,
• wherein the processor is further configured to determine structural and material properties of at least one object, based on the 3D scanned data, determine manipulation information for the at least one object in the containing apparatus based on the received positioning information and action information to be mapped to the virtual space, determine feedback information for the user based at least in part on the manipulation information and/or at least one of the structural and material properties of the at least one object, provide the determined feedback information to a force/tactile feedback device worn by the user via the communication interface, and reconstruct at least a 3D image of the at least one object based on the determined manipulation information,
• wherein the communication interface is further configured to transmit the determined structural and material properties to a display to be displayed around the at least one object,
• wherein determining the feedback information for the user based at least in part on the manipulation information comprises determining, according to the manipulation information, and a volume and a density value of the at least one object, a direction and an amount of a reaction force applied by the at least one object on the user, and
• wherein providing the determined feedback information to the force/tactile feedback device worn by the user via the communication interface comprises applying, according to the determined direction and amount of the reaction force, the reaction force to the user via the force/tactile feedback device worn by the user and the communication interface.

A security inspection system, comprising:

• a three-dimensional (3D) scanning device, configured to 3D scan a containing apparatus in which objects are contained to generate 3D scanned data;
• a location tracking device, configured to position a location of a user for providing positioning information of the user;
• a motion tracking device, configured to determine a motion of the user for providing action information of the user;
• an image data processing device comprising:
• a communication interface, configured to receive three-dimensional (3D) scanned data of the containing apparatus in which objects are contained;
• and
• a processor, configured to reconstruct, based on the received 3D scanned data, a 3D image of the containing apparatus and the objects contained in the containing apparatus for display in a virtual space,
• wherein the communication interface is further configured to receive positioning information and action information of a user to be mapped to the virtual space,
• wherein the processor is further configured to determine structural and material properties of at least one object, based on the 3D scanned data, determine manipulation information for the at least one object in the containing apparatus based on the received positioning information and action information to be mapped to the virtual space, determine feedback information for the user based at least in part on the manipulation information and/or at least one of structural and material properties of the at least one object, and reconstruct at least a 3D image of the at least one object based on the determined manipulation information,
• wherein the communication interface is further configured to transmit the determined structural and material properties to a stereoscopic display to be displayed around the at least one object, and
• wherein determining the feedback information based at least in part on the manipulation information comprises determining, according to the manipulation information, and a volume and a density value of the at least one object, a direction and an amount of a reaction force applied by the at least one object on the user;
• a wearable force/tactile feedback device, configured to provide a force/tactile feedback to the user, wherein providing the force/tactile feedback to the user comprises applying, according to the determined direction and amount of the reaction force, the reaction force to the user via the force/tactile feedback device worn by the user and the communication interface;
• and
• the stereoscopic display, configured to display a reconstructed 3D image.