Head mounted display system capable of assigning at least one predetermined interactive characteristic to a virtual object in a virtual environment created according to a real object in a real environment, a related method and a related non-transitory computer readable storage medium

A method of utilizing a head mounted display system to create a virtual object in a virtual environment corresponding to a real object in a real environment, the method comprising:

• utilizing a scanning unit of the head mounted display system to scan the real object in the real environment so as to generate a scanning result;
• and
• utilizing a processing unit of the head mounted display system to identify the real object according to the scanning result of the scanning unit, determine a first predetermined interactive characteristic and a second predetermined interactive characteristic according to an identification result of the processing unit, create the virtual object in the virtual environment simulating the real object in the real environment according to the scanning result of the scanning unit, and assign the first predetermined interactive characteristic and the second predetermined interactive characteristic to the virtual object in the virtual environment, wherein the first predetermined interactive characteristic comprises a first predetermined manipulating point, a first predetermined manipulating hand gesture and a first predetermined manipulating movement, and the second predetermined interactive characteristic comprises a second predetermined manipulating point, a second predetermined manipulating hand gesture and a second predetermined manipulating movement, the virtual object manipulated in a first predetermined manipulating manner when a manipulating point, a manipulating hand gesture and a manipulating movement of a user respectively correspond the first predetermined manipulating point, the first predetermined manipulating hand gesture and the first predetermined manipulating movement, the virtual object is not manipulated in the first predetermined manipulating manner when at least one of the manipulating point, the manipulating hand gesture and the manipulating movement of the user does not correspond to at least one of the first predetermined manipulating point, the first predetermined manipulating hand gesture and the first predetermined manipulating movement, the virtual object is manipulated in a second manipulating manner when the manipulating point, the manipulating hand gesture and the manipulating movement of the user respectively correspond the second predetermined manipulating point, the second predetermined manipulating hand gesture and the second predetermined manipulating movement, and the virtual object is not manipulated in the second predetermined manipulating manner when at least one of the manipulating point, the manipulating hand gesture and the manipulating movement of the user does not correspond to at least one of the second predetermined manipulating point, the second predetermined manipulating hand gesture and the second predetermined manipulating movement, and the second predetermined manipulating point, the second manipulating hand gesture and the second manipulating movement are different from the first predetermined manipulating point, the first manipulating hand gesture and the first manipulating movement.

A non-transitory computer readable storage medium storing a program that causes a head mounted display system to execute a process, the process comprising:

• utilizing a scanning unit of the head mounted display system to scan a real object in a real environment so as to generate a scanning result;
• and
• utilizing a processing unit of the head mounted display system to identify the real object according to the scanning result of the scanning unit, determine a first predetermined interactive characteristic and a second predetermined interactive characteristic according to an identification result of the processing unit, create the virtual object in the virtual environment simulating the real object in the real environment according to the scanning result of the scanning unit, and assign the first predetermined interactive characteristic and the second predetermined interactive characteristic to the virtual object in the virtual environment, wherein the first predetermined interactive characteristic comprises a first predetermined manipulating point, a first predetermined manipulating hand gesture and a first predetermined manipulating movement, and the second predetermined interactive characteristic comprises a second predetermined manipulating point, a second predetermined manipulating hand gesture and a second predetermined manipulating movement, the virtual object is manipulated in a first predetermined manipulating manner when a manipulating point, a manipulating hand gesture and a manipulating movement of a user respectively correspond the first predetermined manipulating point, the first predetermined manipulating hand gesture and the first predetermined manipulating movement, the virtual object is not manipulated in the first predetermined manipulating manner when at least one of the manipulating point, the manipulating hand gesture and the manipulating movement of the user does not correspond to at least one of the first predetermined manipulating point, the first predetermined manipulating hand gesture and the first predetermined manipulating movement, the virtual object is manipulated in a second manipulating manner when the manipulating point, the manipulating hand gesture and the manipulating movement of the user respectively correspond the second predetermined manipulating point, the second predetermined manipulating hand gesture and the second predetermined manipulating movement, and the virtual object is not manipulated in the second predetermined manipulating manner when at least one of the manipulating point, the manipulating hand gesture and the manipulating movement of the user does not correspond to at least one of the second predetermined manipulating point, the second predetermined manipulating hand gesture and the second predetermined manipulating movement, and the second predetermined manipulating point, the second manipulating hand gesture and the second manipulating movement are different from the first predetermined manipulating point, the first manipulating hand gesture and the first manipulating movement.