Human-machine interaction collection method, apparatus, and system for wearable extended reality device

A human-machine interaction collection apparatus for a wearable extended reality device, the human-machine interaction collection apparatus comprising:

• an extended reality device configured to collect a virtual reality base signal;
• a human body parameter perception device configured to perceive and collect human body perception data, the human body perception data comprising at least one of eye movement data, a physiological state parameter, and electroencephalographic data;
• an environmental parameter perception device configured to collect environmental perception data;
• a data processing module configured to convert the virtual reality base signal into an extended reality scene corresponding to a real scene, convert the collected human body perception data into human body state information of an individual, and convert the collected environmental perception data into a three-dimensional environment scene of a position of the individual;
• a display module configured to display the extended reality scene, the human body state information, and the three-dimensional environment scene that are obtained from the data processing module;
• and
• a data transmission module configured to upload the human body state information of the individual and the three-dimensional environment scene of the position of the individual to a cloud server.

A human-machine interaction collection system for a wearable extended reality device, the human-machine interaction collection system comprising:

• a processor;
• and
• a memory having computer instructions stored thereon, wherein the processor is configured to execute the computer instructions stored in the memory, the processor, when executing the computer instructions, implementing a human-machine interaction collection method for the wearable extended reality device, the method comprising:
• obtaining data synchronously collected, the data comprising a virtual reality base signal collected by the extended reality device, human body perception data collected by a human body parameter perception device, and environmental perception data collected by an environmental parameter perception device, and the human body perception data comprising at least one of eye movement data, a physiological state parameter, and electroencephalographic data;
• providing an extended reality scene based on the virtual reality base signal collected by the extended reality device, obtaining human body state information of an individual based on the human body perception data collected by the human body parameter perception device, performing three-dimensional modeling based on the environmental perception data collected by the environmental parameter perception device, and obtaining a three-dimensional environment scene of a position of the individual;
• displaying the extended reality scene, the human body state information, and the three-dimensional environment scene on a display unit of the extended reality device;
• and
• uploading the human body state information of the individual and the three-dimensional environment scene to a cloud server.