Team sports vision training system based on extended reality, voice interaction and action recognition, and method thereof

A team sports vision training method based on extended reality, voice interaction and action recognition, which is configured to train vision and an action of a user, and the team sports vision training method based on extended reality, voice interaction and action recognition comprising:

• performing a virtual task scenario showing step, wherein the virtual task scenario showing step comprises disposing a head-mounted display device on the user, configuring a task scenario generating module of a computing server to generate a virtual task scenario image and a task parameter group according to a scenario setting parameter group and transmit the virtual task scenario image to the head-mounted display device, and then configuring a task scenario player of the head-mounted display device to show the virtual task scenario image for the user to watch and then generate a speech signal and the action;
• performing a speech recognizing step, wherein the speech recognizing step comprises configuring a speech sensing module of the head-mounted display device to sense a speech signal of the user to generate a speech message, and then configuring a speech recognition module of the computing server to receive the speech message and recognize the speech message according to a speech recognition procedure to generate a speech recognition result, and judge the task parameter group of the task scenario generating module and the speech recognition result to generate a vision training result;
• and
• performing an action recognizing step, wherein the action recognizing step comprises configuring an action capture device to capture the action of the user to generate an action message, and then configuring an action recognition module of the computing server to receive the action message and recognize the action message according to an action recognition procedure to generate an action recognition result, and judge the scenario setting parameter group and the action recognition result to generate a sport training result;
• wherein the vision training result and the sport training result are configured to judge whether the user meets a training requirement;
• wherein the head-mounted display device further comprises a gesture sensing module, the gesture sensing module is configured to sense a gesture of the user to generate a gesture sensing result, and the scenario setting parameter group comprises:
• a task execution parameter comprising a number add item and a color change item, wherein one of the number add item and the color change item is selected according to the gesture sensing result;
• wherein the virtual task scenario image comprises a plurality of virtual objects and a plurality of numbers;
• and in response to determining that the number add item is selected according to the gesture sensing result, the numbers are displayed around the virtual objects, respectively, for the user to watch and then generate the speech signal, the speech recognition module judges whether the speech recognition result corresponding to the speech signal is the same as a number add value of the number add item of the scenario setting parameter group to generate the vision training result, and the number add value is equal to a sum of the numbers.