Hand-eye collaborative auditory cognitive assessment system

A hand-eye collaborative auditory cognitive assessment system, comprising:

• a speech recognition device configured to provide speech information to a participant, obtain a retold statement made by the participant based on the speech information, and obtain a speech retelling result;
• a hand-eye recognition device configured to provide visual information to the participant;
• obtain information of a hand movement executed by the participant based on the visual information, wherein the information of the hand movement comprises a single hand movement score and a comprehensive hand movement score, the single hand movement score is obtained when the hand-eye recognition device operates alone, and the comprehensive hand movement score is obtained when the speech recognition device and the hand-eye recognition device operate together;
• and process the single hand movement score and the comprehensive hand movement score to obtain a cognitive scoring result;
• the hand-eye recognition device comprises:
• an image display module configured to display a moving region that the participant requires to follow with a hand;
• a hand information obtaining module configured to obtain precise touch time of the moving region when the image display module is touched;
• a timekeeping module configured to record total touch time of the image display module;
• a calculation module configured to calculate the single hand movement score or the comprehensive hand movement score based on the precise touch time and the total touch time;
• and
• a hand-eye control processing module configured to control startup and stop of the image display module, the hand information obtaining module, and the timekeeping module, and process the single hand movement score and the comprehensive hand movement score to obtain the cognitive scoring result;
• the image display module is configured to display a moving region that moves along an elliptical path;
• when the hand-eye recognition device provides the visual information to the participant separately, the hand-eye control processing module calculates the single hand movement score based on the precise touch time and the total touch time;
• when the hand-eye recognition device provides the visual information to the participant and the speech recognition device provides the speech information to the participant, the hand-eye control processing module calculates the comprehensive hand movement score based on the precise touch time and the total touch time;
• the hand-eye recognition device further comprises:
• a touch adjustment module configured to set whether the moving region of the image display module moves at a uniform speed;
• and when the moving region moves at the uniform speed, adjust a movement speed of the moving region along the elliptical path;
• or when the moving region moves at a variable speed, adjust a plurality of movement speeds of the moving region along the elliptical path, and adjust duration of a corresponding speed of the moving region;
• and
• an assessment processing device configured to perform cognitive assessment on the participant based on the speech retelling result and the cognitive scoring result.