Multi-Modal Automation for Human Interactive Skill Assessment

A method for screening applicants by a screening entity, which comprises:

• remotely accessing a screening entity's multi-modal pre-screening tool by a candidate using an Internet-accessible device, the pre-screening tool comprising audio and visual elements operable to communicatively interact with the candidate;
• and
• carrying out an interactive skills assessment of the candidate with the pre-screening tool by:
• communicating an instruction to the candidate from the screening entity;
• requiring the candidate, upon receiving the instruction, to perform a pre-defined speech task by simultaneously:
• viewing at least one of textual and pictorial content displayed to the candidate using the visual element of the pre-screening tool;
• and
• communicating, with the audio element of the pre-screening tool, a verbal response from the candidate to the screening entity based upon the displayed content;
• recording the candidate's verbal response with the pre-screening tool and storing the verbal response in a database profile associated with the candidate and accessible by the screening entity;
• and
• analyzing the candidate's recorded response by the screening entity and carrying out a quality and criteria judgment to determine the hiring potential of the candidate.