Expert Crowdsourcing for Health Assessment Learning from Speech in the Digital Healthcare Era

A computer system for objective health assessment, the computer system comprising:

• a communication fabric;
• a storage device connected to the communication fabric, wherein the storage device stores program instructions;
• and
• a processor connected to the communication fabric, wherein the processor executes the program instructions to:
• receive an utterance of a patient in response to a question being presented to the patient;
• generate a transcription of the utterance of the patient responding to the question;
• generate a set of sentence embeddings from the transcription of the utterance made by the patient;
• retrieve a plurality of sentence embeddings corresponding to characteristics of a health condition;
• measure similarity between the set of sentence embeddings generated from the transcription of the utterance made by the patient and the plurality of sentence embeddings corresponding to the characteristics of the health condition;
• and
• send a result of a health assessment of the patient to a healthcare professional based on the similarity between the set of sentence embeddings generated from the transcription of the utterance made by the patient and the plurality of sentence embeddings corresponding to the characteristics of the health condition.

A computer program product for objective health assessment, the computer program product comprising a computer-readable storage medium having program instructions embodied therewith, the program instructions executable by a computer to cause the computer to:

• receive an utterance of a patient in response to a question being presented to the patient;
• generate a transcription of the utterance of the patient responding to the question;
• generate a set of sentence embeddings from the transcription of the utterance made by the patient;
• retrieve a plurality of sentence embeddings corresponding to characteristics of a health condition;
• measure similarity between the set of sentence embeddings generated from the transcription of the utterance made by the patient and the plurality of sentence embeddings corresponding to the characteristics of the health condition;
• and
• send a result of a health assessment of the patient to a healthcare professional based on the similarity between the set of sentence embeddings generated from the transcription of the utterance made by the patient and the plurality of sentence embeddings corresponding to the characteristics of the health condition.