Systems and methods for finer-grained medical entity extraction

A method for creating a system to extract medical from an input statement, the method comprising:

• receiving a medical entity dictionary comprising a set of medical-related terms or phrases and medical forum data;
• forming a set of samples for a training dataset using at least some of the medical forum data and at least some of the medical entity dictionary that comprises, for each sample, a medical statement from the medical forum data and corresponding medical entities in the medical statement;
• using at least some of samples in the training dataset to train a parsing model to identify medical entities in an input statement;
• and
• using at least some of terms and phrases in the medical entity dictionary to form a rule-based model to identify medical entities in an input statement.

A system for medical entity recognition comprising:

• one or more processors;
• a medical entity dictionary, communicatively accessible by at least one of the one or more processors, the medical entity dictionary comprising a set of medical-related terms or phrases;
• a non-transitory computer-readable medium or media comprising one or more sequences of instructions which, when executed by at least one processor of the one or more processors, causes the steps to be performed:
• segmenting an input statement into one or more temporal segments based upon one or more temporal cues in the input statement;
• and
• for a temporal segment from the one or more temporal segments:
• parsing the temporal segment using a rule-based model and the medical entity dictionary to obtain a first set of parsed medical entities;
• parsing the temporal segment using a parsing model that receives as an input the temporal segment and outputs a second set of parsed medical entities in the temporal segment;
• and
• output a final set of parsed medical entities based on the first set of parsed medical entities and the second set of parsed medical entities.