System and method for augmentating video data

A communication apparatus comprising:

• a computer device having a processor connected to a non-transitory memory;
• and
• the computer device having a medical term parser, a body part identifier, a pose analyzer, and a video annotator;
• and
• wherein:
• the medical term parser configures the computer device to analyze medical records stored in non-transitory memory of an electronic health record (EHR) device to identify at least one patient condition of a patient during a communication session involving a patient device of the patient, the at least one patient condition comprising diseases, injuries, medical codes or medical findings for the patient;
• the body part identifier configures the computer device to associate the at least one patient condition identified based on the analyzing of the medical records with at least one body part of the patient;
• the pose analyzer configures the computer device to generate medical record indicia for each of the at least one patient condition identified from the analyzing of the medical records, each generated medical record indicia associated with a respective one of the at least one patient condition identified from the analyzing of the medical records and a medical record having the at least one patient condition identified from the analyzing of the medical records and the at least one body part of the patient associated with the at least one patient condition;
• and
• the video annotator configures the computer device to augment video data received from the patient device of the patient to overlay at least one medical record indicia on a body part of the patient included in the video data so that a graphical user interface is displayable to show video of the video data with the generated medical record indicia shown over a portion of the body part of the patient associated with the at least one patient condition of the medical record associated with the medical record indicia during the communication session;
• and
• wherein the pose analyzer configures the computer device to analyze the body part of the patient included in the video data based on a prominence of the body part for the augmentation of the video data to overlay at least one medical record indicia on the body part, the medical record indicia including a plurality of medical record indicia that have at least two of:
• different coloration, different shading pattern, different sizes, and different shapes to indicate an estimated relevancy of the medical record indicia to a topic being discussed in the communication session.

A non-transitory computer readable medium having an application stored thereon that defines a method performed by a computer device that runs the application, the method comprising:

• analyzing medical records to identify at least one patient condition of the patient during a communication session, the at least one patient condition comprising diseases, injuries, medical codes or medical findings for the patient;
• associating the at least one patient condition identified based on the analyzing of the medical records with at least one body part of the patient;
• generating medical record indicia for each of the at least one patient condition identified from the analyzing of the medical records, each generated medical record indicia associated with a respective one of the at least one patient condition identified from the analyzing of the medical records and a medical record having the at least one patient condition identified from the analyzing of the medical records and the at least one body part of the patient associated with the at least one patient condition;
• augmenting video data received from a patient device to overlay at least one medical record indicia on a body part of the patient included in the video data so that a graphical user interface is displayable to show video of the video data with the generated medical record indicia shown over a portion of the body part of the patient associated with the at least one patient condition of the medical record associated with the medical record indicia during the communication session;
• selecting a pose analyzer to analyze the body part of the patient included in the video data based on a prominence of the body part for performing the augmenting of the video data to overlay at least one medical record indicia on the body part, the medical record indicia including a plurality of medical record indicia that have at least two of:
• different coloration, different shading pattern, different sizes, and different shapes to indicate an estimated relevancy of the medical record indicia to a topic being discussed in the communication session.