Caption modification and augmentation systems and methods for use by hearing assisted user

A method for facilitating communication between an assisted user (AU) using an AU communication device including a display and a hearing user (HU) using an HU communication device, each communication device including a speaker and a microphone and the AU communication device also including a display screen, the method comprising the steps of:

• receiving an HU voice signal as the AU and HU participate in a call using the AU and HU communication devices, respectively;
• transcribing HU voice signal segments into verbatim caption segments;
• presenting each verbatim voice signal segment via the AU communication device display for consumption;
• processing at least a subset of the verbatim caption segments to identify an intended communication (IC) wherein the IC is the communication intended by the HU upon uttering an associated one of the HU voice signal segments;
• for each of at least a subset of the HU voice signal segments, using an associated IC to generate an enhanced caption that is different than the associated verbatim caption;
• presenting at least a subset of the enhanced captions via the AU communication device display for consumption;
• and
• for each enhanced caption, calculating a confidence factor (CF) indicating likelihood the enhanced caption reflects an HU's intended communication.

A method for facilitating communication between an assisted user (AU) using an AU communication device including a display and a hearing user (HU) using an HU communication device, each communication device including a speaker and a microphone and the AU communication device also including a display screen, the method comprising the steps of:

• receiving an HU voice signal as the AU and HU participate in a call using the AU and HU communication devices, respectively;
• transcribing HU voice signal segments into verbatim caption segments;
• presenting each verbatim voice signal segment via the AU communication device display for consumption;
• for each verbatim caption segment:
• (i) processing the verbatim caption segment to identify an intended communication (IC) wherein the IC is the communication intended by the HU upon uttering an associated one of the HU voice signal segments;
• (ii) using the IC to generate an enhanced caption segment that is different than the associated verbatim caption segment;
• (iii) automatically selecting one of the verbatim caption segment and the enhanced caption segment;
• and
• (iv) presenting the selected one of the caption segments on the AU device display screen for consumption;
• and
• for each enhanced caption segment, calculating a confidence factor (CF) indicating likelihood the enhanced caption segment reflects an HU's intended communication.