System and method for extracting and displaying speaker information in an ATC transcription

A method in a flight deck system for extracting speaker information in an ATC (Air Traffic Controller) conversation and displaying the speaker information on a graphical display unit, the method comprising:

• segmenting a stream of audio received over radio from an ATC and other aircraft into a plurality of chunks, wherein each chunk has a speaker;
• extracting vocal cord and prosody based features from a chunk;
• generating a plurality of similarity scores for the extracted vocal cord and prosody based features for the chunk, wherein each similarity score of the plurality of similarity scores is based on a comparison of the extracted vocal cord and prosody based features for the chunk with a different model file from a plurality of model files in an enrolled speaker database for a plurality of speakers from the enrolled speaker database, wherein the plurality of model files are associated with different speakers from the enrolled speaker database;
• when a specific similarity score from the plurality of similarity scores determined based on the comparison of the extracted vocal cord and prosody based features with the plurality of model files in the enrolled speaker database for the plurality of speakers exceeds a threshold level, associate the chunk with a particular speaker from the enrolled speaker database, decoding the chunk using a speaker-dependent automatic speech recognition (ASR) model that is specific for the speaker and tagging the chunk with a permanent name for the speaker;
• when a specific similarity score from the plurality of similarity scores determined based on the comparison of the extracted vocal cord and prosody based features with the plurality of model files in the enrolled speaker database for the plurality of speakers does not exceed a threshold level, assigning a temporary name for the speaker of the chunk, tagging the chunk with the temporary name, and decoding the chunk using a speaker independent speech recognition model;
• formatting the decoded chunk as text;
• signaling the graphical display unit to display the formatted text along with an identity for the speaker of the formatted text, the identity comprising the permanent name of the speaker or the temporary name assigned to the speaker;
• and
• enrolling a non-enrolled speaker into the speaker database and creating a speaker-dependent ASR model for the non-enrolled speaker after a predetermined number of chunks of audio from the non-enrolled speaker are received.

A non-transitory computer-readable medium having stored thereon instructions which when executed by one or more processors in a flight deck system causes the flight deck system to perform a method for extracting speaker information in an ATC (Air Traffic Controller) conversation and displaying the speaker information on a graphical display unit, the method comprising:

• segmenting a stream of audio received over radio from an ATC and other aircraft into a plurality of chunks, wherein each chunk has a speaker;
• extracting vocal cord and prosody based features from a chunk;
• generating a plurality of similarity scores for the extracted vocal cord and prosody based features for the chunk, wherein each similarity score of the plurality of similarity scores is based on a comparison of the extracted vocal cord and prosody based features for the chunk with a different model file from a plurality of model files in an enrolled speaker database for a plurality of speakers from the enrolled speaker database, wherein the plurality of model files are associated with different speakers from the enrolled speaker database;
• when a specific similarity score from the plurality of similarity scores determined based on the comparison of the extracted vocal cord and prosody based features with the plurality of model files in the enrolled speaker database for the plurality of speakers exceeds a threshold level, associate the chunk with a particular speaker from the enrolled speaker database, decoding the chunk using a speaker-dependent automatic speech recognition (ASR) model that is specific for the speaker and tagging the chunk with a permanent name for the speaker;
• when a specific similarity score from the plurality of similarity scores determined based on the comparison of the extracted vocal cord and prosody based features with the plurality of model files in the enrolled speaker database for the plurality of speakers does not exceed a threshold level, assigning a temporary name for the speaker of the chunk, tagging the chunk with the temporary name, and decoding the chunk using a speaker independent speech recognition model;
• formatting the decoded chunk as text;
• signaling the graphical display unit to display the formatted text along with an identity for the speaker of the formatted text, the identity comprising the permanent name of the speaker or the temporary name assigned to the speaker;
• and
• enrolling a non-enrolled speaker into the speaker database and creating a speaker-dependent ASR model for the non-enrolled speaker after a predetermined number of chunks of audio from the non-enrolled speaker are received.