Multimodal phone call application for users with language barriers and/or hearing impairment

Abstract

The present invention discloses a novel communication application for facilitating telephonic conversation for deaf or hearing-impaired individuals. The application leverages advanced Text-to-Speech (TTS) and Speech-to-Text (STT) conversion algorithms to allow seamless bidirectional communication across diverse platforms, including landlines. When a hearing-impaired user types text into the application, the innovative TTS technology converts the text into natural-sounding speech that is delivered to the other end of the phone call. Concurrently, speech from the non-hearing-impaired party is captured and transformed into textual content by the advanced STT technology. The text is then displayed in real-time on the user's device screen. The disclosed application ensure that the user can engage in phone conversations just like any other user. Moreover, it prioritizes real-time, accurate conversions, language translation, and maintains the natural flow of a conversation on any telecommunication platform, offering an inclusive solution to the communication challenges faced by the hearing-impaired population.

Dependencies are inferred from the claim text.