# US 11,445,056 B1 · Telephone system for the hearing impaired > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 11,445,056 B1 - Document ID: US11445056B1 - Status: Granted - Kind: B1 - Application number: 16/988,642 - Filed: 2020-08-08 - Granted: 2022-09-13 - Earliest claimed: 2020-03-07 - Assignees: Eugenious Enterprises, LLC - Applicants: Eugenious Enterprises, LLC - Inventors: Daniel Yusef Abdelsamed; Michael J. Medley; Matthew G. Good - Web page: https://patentgrep.com/patent/US11445056B1 ## CPC - G09B 21/009: {Teaching or communicating with deaf persons (G09B21/04 takes precedence)} - H04M 1/2475: {for a hearing impaired user} - G10L 15/22: Procedures used during a speech recognition process, e.g. man-machine dialogue - G10L 15/26: Speech to text systems (G10L15/08 takes precedence) - G10L 15/30: Distributed recognition, e.g. in client-server systems, for mobile phones or network applications - G10L 21/10: Transforming into visible information - H04L 67/10: in which an application is distributed across nodes in the network (software deployment G06F8/60; multiprogramming arrangements G06F9/46) - H04M 3/42391: {where the subscribers are hearing-impaired persons, e.g. telephone devices for the deaf} - H04M 7/006: {Networks other than PSTN/ISDN providing telephone service, e.g. Voice over Internet Protocol (VoIP) , including next generation networks with a packet-switched transport layer (H04L65/00 takes precedence; aspects not specific to the type of network H04M3/00; special services in those networks H04M3/42)} - G10L 2021/065: {Aids for the handicapped in understanding} - H04M 1/72478: for hearing-impaired users - H04M 2201/38: Displays - H04M 2201/40: using speech recognition - G09B: EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS (devices for psychotechnics or for testing reaction times A61B5/16; games, sports, amusements A63; projectors, projector screens G03B) - H04M: TELEPHONIC COMMUNICATION (circuits for controlling other apparatus via a telephone cable and not involving telephone switching apparatus G08) - G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING - H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M) ## Abstract Technologies related to telecommunications are described herein, wherein such technologies are configured to assist users with hearing impairments. The technologies described herein cause transcriptions of spoken utterances directed to a telephone in a telephone conversation to be presented on a display of the telephone nearly simultaneously with the spoken utterances being audibly output by the telephone. ## Claims ### Claim 1 A server computing system that is in network communication with a communications platform, the server computing system comprising: a processor; and memory storing instructions that, when executed by the processor, cause the processor to perform acts comprising: receiving a request for a token from a first telephone, wherein the token is usable by the first telephone to authenticate with the communications platform; in response to receiving the request, transmitting credentials of the server computing system to the communications platform, wherein the token is generated by the communications platform based upon the credentials of the server computing system; receiving the token from the communications platform; in response to receiving the token from the communications platform, transmitting the token to the first telephone; subsequent to transmitting the token to the first telephone, receiving, from the communications platform, an incoming call notification for a first telephone, the incoming call notification indicates that a second telephone is being employed to place a call to the first telephone; in response to receiving the incoming call notification, transmitting instructions to the communications platform, the instructions informing the communications platform to: connect the call from the second telephone to the first telephone; and when the call is connected, cause a voice signal output by the second telephone to be streamed to the server computing system, wherein the voice signal is directed to the first telephone; upon the call being connected, receiving the voice signal and forwarding the voice signal to a transcription computing system, wherein the transcription computing system transcribes spoken utterances in the voice signal; receiving data from the transcription computing system, the data comprises transcriptions of the spoken utterances in the voice signal; and forwarding the transcriptions of the spoken utterances to the first telephone for display on a display of the first telephone during the call between the first telephone and the second telephone. ### Claim 2 (depends on 1) The server computing system of claim 1, wherein the transcriptions of the spoken utterances are forwarded to the first telephone in real time such that the first telephone displays the spoken utterances on the display within ½ second of when the spoken utterances are audibly output by the first telephone. ### Claim 3 (depends on 1) The server computing system of claim 1, wherein the communications platform is a cloud-based communications platform. ### Claim 4 (depends on 1) The server computing system of claim 1, wherein the data comprises timestamps that are assigned to words in the transcriptions of the spoken utterances, the acts further comprising filtering the timestamps from the data prior to forwarding the transcriptions of the spoken utterances to the first telephone. ### Claim 5 (depends on 1) The server computing system of claim 1, wherein the data comprises metadata that indicates that a transcription of a word in the spoken utterances is in a finalized form, the acts further comprising filtering the metadata from the data prior to forwarding the transcriptions of the spoken utterances to the first telephone. ### Claim 6 (depends on 1) The server computing system of claim 1, wherein the communications platform supports the Voice Over Internet Protocol. ### Claim 7 (depends on 1) The server computing system of claim 1, wherein the instructions further indicate that a second voice signal output by the first telephone that is directed to the second telephone is not to be streamed to the server computing system. ### Claim 8 (depends on 1) The server computing system of claim 1, the acts further comprising: receiving, from the communications platform, an indication that the call between the first telephone and the second telephone has ended; and upon receiving the indication, closing a session between the server computing system and the transcription computing system. ### Claim 9 (depends on 8) The server computing system of claim 8, the acts further comprising: receiving, from the transcription computing system, an amount of time of the session between the server computing system and the transcription computing system; and assigning the amount of time to an account assigned to the first telephone. ### Claim 10 A method performed by a server computing system that is in network communication with a communications platform, the method comprising: receiving, from a first telephone, a request for a token that is usable by the first telephone to authenticate with the communications platform; in response to receiving the request, transmitting credentials of the server computing system to the communications platform, wherein the token is generated by the communications platform based upon the credentials of the server computing system; receiving the token from the communications platform; in response to receiving the token from the communications platform, transmitting the token to the first telephone; subsequent to transmitting the token to the first telephone, receiving, from the communications platform, an incoming call notification for the first telephone, the incoming call notification indicates that a second telephone is being employed to place a call to the first telephone; in response to receiving the incoming call notification, transmitting instructions to the communications platform, the instructions informing the communications platform to: connect the call from the second telephone to the first telephone; and when the call is connected, cause a voice signal output by the second telephone to be streamed to the server computing system, wherein the voice signal is directed to the first telephone; upon the call being connected, receiving the voice signal and forwarding the voice signal to a transcription computing system, wherein the transcription computing system transcribes spoken utterances in the voice signal; receiving data from the transcription computing system, the data comprises transcriptions of the spoken utterances in the voice signal; and forwarding the transcriptions of the spoken utterances to the first telephone for display on a display of the first telephone during the call between the first telephone and the second telephone. ### Claim 11 (depends on 10) The method of claim 10, wherein the transcriptions of the spoken utterances are forwarded to the first telephone in such that the first telephone displays the spoken utterances on the display within ½ second of when the spoken utterances are audibly output by the first telephone. ### Claim 12 (depends on 10) The method of claim 10, wherein the communications platform is a cloud-based communications platform. ### Claim 13 (depends on 10) The method of claim 10, wherein the data comprises timestamps that are assigned to words in the transcriptions of the spoken utterances, the method further comprising filtering the timestamps from the data prior to forwarding the transcriptions of the spoken utterances to the first telephone. ### Claim 14 (depends on 10) The method of claim 10, wherein the data comprises metadata that indicates that a transcription of a word in the spoken utterances is in a finalized form, the method further comprising filtering the metadata from the data prior to forwarding the transcriptions of the spoken utterances to the first telephone. ### Claim 15 (depends on 10) The method of claim 10, wherein the communications platform supports the Voice Over Internet Protocol. ### Claim 16 (depends on 10) The method of claim 10, wherein the instructions further indicate that a second voice signal output by the first telephone that is directed to the second telephone is not to be streamed to the server computing system. ### Claim 17 (depends on 10) The method of claim 10, the acts further comprising: receiving, from the communications platform, an indication that the call between the first telephone and the second telephone has ended; and upon receiving the indication, closing a session between the server computing system and the transcription computing system. ### Claim 18 A computer-readable storage medium of a server computing system that is in network communication with a communications platform, the computer-readable storage medium comprising instructions that, when executed by a processor of the server computing system, cause the processor to perform acts comprising: receiving, from a first telephone, a request for a token that is usable by the first telephone to authenticate with the communications platform; in response to receiving the request, transmitting credentials of the server computing system to the communications platform, wherein the token is generated by the communications platform based upon the credentials of the server computing system; receiving the token from the communications platform; in response to receiving the token from the communications platform, transmitting the token to the first telephone; subsequent to transmitting the token to the first telephone, receiving, from the communications platform, an incoming call notification for the first telephone, the incoming call notification indicates that a second telephone is being employed to place a call to the first telephone; in response to receiving the incoming call notification, transmitting instructions to the communications platform, the instructions informing the communications platform to: connect the call from the second telephone to the first telephone; and when the call is connected, cause a voice signal output by the second telephone to be streamed to the server computing system, wherein the voice signal is directed to the first telephone; upon the call being connected, receiving the voice signal and forwarding the voice signal to a transcription computing system, wherein the transcription computing system transcribes spoken utterances in the voice signal; receiving data from the transcription computing system, the data comprises transcriptions of the spoken utterances in the voice signal; and forwarding the transcriptions of the spoken utterances to the first telephone for display on a display of the first telephone during the call between the first telephone and the second telephone. ### Claim 19 (depends on 18) The computer-readable storage medium of claim 18, wherein the transcriptions of the spoken utterances are forwarded to the first telephone in real time such that the first telephone displays the spoken utterances on the display within ½ second of when the spoken utterances are audibly output by the first telephone. ### Claim 20 (depends on 18) The computer-readable storage medium of claim 18, wherein the data comprises timestamps that are assigned to words in the transcriptions of the spoken utterances, the acts further comprising filtering the timestamps from the data prior to forwarding the transcriptions of the spoken utterances to the first telephone.