# US 10,504,519 B1 · Transcription of communications > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 10,504,519 B1 - Document ID: US10504519B1 - Status: Granted - Kind: B1 - Application number: 16/370,214 - Filed: 2019-03-29 - Granted: 2019-12-10 - Earliest claimed: 2018-10-08 - Assignees: Sorenson IP Holdings, LLC - Applicants: Sorenson IP Holdings, LLC - Inventors: Brian Chevrier; Shane Roylance; Kenneth Boehme - Web page: https://patentgrep.com/patent/US10504519B1 ## CPC - G10L 15/26: Speech to text systems (G10L15/08 takes precedence) - G10L 15/06: Creation of reference templates; Training of speech recognition systems, e.g. adaptation to the characteristics of the speaker's voice (G10L15/14 takes precedence) - G10L 15/08: Speech classification or search - G10L 15/22: Procedures used during a speech recognition process, e.g. man-machine dialogue - G10L 25/48: specially adapted for particular use - G10L 2015/088: {Word spotting} - G10L 2015/221: {Announcement of recognition results} - H04M 3/42391: {where the subscribers are hearing-impaired persons, e.g. telephone devices for the deaf} - H04M 2201/40: using speech recognition - G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING - H04M: TELEPHONIC COMMUNICATION (circuits for controlling other apparatus via a telephone cable and not involving telephone switching apparatus G08) ## Abstract A method to transcribe communications may include obtaining audio data originating at a first device during a communication session between the first device and a second device and providing the audio data to an automated speech recognition system configured to transcribe the audio data. The method may further include obtaining multiple hypothesis transcriptions generated by the automated speech recognition system. Each of the multiple hypothesis transcriptions may include one or more words determined by the automated speech recognition system to be a transcription of a portion of the audio data. The method may further include determining one or more consistent words that are included in two or more of the multiple hypothesis transcriptions and in response to determining the one or more consistent words, providing the one or more consistent words to the second device for presentation of the one or more consistent words by the second device. ## Claims ### Claim 1 A method to transcribe communications, the method comprising: obtaining a plurality of hypothesis transcriptions of audio data generated by a speech recognition system; determining a plurality of consistent words that are included in two or more of the plurality of hypothesis transcriptions; in response to determining the plurality of consistent words, directing the plurality of consistent words to a device for presentation of the plurality of consistent words; and presenting the plurality of consistent words in a rolling fashion, a pace of the presentation of the plurality of consistent words in the rolling fashion being variable. ### Claim 2 (depends on 1) The method of claim 1, further comprising: determining an update word in a final transcription of the audio data that is different from any of the plurality of consistent words; and in response to determining the update word, directing an indication of the update word to the device, the update word replacing one or more of the plurality of consistent words in the presentation of the plurality of consistent words. ### Claim 3 (depends on 1) The method of claim 1, wherein the presentation of the plurality of consistent words by the device is configured to occur before a final transcription of the audio data is provided to the device. ### Claim 4 (depends on 1) The method of claim 1, wherein the variable pace is determined to allow for all of the plurality of consistent words to be presented in less than a threshold period of time. ### Claim 5 (depends on 1) The method of claim 1, wherein the variable pace is determined based on one or more of: a display screen size of the device and an average talking speed of a user associated with the audio data. ### Claim 6 (depends on 1) At least one non-transitory computer-readable media configured to store one or more instructions that when executed by at least one processor cause or direct a system to perform the method of claim 1. ### Claim 7 A system comprising: at least one processor; and at least one non-transitory computer-readable media communicatively coupled to the at least one processor and configured to store one or more instructions that when executed by the at least one processor cause or direct the system to perform operations comprising: obtain a plurality of hypothesis transcriptions of audio data generated by a speech recognition system; determine one or more consistent words that are included in two or more of the plurality of hypothesis transcriptions; in response to determining the one or more consistent words, direct the one or more consistent words to a device for presentation of the one or more consistent words; determine an update word in a final transcription of the audio data that is different from any of the one or more consistent words; and in response to determining the update word, direct an indication of the update word to the device, the update word replacing the one or more consistent words in the presentation of the one or more consistent words. ### Claim 8 (depends on 7) The system of claim 7, wherein the operations further comprise obtain the audio data during a communication session between a second device and the device, the audio data originating at the second device. ### Claim 9 (depends on 7) The system of claim 7, wherein the presentation of the one or more consistent words by the device is configured to occur before the final transcription of the audio data is provided to the device. ### Claim 10 (depends on 7) The system of claim 7, wherein the speech recognition system is included in the system. ### Claim 11 (depends on 7) The system of claim 7, wherein the final transcription includes a plurality of words that the speech recognition system outputs together as the final transcription of the audio data that includes one or more of the one or more consistent words. ### Claim 12 (depends on 7) The system of claim 7, wherein the one or more consistent words are presented in a rolling fashion, a pace of the presentation of the one or more consistent words in the rolling fashion being variable. ### Claim 13 (depends on 7) The system of claim 7, wherein the plurality of hypothesis transcriptions are obtained sequentially over time and the operation to determine the one or more consistent words includes compare a first hypothesis transcription of the plurality of hypothesis transcriptions with a second hypothesis transcription of the plurality of hypothesis transcriptions, the second hypothesis transcription directly following the first hypothesis transcription among the plurality of hypothesis transcriptions. ### Claim 14 A method to transcribe communications, the method comprising: obtaining a plurality of hypothesis transcriptions of audio data generated by a speech recognition system; determining one or more consistent words that are included in two or more of the plurality of hypothesis transcriptions; in response to determining the one or more consistent words, directing the one or more consistent words to a device for presentation of the one or more consistent words; determining an update word in a final transcription of the audio data that is different from any of the one or more consistent words; and in response to determining the update word, directing an indication of the update word to the device, the update word replacing the one or more consistent words in the presentation of the one or more consistent words. ### Claim 15 (depends on 14) The method of claim 14, further comprising obtaining the audio data during a communication session between a second device and the device, the audio data originating at the second device. ### Claim 16 (depends on 14) The method of claim 14, wherein the presentation of the one or more consistent words by the device is configured to occur before the final transcription of the audio data is provided to the device. ### Claim 17 (depends on 14) The method of claim 14, wherein the final transcription includes a plurality of words that the speech recognition system outputs together as the final transcription of the audio data that includes one or more of the one or more consistent words. ### Claim 18 (depends on 14) The method of claim 14, wherein the one or more consistent words are presented in a rolling fashion, a pace of the presentation of the one or more consistent words in the rolling fashion being variable. ### Claim 19 (depends on 14) The method of claim 14, wherein the plurality of hypothesis transcriptions are obtained sequentially over time and determining the one or more consistent words includes comparing a first hypothesis transcription of the plurality of hypothesis transcriptions with a second hypothesis transcription of the plurality of hypothesis transcriptions, the second hypothesis transcription directly following the first hypothesis transcription among the plurality of hypothesis transcriptions. ### Claim 20 (depends on 14) At least one non-transitory computer-readable media configured to store one or more instructions that when executed by at least one processor cause or direct a system to perform the method of claim 14.