# US 11,115,725 B2 · User placement of closed captioning > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 11,115,725 B2 - Document ID: US11115725B2 - Status: Granted - Kind: B2 - Application number: 16/537,267 - Filed: 2019-08-09 - Published: 2019-11-28 - Granted: 2021-09-07 - Earliest claimed: 2017-07-11 - Assignees: Saturn Licensing LLC - Applicants: Sony Corporation - Inventors: Brant Candelore; Mahyar Nejat; Peter Shintani - Web page: https://patentgrep.com/patent/US11115725B2 ## CPC - H04N 21/4884: {for displaying subtitles} - G10L 15/26: Speech to text systems (G10L15/08 takes precedence) - H04N 21/4307: {Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen} - H04N 21/43072: {of multiple content streams on the same device} - H04N 21/4316: {for displaying supplemental content in a region of the screen, e.g. an advertisement in a separate window} - H04N 21/4394: {involving operations for analysing the audio stream, e.g. detecting features or characteristics in audio streams (arrangements characterised by components specially adapted for monitoring, identification or recognition of audio in broadcast systems H04H60/58)} - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION - G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING ## Abstract Placement of Closed Captioning (CC) in content by a content provider is overridden by means of a user interface (UI) that allows the user to place CC on screen on top of the video. The CC may be derived directly from the audio and synchronized with play of the audio and video. ## Claims ### Claim 1 A system comprising: a first decoder for communicating with an audio video device (AVD) for decoding audio received at the AVD at a first time; a speech-to-text (STT) converter implemented on the AVD receiving output from the first decoder to render closed captioning (CC); a second decoder for communicating with the AVD for decoding the audio at a second time later than the first time to generate decoded audio, at least one of the decoders being implemented on a server configured to communicate with the AVD over a network; at least one speaker of the AVD for playing the decoded audio; and at least one display of the AVD for presenting the CC in synchronization with playing the decoded audio from the second decoder on the at least one speaker of the AVD. ### Claim 2 (depends on 1) The system of claim 1, wherein the first decoder comprises an AC3 decoder. ### Claim 3 (depends on 1) The system of claim 1, wherein the STT converter comprises a field programmable gate array. ### Claim 4 (depends on 1) The system of claim 1, wherein the STT converter comprises a processor in the AVD. ### Claim 5 (depends on 1) The system of claim 1, wherein the display is configured to present video associated with the audio in a window comprising less than all of a video display area of the display, the window comprising only first and second corners of the video display area, the CC being presented in a CC region outside of the window. ### Claim 6 (depends on 1) The system of claim 1, wherein the display is configured to present at least one user interface (UI) enabling selection to present the CC rendered by the STT converter and selection to present CC received from a content source in lieu of or in addition to CC rendered by the STT converter. ### Claim 7 A device comprising: at least one computer storage that is not a transitory signal and that comprises instructions executable by at least one processor to: decode first audio received at a display device at a first point in time using a first decoder implemented in the display device or by a network server receiving the first audio from the display device; generate text from the first audio received from the first decoder using speech-to-text (STT) converter implemented in the display device; decode the first audio at a second point of time later than the first point in time using a second decoder implemented by the display device or by a network server receiving the first audio from the display device; and present the text on a display of the display device in synchronization with playing the first audio decoded by the second decoder on at least one speaker of the display device. ### Claim 8 (depends on 7) The device of claim 7, wherein the first decoder is implemented by the display device. ### Claim 9 (depends on 7) The device of claim 7, wherein the first decoder is implemented by the network server. ### Claim 10 (depends on 7) The device of claim 7, wherein the second decoder is implemented by the display device. ### Claim 11 (depends on 7) The device of claim 7, wherein the STT converter comprises a processor in the display device. ### Claim 12 (depends on 7) The device of claim 7, wherein the instructions are executable to present video associated with the audio in a window comprising less than all of a video display area of the display device, the window comprising only first and second corners of the video display area, the text being presented in a region outside of the window. ### Claim 13 (depends on 7) The device of claim 7, wherein the instructions are executable to present at least one user interface (UI) enabling selection to present the text and selection to present closed captioning (CC) received from a content source in lieu of or in addition to the text. ### Claim 14 An assembly, comprising: at least one processor configured with instructions for: receiving at a display device first audio at a first point in time; providing the first audio received at the display device to a first decoder implemented in the display device or in a network server for generating text from the first audio received from the first decoder using speech-to-text (STT) converter implemented in the display device; decoding the first audio at a second point of time later than the first point in time using a second decoder implemented by the display device; and presenting the text on a display of the display device in synchronization with playing the first audio decoded by the second decoder on at least one speaker of the display device. ### Claim 15 (depends on 14) The assembly of claim 14, wherein the first decoder is implemented in the display device. ### Claim 16 (depends on 14) The assembly of claim 14, wherein the first decoder is implemented in the network server.