# US 11,445,256 B2 · Editing timed-text elements > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 11,445,256 B2 - Document ID: US11445256B2 - Status: Granted - Kind: B2 - Application number: 16/918,590 - Filed: 2020-07-01 - Published: 2020-10-22 - Granted: 2022-09-13 - Earliest claimed: 2018-06-06 - Assignees: Home Box Office, Inc. - Applicants: Home Box Office, Inc. - Inventors: Hugo Ayala - Web page: https://patentgrep.com/patent/US11445256B2 ## CPC - G11B 27/34: Indicating arrangements {(indicating means incorporated in magazine or cassette G11B23/046 and G11B23/0875; indicating measured values in general G01D)} - H04N 21/47205: {for manipulating displayed content, e.g. interacting with MPEG-4 objects, editing locally} - G06F 40/166: Editing, e.g. inserting or deleting - G11B 27/031: Electronic editing of digitised analogue information signals, e.g. audio or video signals - H04N 21/4884: {for displaying subtitles} - H04N 21/8456: {by decomposing the content in the time domain, e.g. in time segments} - G11B: INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER (recording measured values in a way that does not require playback through a transducer G01D9/00; recording or playback apparatus using mechanically marked tape, e.g. punched paper tape, or using unit records, e.g. punched or magnetically marked cards G06K; transferring data from one type of record carrier to another G06K1/18; circuits for coupling output of reproducer to radio receiver H04B1/20; gramophone pick-ups or like acoustic electromechanical transducers or circuits therefor H04R) - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) ## Abstract The described technology is generally directed towards integrated tools for editing and otherwise working with close-captioning captions (or subtitles), including an on-screen editing interface that allows a user to select and edit caption text directly on-screen. Caption editing can include changing positioning metadata associated with a caption, changing timing metadata associated with a caption, and/or changing text content/text style metadata of a caption. A counter is provided to assist the user with respect to how many additional characters can be added to the caption. Also provided is a search interface that locates captions within a large set of captions, such as the full set of captions for a video. ## Claims ### Claim 1 A system, comprising, a processor; and a memory that stores executable instructions that, when executed by the processor, facilitate performance of operations, the operations comprising: displaying a first selected video frame of a video; overlaying an interactive interface over the first selected video frame; detecting a first interaction with the interactive interface, and in response to the detecting the first interaction, changing the first selected video frame to a second selected video frame of the video and displaying the second video frame of a video behind the interactive interface; obtaining text caption data associated with the second selected video frame; displaying, on the interactive interface, a representation of a remaining character counter element of a remaining character count of the text caption data based on a number of characters of the caption data and a character limit; rendering a representation of the text caption data in the interactive interface; detecting a second interaction with the interactive interface that edits the text caption data into modified text caption data; and in response to the detecting the second interaction, rendering a representation of the modified text caption data in the interactive interface, and maintaining the modified text caption data in association with the second selected video frame. ### Claim 2 (depends on 1) The system of claim 1, wherein the operations further comprise detecting a third interaction with the interactive interface, and in response to the detecting the third interaction, repositioning the interactive interface relative to the second selected video frame, and maintaining interactive interface positioning data in association with the second selected video frame. ### Claim 3 (depends on 1) The system of claim 1, wherein the operations further comprise detecting a third interaction with the interactive interface, and in response to the detecting the third interaction, changing a size of the interactive interface, and maintaining interactive interface size data in association with the second selected video frame. ### Claim 4 (depends on 1) The system of claim 1, wherein the operations further comprise obtaining text style metadata corresponding the modified text caption data, rendering a styled representation of the modified text caption data in the interactive interface based on the text style metadata, and maintaining the text style metadata data in association with the second selected video frame. ### Claim 5 (depends on 1) The system of claim 1, wherein the operations further comprise rendering an interactive search menu comprising a search input element for entering text to search for one or more captions within a group of closed captions associated with the video. ### Claim 6 (depends on 5) The system of claim 5, wherein the operations further comprise rendering a search result comprising matching text and a timecode at which the matching text appears in the video. ### Claim 7 (depends on 1) The system of claim 1, wherein the operations further comprise detecting a third interaction with the interactive interface that selects at least some of the text caption data, and in response to the detecting the third interaction, rendering a caption style selection interactive interface. ### Claim 8 (depends on 7) The system of claim 7, wherein the caption style selection interactive interface facilitates editing at least one of: font, font size, font color, background color, background opacity, window color or window opacity. ### Claim 9 (depends on 7) The system of claim 7, wherein the caption style selection interactive interface facilitates editing font style corresponding to at least one of: italic, bold, underline, blinking or all capital alphabet characters. ### Claim 10 (depends on 1) The system of claim 1, wherein the changing the first selected video frame to the second selected video frame of the video moves to an earlier frame in the video. ### Claim 11 (depends on 1) The system of claim 1, wherein the operations further comprise determining that the remaining character count has reached a threshold value, and in response to the determining, modifying an appearance of the representation of the remaining character counter element. ### Claim 12 A computer-implemented method, comprising: rendering an interactive interface over a first displayed frame of video content, in which the interactive interface displays first closed captioning text that is associated with the first displayed frame; displaying, on the interactive interface, a first representation of a first character counter element of the first closed captioning text; detecting a change from the first displayed frame to a second displayed frame; rendering the interactive interface over the second displayed frame of the video content, in which the interactive interface displays second closed captioning text that is associated with the second displayed frame; and displaying, on the interactive interface, a second representation of a second character counter element of the second closed captioning text. ### Claim 13 (depends on 12) The computer-implemented method of claim 12, further comprising detecting interaction with the interactive interface that changes a character of the second closed captioning text. ### Claim 14 (depends on 12) The computer-implemented method of claim 12, further comprising detecting interaction with the interactive interface that changes style data of the second closed captioning text. ### Claim 15 (depends on 12) The computer-implemented method of claim 12, further comprising detecting interaction with the interactive interface that repositions the interactive interface relative to the second displayed frame of the video content. ### Claim 16 (depends on 12) The computer-implemented method of claim 12, further comprising rendering an interactive search menu, the interactive search menu comprising a search input element for entering text to search within a group of closed captions associated with the video. ### Claim 17 (depends on 12) The computer-implemented method of claim 12, wherein the operations further comprise receiving third input data via the interactive interface that changes the modified character count, determining that the modified character count has reached a threshold value, and in response to the determining, changing an appearance of the representation of the modified representation of the modified character count. ### Claim 18 A non-transitory machine-readable medium, comprising executable instructions that, when executed by a processor facilitate performance of operations, the operations comprising: displaying a displayed frame of video content; rendering an interactive interface over the displayed frame; obtaining closed captioning text corresponding to the displayed frame; rendering the closed captioning text on the interactive interface; rendering a representation on the interactive interface of a character counter element of the closed captioning text based on a number of characters of the closed captioning text; receiving first input data via the interactive interface that changes the displayed frame to a different displayed frame, and in response to the receiving the first input data, displaying the different displayed frame of video content, rendering the interactive interface over the different displayed frame, obtaining different closed captioning text corresponding to the different displayed frame and rendering the different closed captioning text on the interactive interface; receiving second input data via the interactive interface that changes the different closed captioning text to modified closed captioning text; and rendering a modified representation on the interactive interface of a modified character count of the modified closed captioning text based a number of characters of the modified closed captioning text. ### Claim 19 (depends on 18) The non-transitory machine-readable medium of claim 18, wherein the operations further comprise receiving third input data via the interactive interface that repositions the modified closed captioning text relative to the different displayed frame. ### Claim 20 (depends on 18) The non-transitory machine-readable medium of claim 18, wherein the operations further comprise maintaining a character counter corresponding to a number of closed caption characters of the modified closed caption text, and rendering a representation of the counter in conjunction with the interactive interface.