# US 12,225,270 B2 · Event-driven streaming media interactivity > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,225,270 B2 - Document ID: US12225270B2 - Status: Granted - Kind: B2 - Application number: 17/967,266 - Filed: 2022-10-17 - Published: 2023-02-09 - Granted: 2025-02-11 - Earliest claimed: 2017-12-20 - Assignees: Videokawa, Inc. - Applicants: Videokawa, Inc. - Inventors: Steven Selfors - Web page: https://patentgrep.com/patent/US12225270B2 ## CPC - H04N 21/4884: {for displaying subtitles} - G09B 19/06: Foreign languages (with audible presentation of material to be studied G09B5/04) - G09B 21/00: Teaching, or communicating with, the blind, deaf or mute (audible presentation of material to be studied G09B5/04; devices or methods for replacing direct visual or auditory perception by another kind of perception A61F9/08, A61F11/04; audible indication of meter readings or of colour G01D7/12; watches for blind persons G04B25/02; speech analysis, speech recognition G10L; sound-recording or reproducing, per se G11B) - H04N 21/47202: {for requesting content on demand, e.g. video on demand} - H04N 21/47217: {for controlling playback functions for recorded or on-demand content, e.g. using progress bars, mode or play-point indicators or bookmarks (specific graphical features in visual interfaces H04N21/4312)} - H04N 21/4856: {for language selection, e.g. for the menu or subtitles} - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION - G09B: EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS (devices for psychotechnics or for testing reaction times A61B5/16; games, sports, amusements A63; projectors, projector screens G03B) ## Abstract Aspects described herein may provide systems, methods, and device for facilitating language learning using videos. Subtitles may be displayed in a first, target language or a second, native language during display of the video. On a pause event, both the target language subtitle and the native language subtitle may be displayed simultaneously to facilitate understanding. While paused, a user may select an option to be provided with additional contextual information indicating usage and context associated with one or more words of the target language subtitle. The user may navigate through previous and next subtitles with additional contextual information while the video is paused. Other aspects may allow users to create auto-continuous video loops of definable duration, and may allow users to generate video segments by searching an entire database of subtitle text, and may allow users create, save, share, and search video loops. ## Claims ### Claim 1 A computer-implemented method for language learning, the method comprising: displaying, by a user device, audiovisual content corresponding to a video; receiving, by the user device, a request to pause display of the video at a first event time; retrieving, by the user device, context data corresponding to a most recent subtitle associated with the video, wherein the most recent subtitle has a corresponding start time less than or equal to the first event time and is a target language subtitle in a target language associated with the audiovisual content, wherein the context data comprises at least one word or phrase of the most recent subtitle in the target language and visual indicia information indicating context and usage of the at least one word or phrase; displaying, by the user device and in response to the request to pause display of the video, the paused video, the target language subtitle, and a corresponding native language subtitle, wherein at least one of the target language subtitle and the native language subtitle appears in response to the request to pause display of the video, wherein the native language subtitle corresponds to the target language subtitle and is in a native language that is associated with a user of the user device and is different from the target language; displaying, by the user device and subsequent to the request to pause display of the video, visual indicia indicating the context and usage of the at least one word or phrase of the target language subtitle based on the visual indicia information; receiving, during display of the context with the paused video, a request to change to a previous or next target language subtitle associated with the target language subtitle; determining the previous or next target language subtitle; and updating the display of the paused video to display the previous or next target language subtitle, a corresponding previous or next native language subtitle, and corresponding previous or next additional context. ### Claim 2 (depends on 1) The method of claim 1, wherein the context data corresponding to the most recent subtitle is retrieved from a server. ### Claim 3 (depends on 2) The method of claim 2, further comprising: sending, by the user device to the server and in response to the request to pause display of the video, a request for the context data corresponding to the most recent subtitle associated with the video. ### Claim 4 (depends on 2) The method of claim 2, wherein the context data corresponding to the most recent subtitle is pre-fetched from the server prior to the request to pause display of the video. ### Claim 5 (depends on 4) The method of claim 4, further comprising: sending, by the user device to the server and in response to a prior request to pause display of the video at a second event time, a request for second context data corresponding to the prior request to pause display of the video, wherein the request for the second context data comprises a request to pre-fetch the context data corresponding to the most recent subtitle associated with the first event time. ### Claim 6 (depends on 1) The method of claim 1, wherein the context data corresponding to the most recent subtitle is cached on the user device. ### Claim 7 (depends on 1) The method of claim 1, wherein displaying the audiovisual content corresponding to the video comprises requesting a stream of the video from a server. ### Claim 8 (depends on 7) The method of claim 7, further comprising: sending, by the user device to the server and in response to the request to pause display of the video, a request for the context data corresponding to the most recent subtitle associated with the video. ### Claim 9 (depends on 7) The method of claim 7, further comprising: sending, by the user device to a second server and in response to the request to pause display of the video, a request for the context data corresponding to the most recent subtitle associated with the video, wherein the second server is different from the server. ### Claim 10 (depends on 1) The method of claim 1, wherein the video is cached on the user device. ### Claim 11 (depends on 1) The method of claim 1, wherein the visual indicia is displayed in response to a request to display additional context corresponding to the target language subtitle while the display of the video is paused. ### Claim 12 (depends on 1) The method of claim 1, wherein the context data corresponding to the most recent subtitle comprises the target language subtitle and the corresponding native language subtitle. ### Claim 13 (depends on 1) The method of claim 1, wherein the visual indicia information comprises markup language data associating the at least one word or phrase of the target language subtitle with at least one of: an in-context definition, priority, part of speech, pronunciation, formality, or in-context example sentences. ### Claim 14 A computer-implemented method for language learning, the method comprising: displaying, by a user device, a video in a first mode, wherein displaying the video in the first mode comprises: displaying the video and subtitles in a first language, or displaying the video without subtitles; receiving, by the user device and during display of the video in the first mode, user input indicating a request to pause the video at a first event time; retrieving, by the user device, context data corresponding to a most recent subtitle associated with the video, wherein the most recent subtitle has a corresponding start time less than or equal to the first event time and is in the first language associated with the audiovisual content, wherein the context data comprises at least one word or phrase of the most recent subtitle in the first language and visual indicia information indicating context and usage of the at least one word or phrase of the first subtitle in the first language; displaying, by the user device and in response to receiving the request to pause the video, the video in a second mode, wherein displaying the video in the second mode comprises displaying: the paused video, the first subtitle in the first language, and a corresponding second subtitle comprising the first subtitle in a different second language, wherein the second subtitle is not displayed in the first mode; receiving, by the user device, user input indicating a request to see additional context related to the first subtitle or the second subtitle; displaying, by the user device and in response to receiving the request to see additional context, the video in a third mode, wherein displaying the video in the third mode comprises displaying: the paused video, the first subtitle in the first language, the corresponding second subtitle in the second language, and visual indicia indicating the context and usage of the at least one word or phrase in the first subtitle based on the visual indicia information; receiving, during display of the context with the paused video in the third mode, a request to change to a previous or next first language subtitle associated with the first subtitle; determining the previous or next first language subtitle; and updating the display of the paused video to display the previous or next first language subtitle, a corresponding previous or next second language subtitle, and corresponding previous or next additional context. ### Claim 15 (depends on 14) The method of claim 14, wherein the context data corresponding to the most recent subtitle is retrieved from a server. ### Claim 16 (depends on 15) The method of claim 15, wherein the context data corresponding to the most recent subtitle is pre-fetched from the server prior to the request to pause display of the video. ### Claim 17 (depends on 14) The method of claim 14, wherein the context data corresponding to the most recent subtitle is cached on the user device. ### Claim 18 (depends on 14) The method of claim 14, wherein displaying the audiovisual content corresponding to the video comprises requesting a stream of the video from a server. ### Claim 19 (depends on 14) The method of claim 14, wherein the video is cached on the user device. ### Claim 20 A non-transitory computer readable medium storing instructions that, when executed by one or more processors, cause a user device to perform steps comprising: displaying, by the user device, audiovisual content corresponding to a video; receiving, by the user device, a request to pause display of the video at a first event time; retrieving, by the user device, context data corresponding to a most recent subtitle associated with the video, wherein the most recent subtitle has a corresponding start time less than or equal to the first event time and is a target language subtitle in a target language associated with the audiovisual content, wherein the context data comprises at least one word or phrase of the most recent subtitle in the target language and visual indicia information indicating context and usage of the at least one word or phrase; displaying, by the user device and in response to the request to pause display of the video, the paused video, the target language subtitle, and a corresponding native language subtitle, wherein at least one of the target language subtitle and the native language subtitle appears in response to the request to pause display of the video, wherein the native language subtitle corresponds to the target language subtitle and is in a native language that is associated with the user and is different from the target language; displaying, by the user device and subsequent to the request to pause display of the video, visual indicia indicating the context and usage of the at least one word or phrase of the target language subtitle based on the visual indicia information; receiving, during display of the context with the paused video, a request to change to a previous or next target language subtitle associated with the target language subtitle; determining the previous or next target language subtitle; and updating the display of the paused video to display the previous or next target language subtitle, a corresponding previous or next native language subtitle, and corresponding previous or next additional context. ### Claim 21 (depends on 20) The non-transitory computer readable medium of claim 20 wherein displaying the audiovisual content corresponding to the video comprises requesting a stream of the video from a server. ### Claim 22 (depends on 20) The non-transitory computer readable medium of claim 20, wherein the video is cached on the user device.