# US 2024/0205508 A1 · Systems and methods for fast, intuitive, and personalized language learning from video subtitles

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2024/0205508 A1
- Document ID: US20240205508A1
- Status: Published application
- Kind: A1
- Application number: 18/084,786
- Filed: 2022-12-20
- Published: 2024-06-20
- Earliest claimed: 2022-12-20
- Assignees: Adeia Guides Inc.
- Applicants: Rovi Guides, Inc.
- Inventors: Zhiyun Li
- Web page: https://patentgrep.com/patent/US20240205508A1

## CPC

- G06F 40/237: Lexical tools
- H04N 21/4884: {for displaying subtitles}
- G06F 40/253: Grammatical analysis; Style critique
- G09B 19/06: Foreign languages (with audible presentation of material to be studied G09B5/04)
- H04N 5/278: Subtitling
- H04N 21/466: Learning process for intelligent management, e.g. learning user preferences for recommending movies {(services using the results of monitoring in broadcast systems H04H60/61)}
- H04N 21/47217: {for controlling playback functions for recorded or on-demand content, e.g. using progress bars, mode or play-point indicators or bookmarks (specific graphical features in visual interfaces H04N21/4312)}
- H04N 21/4856: {for language selection, e.g. for the menu or subtitles}
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G09B: EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS (devices for psychotechnics or for testing reaction times A61B5/16; games, sports, amusements A63; projectors, projector screens G03B)

## Abstract

A vocabulary level of a user in a language to be learned is identified. During playback of a media asset on a first device, subtitles in the language are extracted for at least a portion of the media asset. The extracted subtitles may contain a single word, or a plurality of words in the language in question. Based on the vocabulary level, a subset of words from the extracted subtitles are predicted to be new to the user. The predicted new words are then generated for display on a second device associated with the user, along with an explanation of each word of the subset of words.

## Claims

### Claim 1

A method for fast, intuitive, personalized language learning from subtitles, the method comprising:
identifying a vocabulary level of a user in a first language;
during playback, on a first device, of a media asset, extracting subtitles in the first language for at least a portion of the media asset, the subtitles comprising a plurality of words in the first language;
predicting, based on the vocabulary level, a subset of words of the plurality words that are new to the user; and
generating for display, on a second device associated with the user, the subset of words and a respective explanation of each word of the subset of words.

### Claim 2 (depends on 1)

The method of claim 1, wherein identifying a vocabulary level of the user in the first language further comprises:
retrieving, from a user profile associated with the user, a language learning history for the first language; and
determining, based on the language learning history, a familiarity level of the user with the first language.

### Claim 3 (depends on 1)

The method of claim 1, wherein generating for display, on the second device associated with the user, the subset of words and a respective explanation of each word of the subset of words further comprises:
transmitting, to the second device, the subset of words and the respective explanations.

### Claim 4 (depends on 1)

The method of claim 1, wherein generating for display, on the second device associated with the user, the subset of words and a respective explanation of each word of the subset of words further comprises:
adding the subset of words and the respective explanation of each word to a list of words and corresponding explanations that have previously been generated for display during playback of the media asset; and
automatically scrolling the list such that the subset of words is visible on a display of the second device.

### Claim 5 (depends on 1)

The method of claim 1, further comprising:
receiving an input to bookmark a word of the subset of words; and
in response to receiving the input:
identifying a start time and an end time for display of a subtitle in which the word is contained; and
storing the start time, the end time, and an identifier of the media asset in association with the word.

### Claim 6 (depends on 5)

The method of claim 5, further comprising:
storing a segment of the media asset beginning at the start time and ending at the end time; and
in response to receiving a selection of the bookmark, replaying the stored segment.

### Claim 7 (depends on 5)

The method of claim 5, further comprising:
in response to receiving a selection of the bookmark:
retrieving the identifier of the media asset; and
based on the identifier of the media asset, the start time, and the end time, replaying a segment of the media asset beginning at the start time and ending at the end time.

### Claim 8 (depends on 7)

The method of claim 7, wherein replaying the segment of the media asset corresponding to the display time comprises instructing the first device to perform a rewind operation to the start time.

### Claim 9 (depends on 7)

The method of claim 7, wherein replaying the segment of the media asset corresponding to the display time comprises:
instructing the first device to pause playback of the media asset;
retrieving, at the second device, the segment of the media asset; and
replaying at least audio data of the segment on the second device.

### Claim 10 (depends on 1)

The method of claim 1, wherein generating for display, on a second device associated with the user, the subset of words and a respective explanation of each word of the subset of words further comprises:
retrieving a sentence from the subtitles, the sentence including a word of the subset of words; and
transmitting, to the second device, the sentence and the respective explanation of the word of the subset of words.

### Claim 11

A system for fast, intuitive, personalized language learning from subtitles, the system comprising:
input/output circuitry; and
control circuitry configured to:
identify a vocabulary level of a user in a first language;
during playback, on a first device, of a media asset, extract subtitles in the first language for at least a portion of the media asset, the subtitles comprising a plurality of words in the first language;
predict, based on the vocabulary level, a subset of words of the plurality words that are new to the user; and
generate for display, via the input/output circuitry, on a second device associated with the user, the subset of words and a respective explanation of each word of the subset of words.

### Claim 12 (depends on 11)

The system of claim 11, wherein the control circuitry configured to identify a vocabulary level of the user in the first language is further configured to:
retrieve, using the input/output circuitry, from a user profile associated with the user, a language learning history for the first language; and
determine, based on the language learning history, a familiarity level of the user with the first language.

### Claim 13 (depends on 11)

The system of claim 11, wherein the control circuitry configured to generate for display, via the input/output circuitry, on the second device associated with the user, the subset of words and a respective explanation of each word of the subset of words is further configured to:
transmit, to the second device, the subset of words and the respective explanations.

### Claim 14 (depends on 11)

The system of claim 11, wherein the control circuitry configured to generate for display, via the input/output circuitry, on the second device associated with the user, the subset of words and a respective explanation of each word of the subset of words is further configured to:
add the subset of words and the respective explanation of each word to a list of words and corresponding explanations that have previously been generated for display during playback of the media asset; and
automatically scroll the list such that the subset of words is visible on a display of the second device.

### Claim 15 (depends on 11)

The system of claim 11, wherein the control circuitry is further configured to:
receive an input to bookmark a word of the subset of words; and
in response to receiving the input:
identify a start time and an end time for display of a subtitle in which the word is contained; and
store the start time, the end time, and an identifier of the media asset in association with the word.

### Claim 16 (depends on 15)

The system of claim 15, wherein the control circuitry is further configured to:
store a segment of the media asset beginning at the start time and ending at the end time; and
in response to receiving a selection of the bookmark, replay the stored segment.

### Claim 17 (depends on 15)

The system of claim 15, wherein the control circuitry is further configured to
in response to receiving a selection of the bookmark:
retrieve the identifier of the media asset; and
based on the identifier of the media asset, the start time, and the end time, replay a segment of the media asset beginning at the start time and ending at the end time.

### Claim 18 (depends on 17)

The system of claim 17, wherein the control circuitry configured to replay the segment of the media asset corresponding to the display time is further configured to instruct the first device to perform a rewind operation to the start time.

### Claim 19 (depends on 17)

The system of claim 17, wherein the control circuitry configured to replay the segment of the media asset corresponding to the display time is further configured to:
instruct the first device to pause playback of the media asset;
retrieve, at the second device, the segment of the media asset; and
replay at least audio data of the segment on the second device.

### Claim 20 (depends on 11)

The system of claim 11, wherein the control circuitry configured to generate for display, using the input/output circuitry, on a second device associated with the user, the subset of words and a respective explanation of each word of the subset of words is further configured to:
retrieve a sentence from the subtitles, the sentence including a word of the subset of words; and
transmit, to the second device, using the input/output circuitry, the sentence and the respective explanation of the word of the subset of words.

### Claim at position 21

21-50. (canceled)
