# US 2021/0233427 A1 · System and methods for facilitating language learning

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0233427 A1
- Document ID: US20210233427A1
- Status: Published application
- Kind: A1
- Application number: 17/055,797
- Filed: 2019-01-11
- Published: 2021-07-29
- Earliest claimed: 2018-05-22
- Assignees: Mooveez Company A.S.
- Applicants: Mooveez Company A.S.
- Inventors: Miroslav Pesta; Karel Tomas; Jiri Horak
- Web page: https://patentgrep.com/patent/US20210233427A1

## CPC

- G09B 19/06: Foreign languages (with audible presentation of material to be studied G09B5/04)
- G06F 3/04817: using icons (graphical or visual programming using iconic symbols G06F8/34)
- G06F 3/04842: Selection of displayed objects or displayed text elements (G06F3/0482 takes precedence)
- G06F 40/40: Processing or translation of natural language (natural language analysis G06F40/20; semantic analysis G06F40/30)
- G09B 5/065: {Combinations of audio and video presentations, e.g. videotapes, videodiscs, television systems}
- G09B 19/04: Speaking (with audible presentation of the material to be studied G09B5/04)
- G09B: EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS (devices for psychotechnics or for testing reaction times A61B5/16; games, sports, amusements A63; projectors, projector screens G03B)
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

This disclosure provides methods and systems for facilitating learning through watching multimedia contents in a target language, learning words and grammatical rules in text transcripts presented in multiple forms including flashcards, and providing an accurate assessment of current linguistic knowledge of a learner in a language knowledge map.

## Claims

### Claim 1

A method for facilitating language learning, comprising:
presenting, on a display of a user device, a multimedia content comprising one or more audiovisual segments, wherein each of the audiovisual segments is associated with a sentence or a portion of the sentence;
providing, on the same display, a first text transcript in a target language and a second text transcript in a source language corresponding to the sentence or the portion of the sentence associated with each of the audiovisual segments;
receiving one or more user responses from a user to the first text transcript in the target language associated with each of the audiovisual segments, wherein the user responses indicate the user's comprehension of the first text transcript in the target language;
determining a linguistic knowledge of the user based on an aggregate analysis of the received one or more user responses to the first text transcript in the target language, wherein the linguistic knowledge of the user is determined by a level of vocabulary or a mastery of a grammatical rule;
generating a language knowledge map based on the linguistic knowledge of the user, wherein the language knowledge map comprises a plurality of cells representing words, phrases or grammatical rules; and
displaying the language knowledge map on the user device.

### Claim 2 (depends on 1)

The method of claim 1, wherein the language knowledge map further comprises a plurality of zones representing one or more levels of mastery of words and grammatical rules, wherein the words and grammatical rules constitute the sentence or the phrase within the first text transcript in the target language.

### Claim 3 (depends on 1)

The method claim 1, wherein the plurality of cells comprises a color shading indicating a level of mastery of words or grammatical rules.

### Claim 4 (depends on 1)

The method of claim 1, wherein a combination of adjacent two or more cells of the plurality of cells in the language knowledge map represents one or more grammatical rules.

### Claim 5 (depends on 1)

The method of claim 1, further comprising:
receiving a user action selecting one of the plurality of cells, wherein the user action is a request to display a content embedded in the selected cell; and
presenting the content embedded in the selected cell upon receiving the user action, wherein the content comprises a word displayed in at least one of the source language and the target language.

### Claim 6 (depends on 1)

The method of claim 1, further comprising:
updating the language knowledge map based on the aggregate analysis of the received one or more user responses over a period of time or to a plurality of multimedia contents viewed by the user.

### Claim 7 (depends on 1)

The method of claim 1, where the first text transcript in the target language is provided by a language professional or by a translation of the first text transcript in the target language.

### Claim 8

(canceled)

### Claim 9

(canceled)

### Claim 10 (depends on 1)

The method of claim 1, wherein the one or more user responses comprise a first user input responsive to a first icon indicating the user's comprehension of the first text transcript in the target language, wherein the first user input is an indicia of a confirmation or a denial of the user's comprehension of the first text transcript in the target language and wherein said method further comprises:
assigning a mastered status or an unmastered status to the first text transcript based on the first user input; and
assigning the mastered status or the unmastered status to the words and the grammatical rules within the text first transcript in the target language.

### Claim 11 (depends on 1)

The method of claim 1, wherein the one or more user responses comprise a second user input responsive to a second icon indicating a user's request for creating a flashcard associated with the first text transcript in the target language or the second text transcript in the source language corresponding to an audiovisual segment and wherein the flashcard comprises the first text transcript in the target language and the corresponding audiovisual segment and the second text transcript in the source language and the corresponding audiovisual segment.

### Claim 12

(canceled)

### Claim 13

(canceled)

### Claim 14

(canceled)

### Claim 15 (depends on 11)

The method of claim 11, further comprising:
receiving a user action responsive to the flashcard that is a request for playing the flashcard; and
playing, upon receiving the user action, an audio component of the audiovisual segment and the first text transcript in the target language associated with the audiovisual segment.

### Claim 16 (depends on 15)

The method of claim 15, further comprising:
automatically assigning the mastered status to the words and the grammatical rules within the first transcript in the target language contained in the flashcard after repeating the step of playing the flashcard a predetermined number of times.

### Claim 17 (depends on 11)

The method of claim 11, further comprising:
receiving a third user input responsive to a third icon indicating the user's comprehension of the first transcript in the target language within the flashcard; and
assigning the mastered status to the words and the grammatical rules within the text transcript.

### Claim 18 (depends on 11)

The method of claim 11, further comprising:
receiving a fourth user input responsive to a fourth icon that is a request to record a user's audio dictation for the audiovisual segment associated with the flashcard;
acquiring an audio recording comprising the user's audio dictation for the audiovisual segment; and
associating the audio recording with the flash card.

### Claim 19

(canceled)

### Claim 20

(canceled)

### Claim 21 (depends on 1)

The method of claim 1, wherein the method comprises, before the step of presenting the multimedia content:
providing information of one or more multimedia contents for selection by the user;
receiving a first user input indicating a selection of the one or more multimedia contents;
receiving a second user input indicating a selection of the source language;
receiving a third user input indicating a selection of the target language; and
delivering, to the user device, the one or more multimedia contents based on the first user input, the second user input, and the third user input by downloading or steaming the one or more multimedia contents.

### Claim 22

(canceled)

### Claim 23

(canceled)

### Claim 24

(canceled)

### Claim 25 (depends on 1)

The method of claim 1, further comprising providing a functional cover movable to an area on the display of the user device, so that the functional cover masks a portion of the first text transcript in the target language or the second text transcript in the source language, wherein a movement of the functional cover causes the multimedia content to pause.

### Claim 26 (depends on 1)

The method of claim 1, further comprising:
providing one or more questions related to a content of the text transcript, wherein the content is a word, a phrase, a sentence, a grammatical rule or a combination of two or more thereof;
receiving a user input comprising answers to the one or more questions; and
determining the linguistic knowledge of the user based on the aggregate analysis of the received user input.

### Claim 27

(canceled)

### Claim 28

(canceled)

### Claim 29 (depends on 11)

The method of claim 11, further comprising:
displaying, upon receiving a user action to play the flashcard, a message that is an invitation of a practice to transcribe the audiovisual segment associated with the flashcard after a parameter of the flashcard exceeds a predetermined value; and
receiving a user input that is indicative of an acceptance or a rejection of the invitation the practice to transcribe the audiovisual segment.

### Claim 30

(canceled)

### Claim 31

(canceled)

### Claim 32 (depends on 29)

The method of claim 29, further comprising:
playing the audio component of the audiovisual segment and displaying the first text transcript in the target language upon determining that the user input is an acceptance of the invitation to transcribe the audiovisual segment; and
receiving and displaying a dictation from the user corresponding to the played audio component or the displayed first text transcript in the target language.

### Claim 33

(canceled)

### Claim 34

(canceled)

### Claim 35 (depends on 134)

The method of claim 134, further comprising:
receiving a taping action from the user on the display of the user device in response to a scene of the multimedia content, wherein the taping action from the user continues longer than a preset period of time; and
displaying a plurality of text transcripts in the target language that corresponds to the scene of the multimedia content while pausing the play of the multimedia content.

### Claim 36

(canceled)

### Claim 37

(canceled)

### Claim 38

A system for facilitating language learning, comprising:
a non-transitory, computer readable memory;
one or more processors; and
a computer-readable medium containing programming instructions that, when executed by the one or more processors, cause the system to:
present, on a display of a user device, a multimedia content comprising one or more audiovisual segments, wherein each of the audiovisual segments is associated with a sentence or a portion of the sentence;
provide, on the same display, a first text transcript in a target language and a second text transcript in a source language corresponding to the sentence or the portion of the sentence associated with each of the audiovisual segments;
receive one or more user responses from a user to the first text transcript in the target language associated with each of the audiovisual segments, wherein the user responses indicate the user's comprehension of the first text transcript in the target language;
determine a linguistic knowledge of the user based on an aggregate analysis of the received one or more user responses to the first text transcript in the target language, wherein the linguistic knowledge of the user is determined by a level of vocabulary or a mastery of a grammatical rule;
generate a language knowledge map based on the linguistic knowledge of the user, wherein the language knowledge map comprises a plurality of cells representing words, phrases or grammatical rules; and
display the language knowledge map on the user device.
