# US 12,190,752 B2 · System and method for dual mode presentation of content in a target language to improve listening fluency in the target language

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 12,190,752 B2
- Document ID: US12190752B2
- Status: Granted
- Kind: B2
- Application number: 17/962,062
- Filed: 2022-10-07
- Published: 2023-02-16
- Granted: 2025-01-07
- Earliest claimed: 2019-04-09
- Assignees: Jiveworld, Spc
- Applicants: Jiveworld, SPC
- Inventors: Daniel Paul Raynaud
- Web page: https://patentgrep.com/patent/US12190752B2

## CPC

- G09B 5/06: with both visual and audible presentation of the material to be studied
- G09B 19/06: Foreign languages (with audible presentation of material to be studied G09B5/04)
- G10L 21/10: Transforming into visible information
- G09B 19/04: Speaking (with audible presentation of the material to be studied G09B5/04)
- G10L 15/08: Speech classification or search
- G10L 15/26: Speech to text systems (G10L15/08 takes precedence)
- G10L 2015/088: {Word spotting}
- H04N 21/4394: {involving operations for analysing the audio stream, e.g. detecting features or characteristics in audio streams (arrangements characterised by components specially adapted for monitoring, identification or recognition of audio in broadcast systems H04H60/58)}
- H04N 21/4542: {Blocking scenes or portions of the received content, e.g. censoring scenes}
- G09B: EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS (devices for psychotechnics or for testing reaction times A61B5/16; games, sports, amusements A63; projectors, projector screens G03B)
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

Embodiments of a language learning system and method for implementing or assisting in self-study for improving listening fluency in a target language are disclosed. Such embodiments may simultaneously present the same piece of content in an auditory presentation and a corresponding visual presentation of a transcript of the auditory presentation, where the two presentations are adapted to work in tandem to increase the effectiveness of language learning for users.

## Claims

### Claim 1

A system for language learning, comprising:
a processor; and
a non-transitory computer readable medium comprising instructions to:
obtain an audio file and a corresponding transcript and timing file, the transcript and timing file comprising words of a transcript of content of the audio file;
auditorily present the content of the audio file;
simultaneously with the auditory presentation of the content of the audio file, generate an interface using the transcript and timing file, the interface including a visual display, the visual display synchronized with the auditory presentation of the content and presenting a visual transcript of the content in a target language, wherein:
the visual transcript includes a visual transcript of a set of characters comprising the content,
the visual transcript of the set of characters includes a redacted character, and
the redacted character is redacted by presenting a corresponding lozenge for the redacted character in the visual display, wherein a visual appearance of the corresponding lozenge for the redacted character communicates a structure or expression of the redacted character, and synchronizing the visual display of the visual transcript of the content with the auditory presentation of the content comprises:
determining that the redacted character is being presented in the auditory presentation of the content;
highlighting the presentation of the corresponding lozenge of the redacted character in the visual display substantially simultaneously with the auditory presentation of that character in the auditory presentation.

### Claim 2 (depends on 1)

The system of claim 1, wherein the structure or expression is a number of syllables of the character.

### Claim 3 (depends on 2)

The system of claim 2, wherein the lozenge comprises at least one embedded dot corresponding to the number of syllables of the character.

### Claim 4 (depends on 1)

The system of claim 1, wherein the structure or expression comprises a class of the redacted character.

### Claim 5 (depends on 4)

The system of claim 4, wherein a color of the lozenge indicates the class of the redacted character.

### Claim 6 (depends on 5)

The system of claim 5, wherein the class of the redacted character is a kanji, a hiragana, a katakana, or a romaji.

### Claim 7 (depends on 1)

The system of claim 1, wherein the redacted character is an alphabetic character that comprises an alphabetic font, and wherein a vertical height of the lozenge corresponds to a distance between a baseline and a mean line of the alphabetic font.

### Claim 8

A method for language learning, comprising:
obtaining an audio file and a corresponding transcript and timing file, the transcript and timing file comprising words of a transcript of content of the audio file;
auditorily present the content of the audio file;
simultaneously with the auditory presentation of the content of the audio file, generating an interface at an electronic device using the transcript and timing file, the interface including a visual display, the visual display synchronized with the auditory presentation of the content and presenting a visual transcript of the content in a target language, wherein:
the visual transcript includes a visual transcript of a set of characters comprising the content,
the visual transcript of the set of characters includes a redacted character, and
the redacted character is redacted by presenting a corresponding lozenge for the redacted character in the visual display, wherein a visual appearance of the corresponding lozenge for the redacted character communicates a structure or expression of the redacted character, and synchronizing the visual display of the visual transcript of the content with the auditory presentation of the content comprises:
determining that the redacted character is being presented in the auditory presentation of the content; and
highlighting the presentation of the corresponding lozenge of the redacted character in the visual display substantially simultaneously with the auditory presentation of that character in the auditory presentation.

### Claim 9 (depends on 8)

The method of claim 8, wherein the structure or expression is a number of syllables of the character.

### Claim 10 (depends on 9)

The method of claim 9, wherein the lozenge comprises at least one embedded dot corresponding to the number of syllables of the character.

### Claim 11 (depends on 8)

The method of claim 8, wherein the structure or expression comprises a class of the redacted character.

### Claim 12 (depends on 11)

The method of claim 11, wherein a color of the lozenge indicates the class of the redacted character.

### Claim 13 (depends on 12)

The method of claim 12, wherein the class of the redacted character is a kanji, a hiragana, a katakana, or a romaji.

### Claim 14 (depends on 8)

The method of claim 8, wherein the redacted character is an alphabetic character that comprises an alphabetic font, and wherein a vertical height of the lozenge corresponds to a distance between a baseline and a mean line of the alphabetic font.

### Claim 15

A non-transitory computer readable medium, comprising instructions for:
obtaining an audio file and a corresponding transcript and timing file, the transcript and timing file comprising words of a transcript of content of the audio file;
auditorily present the content of the audio file;
simultaneously with the auditory presentation of the content of the audio file, generating an interface at an electronic device using the transcript and timing file, the interface including a visual display, the visual display synchronized with the auditory presentation of the content and presenting a visual transcript of the content in a target language, wherein:
the visual transcript includes a visual transcript of a set of characters comprising the content,
the visual transcript of the set of characters includes a redacted character, and
the redacted character is redacted by presenting a corresponding lozenge for the redacted character in the visual display, wherein a visual appearance of the corresponding lozenge for the redacted character communicates a structure or expression of the redacted character, and synchronizing the visual display of the visual transcript of the content with the auditory presentation of the content comprises:
determining that the redacted character is being presented in the auditory presentation of the content; and
highlighting the presentation of the corresponding lozenge of the redacted character in the visual display substantially simultaneously with the auditory presentation of that character in the auditory presentation.

### Claim 16 (depends on 15)

The non-transitory computer readable medium of claim 15, wherein the structure or expression is a number of syllables of the character.

### Claim 17 (depends on 16)

The non-transitory computer readable medium of claim 16, wherein the lozenge comprises at least one embedded dot corresponding to the number of syllables of the character.

### Claim 18 (depends on 15)

The non-transitory computer readable medium of claim 15, wherein the structure or expression comprises a class of the redacted character.

### Claim 19 (depends on 18)

The non-transitory computer readable medium of claim 18, wherein a color of the lozenge indicates the class of the redacted character.

### Claim 20 (depends on 19)

The non-transitory computer readable medium of claim 19, wherein the class of the redacted character is a kanji, a hiragana, a katakana, or a romaji.

### Claim 21 (depends on 15)

The non-transitory computer readable medium of claim 15, wherein the redacted character is an alphabetic character that comprises an alphabetic font, and wherein a vertical height of the lozenge corresponds to a distance between a baseline and a mean line of the alphabetic font.