# US 12,010,386 B2 · System and method for providing digital graphics and associated audiobooks

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 12,010,386 B2
- Document ID: US12010386B2
- Status: Granted
- Kind: B2
- Application number: 17/738,589
- Filed: 2022-05-06
- Published: 2022-11-10
- Granted: 2024-06-11
- Earliest claimed: 2021-05-06
- Applicants: Anthony Palmer
- Inventors: Anthony Palmer
- Web page: https://patentgrep.com/patent/US12010386B2

## CPC

- H04N 21/47202: {for requesting content on demand, e.g. video on demand}
- H04N 21/8146: {involving graphical data, e.g. 3D object, 2D graphics}
- G06F 3/165: {Management of the audio stream, e.g. setting of volume, audio stream path}
- H04N 21/2543: Billing {, e.g. for subscription services (payment schemes, architectures or protocols G06Q20/00; e-commerce G06Q30/00; arrangements for billing for the use of broadcast information or broadcast-related information H04H60/21)}
- H04N 21/4394: {involving operations for analysing the audio stream, e.g. detecting features or characteristics in audio streams (arrangements characterised by components specially adapted for monitoring, identification or recognition of audio in broadcast systems H04H60/58)}
- H04N 21/47217: {for controlling playback functions for recorded or on-demand content, e.g. using progress bars, mode or play-point indicators or bookmarks (specific graphical features in visual interfaces H04N21/4312)}
- H04N 21/8106: {involving special audio data, e.g. different tracks for different languages}
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

The present invention relates to a system and method for providing digital media such as comics with associated audio files such as audiobooks. The digital media and audio are provided using a computer-implemented application and a website. The system includes a server with associated databases for digitizing physical copies of comics and other graphical content, and creating audio files by using text to speech and natural language processing and storing digital comics and audiobooks. A media player displays digital comics and an audio player plays out audio files in synchronized manner allowing people to listen to comics without having to read the textual content contained in the digital media file.

## Claims

### Claim 1

A system for providing graphical media and associated audio, the comprising:
a server having at least one processor;
a non-transitory computer-readable storage medium having executable instructions;
a controller connected to the at least one processor, the controller configured for presenting one or more graphical user interfaces;
a scanner configured to convert a plurality of comics, each comic having a plurality of comic characters, into a graphical media file for each comic, wherein each graphical media file is associated with a unique identifier for searching using the unique identifier;
a text to speech module configured to select and utilize a plurality of voice prints from a library for producing an audio file for a transcript of each comic, wherein the audio file is associated with the unique identifier and the plurality of voice prints includes a unique voice print for each character of each comic for audible recognition of each comic character; and
wherein the text to speech module utilizes a natural language processor to extract a plurality of literary elements selected from the group of a plot element, an annotation, a character's emotion, and an inflection in each comic to produce a mood and an attitude of each comic character during streaming of each comic; and
a first database for storing a plurality of graphical media files and a second database for storing a plurality of audio files, wherein each of the graphical media files and audio files has a code.

### Claim 2 (depends on 1)

The system as recited in claim 1, wherein each code of each file in the graphical media files is matched to a code of an audio file in the database of audio files.

### Claim 3 (depends on 1)

The system as recited in claim 1 further comprising a smart device having a downloaded software application for connecting to the server.

### Claim 4 (depends on 3)

The system as recited in claim 3, wherein the smart device uses a communication module to connect to the server or an internet site.

### Claim 5 (depends on 1)

The system as recited in claim 1 further comprising a mapping module to map a graphical media file to an audiobook file.

### Claim 6 (depends on 1)

The system as recited in claim 1, wherein the graphical media files contains graphics for comics or manga book.

### Claim 7 (depends on 1)

The system as recited in claim 1 further comprising a user input device for making a selection of graphical media and audio.

### Claim 8 (depends on 1)

The system as recited in claim 1 further comprising a billing database for containing information relating to a subscriber.

### Claim 9 (depends on 1)

The system as recited in claim 1 further comprising an audio media player and a digital media player.

### Claim 10

A method for requesting digital media and audio media files, the method comprising the steps of:
providing a first database having a plurality of digital media files;
providing a second database having a plurality of audio files;
linking each of the digital media files with one of the plurality of audio files;
requesting at least one digital media file;
associating at least one audio file with the at least one digital media file; and
transmitting the at least one audio file and the at least one digital file to a subscriber; and
wherein each of the plurality of digital media files is a comic scanned and converted into a graphical media file, wherein each of the graphical media file is associated with a unique identifier for searching using the unique identifier; and
wherein each of the plurality of audio files associated the unique identifier is generated from the respective digital media file via a text to speech module converting a transcript of the comic into the respective audio file, and wherein the transcript is converted into the respective audio file using the plurality of voice prints and includes a unique voice print for each character of the comic for audible recognition of each comic character; and
wherein the text to speech module utilizes a natural language processor to extract a plurality of literary elements selected from the group of a plot element, an annotation, a character's emotion, and an inflection in the comic to produce a mood and an attitude of the comic character during streaming of the comic.

### Claim 11 (depends on 10)

The method as recited in claim 10 further comprising a step of providing a user interface device after the step of providing a first database.

### Claim 12 (depends on 10)

The method as recited in claim 10 further comprising a step of providing a billing database for containing information about the subscriber.

### Claim 13 (depends on 10)

The method as recited in claim 10 further comprising a step of storing correspondence relating to the at least one audio file and the at least one digital file after the step of requesting.

### Claim 14 (depends on 10)

The method as recited in claim 10 further comprising a step of displaying the at least one media file after the step of transmitting.

### Claim 15

A method of using a system for retrieving digital media and audio media, the method comprising the steps of:
providing a system having a digital media database having comic and manga file, an audio media database and a billing database;
scanning a comic into the digital media database associated with a unique identifier for searching the unique identifier;
generating an audio file from a transcript of the comic via a text to speech module that produces an audio representation of the comic, and wherein the text to speech module utilizes a natural language processor to extract a plurality of literary elements selected from the group of a plot element, an annotation, a character's emotion, and an inflection in the comic to produce a mood and an attitude of the comic character during streaming of the comic;
creating a subscription and accessing the billing database by a subscriber;
requesting at least one digital media and at least one audio media;
associating the at least one digital media and the at least one audio media by a code;
retrieving the at least one digital media and at least one audio media;
selecting a plurality of voice prints from a voice print library for the at least one audio media associated with the unique identifier, wherein the plurality of voice prints includes a unique voice print for each character of the comic for audible recognition of each comic character;
transmitting the at least one digital media and at least one audio media to the subscriber; and
displaying the at least one digital media and playing the at least one audio file in the selected voice print.

### Claim 16 (depends on 15)

The method as recited in claim 15 further comprising a step of selecting a subscription plan after the step of creating a subscription.

### Claim 17 (depends on 15)

The method as recited in claim 15, wherein the step of displaying the at least one digital media is done on a media player and the audio file is played on an audio player.

### Claim 18 (depends on 15)

The method as recited in claim 15 further comprising a step of providing a user input device connected to a communication module after the step of providing a system.