# US 2019/0173690 A1 · Simultaneously rendering an image stream of static graphic images and a corresponding audio stream

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0173690 A1
- Document ID: US20190173690A1
- Status: Published application
- Kind: A1
- Application number: 16/267,550
- Filed: 2019-02-05
- Published: 2019-06-06
- Earliest claimed: 2005-12-13
- Assignees: Audi Pod Inc.
- Applicants: Audio Pod Inc.
- Inventors: John McCue; Robert McCue; Gregory Shostakovsky; Glenn McCue
- Web page: https://patentgrep.com/patent/US20190173690A1

## CPC

- H04L 12/4633: {Interconnection of networks using encapsulation techniques, e.g. tunneling}
- G06F 9/45558: {Hypervisor-specific management and integration aspects}
- H04L 41/0668: by dynamic selection of recovery network elements, e.g. replacement by the most appropriate element after failure
- H04L 41/0836: {to enhance reliability, e.g. reduce downtime}
- H04L 41/0895: Configuration of virtualised networks or elements, e.g. virtualised network function or OpenFlow elements
- H04L 41/40: using virtualisation of network functions or resources, e.g. SDN or NFV entities
- H04L 43/08: Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters
- H04L 43/0811: by checking connectivity
- H04L 43/20: the monitoring system or the monitored elements being virtualised, abstracted or software-defined entities, e.g. SDN or NFV
- H04L 45/74: Address processing for routing
- H04L 67/10: in which an application is distributed across nodes in the network (software deployment G06F8/60; multiprogramming arrangements G06F9/46)
- H04L 69/22: Parsing or analysis of headers
- G06F 2009/45579: {I/O management, e.g. providing access to device drivers or storage}
- G06F 2009/45595: {Network integration; Enabling network access in virtual machine instances}
- H04L 43/0817: by checking functioning
- H04L 43/0829: Packet loss
- H04L 43/0852: Delays
- H04L 43/0864: Round trip delays
- H04L 43/0876: Network utilisation, e.g. volume of load or congestion level
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

An image stream of static graphic images and a corresponding audio stream (e.g., a comic book image stream and an audio narration stream) are simultaneously rendered. One or more images from the image stream, which are each associated with time information relative to a timeline of the audio stream, are downloaded to the client device. A page is assembled from the images and is assigned time information relative to the timeline of the audio stream on the basis of the time information for the images. A portion of the audio stream including a time offset corresponding to a position on the page is downloaded to the client device. The page and the portion of the audio stream are simultaneously rendered on the client device by using the time information for the images or for the page, the portion of the audio stream being rendered in dependence upon the time offset.

## Claims

### Claim 1

A method comprising:
accessing, by a client device, a network accessible library having stored thereon an image stream of static graphic images and a corresponding audio stream;
downloading to the client device from the network accessible library one or more static graphic images from the image stream, wherein the one or more static graphic images are each associated with time information including at least one of a start time, an end time, and a duration relative to a timeline of the audio stream;
assembling, by the client device, a first page from the one or more static graphic images;
assigning to the first page, by the client device, time information including at least one of a start time, an end time, and a duration relative to the timeline of the audio stream, wherein the time information for the first page is determined on the basis of the time information for the one or more static graphic images;
downloading to the client device from the network accessible library a portion of the audio stream including a first time offset, wherein the first time offset corresponds to a first position on the first page; and
simultaneously rendering the first page and the portion of the audio stream on the client device by using the time information for the one or more static graphic images or for the first page, wherein the portion of the audio stream is rendered in dependence upon the first time offset.

### Claim 2 (depends on 1)

The method of claim 1, wherein the network accessible library includes one or more server devices.

### Claim 3 (depends on 1)

The method of claim 1, wherein the number of the one or more static graphic images included on the first page is determined on the basis of the size of the one or more static graphic images and the graphic rendering capability of the client device.

### Claim 4 (depends on 1)

The method of claim 1, wherein the first time offset is a start time of the first page, a start time of one of the one or more static graphic images, or a bookmarked position.

### Claim 5 (depends on 1)

The method of claim 1, further comprising:
assembling a second page from the one or more static graphic images; and
assigning to the second page time information including at least one of a start time, an end time, and a duration relative to the timeline of the audio stream, wherein the time information for the second page is determined on the basis of the time information for the one or more static graphic images.

### Claim 6 (depends on 5)

The method of claim 5, further comprising:
automatically turning from the first page to the second page in dependence upon the time information for the first page or for the second page as the portion of the audio stream is rendered.

### Claim 7 (depends on 6)

The method of claim 6, wherein the portion of the audio stream is rendered without any perceptible interruption.

### Claim 8 (depends on 1)

The method of claim 1, further comprising:
setting a second time offset as a bookmarked position, wherein the second time offset corresponds to a second position on the first page or a position in the timeline of the audio stream.

### Claim 9 (depends on 8)

The method of claim 8, further comprising:
transmitting the bookmarked position to a network accessible server device or a second other client device.

### Claim 10 (depends on 1)

The method of claim 1, wherein the time information for the one or more static graphic images is external to the audio stream.

### Claim 11 (depends on 10)

The method of claim 10, wherein the time information for the one or more static graphic images is stored in a descriptor file.

### Claim 12 (depends on 1)

The method of claim 1, wherein the one or more static graphic images contain elements that form text characters when rendered.

### Claim 13 (depends on 12)

The method of claim 12, further comprising:
rendering on the first page one or more text passages representing the text characters formed by the elements in the one or more static graphic images; and
assigning to each of the one or more text passages time information including at least one of a start time, an end time, and a duration relative to the timeline of the audio stream, wherein the time information for each text passage is determined on the basis of the time information for the one or more static graphic images.

### Claim 14 (depends on 13)

The method of claim 13, wherein only a portion of a first text passage associated with a first static graphic image is rendered on the first page.

### Claim 15 (depends on 14)

The method of claim 14, wherein a remaining portion of the first text passage is rendered on a second page, wherein the first static graphic image is replicated on the second page in association with the remaining portion of the first text passage, and wherein the second page is repaginated.

### Claim 16

A non-transitory computer-readable storage medium having stored thereon instructions which, when executed by a processor of a computing device, cause the computing device to:
access a network accessible library having stored thereon an image stream of static graphic images and a corresponding audio stream;
download from the network accessible library one or more static graphic images from the image stream, wherein the one or more static graphic images are each associated with time information including at least one of a start time, an end time, and a duration relative to a timeline of the audio stream;
assemble a first page from the one or more static graphic images;
assign to the first page time information including at least one of a start time, an end time, and a duration relative to the timeline of the audio stream, wherein the time information for the first page is determined on the basis of the time information for the one or more static graphic images;
download from the network accessible library a portion of the audio stream including a first time offset, wherein the first time offset corresponds to a first position on the first page; and
simultaneously render the first page and the portion of the audio stream by using the time information for the one or more static graphic images or for the first page, wherein the portion of the audio stream is rendered in dependence upon the first time offset.