# US 2025/0147639 A1 · Method and system for interactive navigation of media frames

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0147639 A1
- Document ID: US20250147639A1
- Status: Published application
- Kind: A1
- Application number: 18/504,119
- Filed: 2023-11-07
- Published: 2025-05-08
- Earliest claimed: 2023-11-07
- Assignees: Global Publishing Interactive, Inc.
- Applicants: Global Publishing Interactive, Inc.
- Inventors: Robert Hoffer; Christopher Carter; Shaun Rowan
- Web page: https://patentgrep.com/patent/US20250147639A1

## CPC

- G06F 3/0483: Interaction with page-structured environments, e.g. book metaphor
- G06F 40/30: Semantic analysis
- G06T 7/11: Region-based segmentation
- G06T 7/13: Edge detection
- G06T 2207/20081: Training; Learning
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

Methods and systems are provided for automatic, adaptive navigation of digital comic book frames. A frame image of a comic book may include one or more discrete panels. The frame image can be parsed using a first machine-learning model to derive visual features associated with the frame image and a second machine-learning model to derive contextual information associated with words appearing in each panel. A frame configuration can be defined that defines a transition for navigating between a sequence of views of the frame image, where each view corresponds to a panel or a portion thereof.

## Claims

### Claim 1

A method comprising:
receiving a frame image including one or more panels;
executing a first machine-learning model using the frame image, wherein the first machine-learning model segments the frame image into one or more image regions;
executing a second machine-learning model using the frame image, wherein the second machine-learning model identifies a context associated with alphanumeric text positioned within the one or more panels;
generating a frame configuration using the frame image, the one or more image regions, and the context corresponding to the one or more panels, wherein the frame configuration identifies a sequence of views to present the frame image, wherein each view of the sequence of views corresponds to a panel of the one or more panels or a portion thereof; and
facilitating execution of the frame configuration causing a presentation of a first view of the sequence of views.

### Claim 2 (depends on 1)

The method of claim 1, wherein the first machine-learning model performs edge detection to identify each panel of the one or more panels.

### Claim 3 (depends on 1)

The method of claim 1, wherein the first machine-learning model uses the one or more image regions to determine a presentation order of the one or more panels.

### Claim 4 (depends on 1)

The method of claim 1, wherein the second machine-learning model uses the context corresponding to the alphanumeric text to define a presentation order of the one or more panels.

### Claim 5 (depends on 1)

The method of claim 1, further comprising:
detecting a navigation command associated with the presentation of a first view of the sequence of views; and
presenting a subsequent view of the sequence of views based on the navigation command.

### Claim 6 (depends on 5)

The method of claim 5, wherein the navigation command is defined based on one of: a voice command, a gesture, device motion, eye movement, device input, or time.

### Claim 7 (depends on 5)

The method of claim 5, further comprising:
modifying the frame configuration based on the navigation command, wherein modifying the frame configuration includes adjusting a transition between views of the sequence of views that are remaining.

### Claim 8

A system comprising:
one or more processors;
a non-transitory computer-readable medium storing instructions that when executed by the one or more processors, cause the one or more processors to perform operations including:
receiving a frame image including one or more panels;
executing a first machine-learning model using the frame image, wherein the first machine-learning model segments the frame image into one or more image regions;
executing a second machine-learning model using the frame image, wherein the second machine-learning model identifies text and a context corresponding to the one or more panels;
generating a frame configuration using the frame image, the one or more image regions, and the context corresponding to the one or more panels, wherein the frame configuration identifies a sequence of views to present the frame image, wherein each view of the sequence of views corresponds to a panel of the one or more panels or a portion thereof; and
facilitating execution of the frame configuration causing a presentation of a first view of the sequence of views.

### Claim 9 (depends on 8)

The system of claim 8, wherein the first machine-learning model performs edge detection to identify each panel of the one or more panels.

### Claim 10 (depends on 8)

The system of claim 8, wherein the first machine-learning model uses the one or more image regions to determine a presentation order of the one or more panels.

### Claim 11 (depends on 8)

The system of claim 8, wherein the second machine-learning model uses the context corresponding to the alphanumeric text to define a presentation order of the one or more panels.

### Claim 12 (depends on 8)

The system of claim 8, wherein the operations further include:
detecting a navigation command associated with the presentation of a first view of the sequence of views; and
presenting a subsequent view of the sequence of views based on the navigation command.

### Claim 13 (depends on 12)

The system of claim 12, wherein the navigation command is defined based on one of: a voice command, a gesture, device motion, eye movement, device input, or time.

### Claim 14 (depends on 12)

The system of claim 12, wherein the operations further include:
modifying the frame configuration based on the navigation command, wherein modifying the frame configuration includes adjusting a transition between views of the sequence of views that are remaining.

### Claim 15

A non-transitory computer-readable medium storing instructions that when executed by one or more processors, cause the one or more processors to perform operations including:
receiving a frame image including one or more panels;
executing a first machine-learning model using the frame image, wherein the first machine-learning model segments the frame image into one or more image regions;
executing a second machine-learning model using the frame image, wherein the second machine-learning model identifies a context associated with text positioned within the one or more panels;
generating a frame configuration using the frame image, the one or more image regions, and the context corresponding to the one or more panels, wherein the frame configuration identifies a sequence of views to present the frame image, wherein each view of the sequence of views corresponds to a panel of the one or more panels or a portion thereof; and
facilitating execution of the frame configuration causing a presentation of a first view of the sequence of views.

### Claim 16 (depends on 15)

The non-transitory computer-readable medium of claim 15, wherein the first machine-learning model performs edge detection to identify each panel of the one or more panels.

### Claim 17 (depends on 15)

The non-transitory computer-readable medium of claim 15, wherein the first machine-learning model uses the one or more image regions to determine a presentation order of the one or more panels.

### Claim 18 (depends on 15)

The non-transitory computer-readable medium of claim 15, wherein the operations further include:
detecting a navigation command associated with the presentation of a first view of the sequence of views; and
presenting a subsequent view of the sequence of views based on the navigation command.

### Claim 19 (depends on 18)

The non-transitory computer-readable medium of claim 18, wherein the navigation command is defined based on one of: a voice command, a gesture, device motion, eye movement, device input, or time.

### Claim 20 (depends on 18)

The non-transitory computer-readable medium of claim 18, wherein the operations further include:
modifying the frame configuration based on the navigation command, wherein modifying the frame configuration includes adjusting a transition between views of the sequence of views that are remaining.
