# US 2004/0017404 A1 · Graph-based visual navigation through logical processes

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2004/0017404 A1
- Document ID: US20040017404A1
- Status: Published application
- Kind: A1
- Application number: 10/427,410
- Filed: 2003-04-30
- Published: 2004-01-29
- Earliest claimed: 1999-04-06
- Assignees: Vergics Corporation
- Inventors: Rodica Schileru-Key
- Web page: https://patentgrep.com/patent/US20040017404A1

## CPC

- G06F 3/04815: Interaction with a metaphor-based environment or interaction object displayed as three-dimensional [3D], e.g. changing the user viewpoint with respect to the environment or object
- G06T 19/00: Manipulating three-dimensional [3D] models or images for computer graphics
- H04L 41/22: comprising specially adapted graphical user interfaces [GUI]
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)

## Abstract

A computer system and method of operation thereof are provided that allow interactive navigation and exploration of logical processes. The computer system employs a data architecture comprising a network of nodes connected by branches. Each node in the network represents a decision point in the process that allows the user to select the next step in the process and each branch in the network represents a step or a sequence of steps in the logical process. The network is constructed directly from the target logical process. Navigation data such as image frame sequences, stages in the logical process, and other related information are associated with the elements of the network. This establishes a direct relationship between steps in the process and the data that represent them. From such an organization, the user may tour the process, viewing the image sequences associated with each step and choosing among different steps at will.

## Claims

### Claim 1

A method of navigating logical processes, the method comprising:
generating a logical environment from a logical process, the logical environment comprising a plurality of nodes connected by branches, wherein each node represents a decision point in the logical process and each branch represents a step or a sequence of steps in the logical process;
displaying a graph of at least a portion of the nodes and branches of the logical environment in a first window of a display device of a computer;
displaying a visual representation of the logical process in a second window of the display device; and
allowing a user to navigate through the logical environment by entering navigation commands via at least one input device connected to the computer.

### Claim 2 (depends on 1)

The method of claim 1, wherein the logical environment further comprises a plurality of hotspots, wherein each hotspot represents a point of interest.

### Claim 3 (depends on 2)

The method of claim 2 further comprising:
receiving a query from the user;
finding one or more nodes, one or more branches, and/or one or more hotspots in the logical environment that represent an answer to the query; and
highlighting the answer on the graph displayed in the first window of the display device.

### Claim 4 (depends on 2)

The method of claim 2 further comprising:
detecting that the user has selected an arbitrary point in the logical environment;
jumping to a point in the logical process corresponding to the arbitrary point in the logical environment; and
displaying a visual representation of the logical process at the point in a window of the display device.

### Claim 5 (depends on 4)

The method of claim 4, wherein the arbitrary point is a node, a hotspot, or a point within a branch.

### Claim 6 (depends on 1)

The method of claim 1 further comprising:
associating multimedia content with at least a portion of the logical environment;
displaying a visual representation of the multimedia content as an element of the graph displayed in the first window of the display device;
detecting that the user has selected the visual representation of the multimedia content via the at least one input device; and
displaying the multimedia content in a window of the display device.

### Claim 7 (depends on 6)

The method of claim 6, wherein the multimedia content is displayed in a third window of the display device.

### Claim 8 (depends on 1)

The method of claim 1 further comprising:
linking a portion of the logical environment with another portion of the logical environment;
displaying a visual representation of the link as an element of the graph displayed in the first window of the display device;
detecting that the user has selected the visual representation of the link via the at least one input device; and
jumping to the other portion of the logical environment.

### Claim 9 (depends on 1)

The method of claim 1 further comprising:
associating a database query with a portion of the logical environment;
displaying a visual representation of the database query as an element of the graph displayed in the first window of the display device;
detecting that the user has selected the visual representation of the database query via the input device; and
executing the database query.

### Claim 10 (depends on 1)

The method of claim 1 further comprising:
associating multimedia content with a portion of the logical environment; and
displaying the multimedia content when the user navigates within a specified distance from that portion of the logical environment.

### Claim 11 (depends on 1)

The method of claim 1, wherein each node in the logical environment is configured to be contractible.

### Claim 12 (depends on 1)

The method of claim 1, wherein each node in the logical environment is configured to be expandable.

### Claim 13 (depends on 1)

The method of claim 1 further comprising:
associating each element in the logical environment with a unique identifier; and
enabling the user to search for an element in the logical environment using the unique identifier of the element.

### Claim 14 (depends on 1)

The method of claim 1 wherein the logical process is represented by a plurality of disjointed graphs, wherein at least two of the disjointed graphs are logically connected.

### Claim 15

A computer system for navigating logical processes, the computer system comprising:
a computer;
a display device connected to the computer;
one or more input devices connected to the computer; and
a computer program executing on the computer, wherein the computer program comprises computer instructions for:
generating a logical environment from a logical process, the logical environment comprising a plurality of nodes connected by branches, wherein each node represents a decision point in the logical process and each branch represents a step or a sequence of steps in the logical process;
displaying a graph of at least a portion of the nodes and branches of the logical environment in a first window of the display device;
displaying a visual representation of the logical process in a second window of the display device; and
allowing a user to navigate through the logical environment by entering navigation commands via the one or more input devices.

### Claim 16 (depends on 14)

The computer system of claim 14, wherein the logical environment further comprises a plurality of hotspots, wherein each hotspot represents a point of interest.

### Claim 17 (depends on 16)

The computer system of claim 16, wherein the computer program further comprises computer instructions for:
receiving a query from the user;
finding one or more nodes, one or more branches, and/or one or more hotspots in the logical environment that represent an answer to the query; and
highlighting the answer on the graph displayed in the first window of the display device.

### Claim 18 (depends on 16)

The computer system of claim 16, wherein the computer program further comprises computer instructions for:
detecting that the user has selected an arbitrary point in the logical environment;
jumping to a point in the logical process corresponding to the arbitrary point in the logical environment; and
displaying a visual representation of the logical process at the point in a window of the display device.

### Claim 19 (depends on 18)

The computer system of claim 18, wherein the arbitrary point is a node, a hotspot, or a point within a branch.

### Claim 20 (depends on 15)

The computer system of claim 15, wherein the computer program further comprises computer instructions for:
associating multimedia content with at least a portion of the logical environment;
displaying a visual representation of the multimedia content as an element of the graph displayed in the first window of the display device;
detecting that the user has selected the visual representation of the multimedia content via the at least one input device; and
displaying the multimedia content in a window of the display device.

### Claim 21 (depends on 20)

The computer system of claim 20, wherein the multimedia content is displayed in a third window of the display device.

### Claim 22 (depends on 15)

The computer system of claim 15, wherein the computer program further comprises computer instructions for:
linking a portion of the logical environment with another portion of the logical environment;
displaying a visual representation of the link as an element of the graph displayed in the first window of the display device;
detecting that the user has selected the visual representation of the link via the at least one input device; and
jumping to the other portion of the logical environment.

### Claim 23 (depends on 15)

The computer system of claim 15, wherein the computer program further comprises computer instructions for:
associating a database query with a portion of the logical environment;
displaying a visual representation of the database query as an element of the graph displayed in the first window of the display device;
detecting that the user has selected the visual representation of the database query via the input device; and
executing the database query.

### Claim 24 (depends on 15)

The computer system of claim 15, wherein the computer program further comprises computer instructions for:
associating multimedia content with a portion of the logical environment; and
displaying the multimedia content when the user navigates within a specified distance from that portion of the logical environment.

### Claim 25 (depends on 15)

The computer system of claim 15, wherein each node in the logical environment is configured to be contractible.

### Claim 26 (depends on 15)

The computer system of claim 15, wherein each node in the logical environment is configured to be expandable.

### Claim 27 (depends on 15)

The computer system of claim 15, wherein the computer program further comprises computer instructions for:
associating each element in the logical environment with a unique identifier; and
enabling the user to search for an element in the logical environment using the unique identifier of the element.

### Claim 28 (depends on 15)

The computer system of claim 15 wherein the logical process is represented by a plurality of disjointed graphs, wherein at least two of the disjointed graphs are logically connected.
