# US 2018/0025659 A1 · Electronic Manual with Cross-Linked Text and Virtual Models

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2018/0025659 A1
- Document ID: US20180025659A1
- Status: Published application
- Kind: A1
- Application number: 15/655,627
- Filed: 2017-07-20
- Published: 2018-01-25
- Earliest claimed: 2016-07-22
- Assignees: Sharp Vision Software LLC
- Applicants: Sharp Vision Software, LLC
- Inventors: Win Liu
- Web page: https://patentgrep.com/patent/US20180025659A1

## CPC

- G09B 5/065: {Combinations of audio and video presentations, e.g. videotapes, videodiscs, television systems}
- G06F 3/04815: Interaction with a metaphor-based environment or interaction object displayed as three-dimensional [3D], e.g. changing the user viewpoint with respect to the environment or object
- G06F 3/0483: Interaction with page-structured environments, e.g. book metaphor
- G06F 3/04845: for image manipulation, e.g. dragging, rotation, expansion or change of colour
- G06F 40/103: Formatting, i.e. changing of presentation of documents (automatic justification G06F40/189; automatic line break hyphenation G06F40/191)
- G06F 40/134: Hyperlinking
- G06T 19/20: Editing of three-dimensional [3D] images, e.g. changing shapes or colours, aligning objects or positioning parts
- G09B 19/0053: {Computers, e.g. programming}
- G09B 25/02: of industrial processes; of machinery
- G06F 2203/04806: Zoom, i.e. interaction techniques or interactors for controlling the zooming operation
- G06T 2219/2012: Colour editing, changing, or manipulating; Use of colour codes
- G09B: EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS (devices for psychotechnics or for testing reaction times A61B5/16; games, sports, amusements A63; projectors, projector screens G03B)
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

A method of providing an electronic manual with three-dimensional (3D) virtual models includes instructions executed by a processor and includes retrieving an electronic manual from a memory device and displaying the electronic manual on a display interface of a display device, where the electronic manual includes a textual instruction section and a virtual model section and where the virtual model section includes a 3D virtual model of an object. The method includes receiving, by a user interface of the display device, a user input selecting a linked text displayed in the textual instruction section, identifying a component of the object in the 3D virtual model that is linked to the linked text, and highlighting, in response to identifying the component of the object in the 3D virtual model, the component of the object in the 3D virtual model displayed on display interface of the display device.

## Claims

### Claim 1

A non-transitory computer-readable medium comprising instructions that when executed by a processor display an electronic manual on a display interface of a display device, the instructions comprising:
retrieving an electronic manual from a memory device;
displaying the electronic manual on a display interface of a display device, the electronic manual comprising a textual instruction section and a virtual model section, wherein the virtual model section includes a 3D virtual model of an object;
receiving from an input interface device a user input selecting a linked text displayed in the textual instruction section;
identifying, in response to receiving the user input selecting the linked text, a component of the object in the 3D virtual model that is linked to the linked text; and
highlighting, in response to identifying the component of the object in the 3D virtual model, the component of the object in the 3D virtual model displayed on display interface of the display device.

### Claim 2 (depends on 1)

The non-transitory computer-readable medium of claim 1, wherein the instructions further comprise highlighting the linked text in response to identifying the component of the object in the 3D virtual model.

### Claim 3 (depends on 1)

The non-transitory computer-readable medium of claim 1, wherein the instructions further comprise:
receiving from a input interface device a second user input selecting the component of the object in the 3D virtual model;
identifying, in response to receiving the second user input selecting the component of the object in the 3D virtual model, a linked text in the textual instruction section that is linked to the component of the object in the 3D virtual model; and
highlighting the linked text in the textual instruction section in response to identifying the linked text in the textual instruction section.

### Claim 4 (depends on 1)

The non-transitory computer-readable medium of claim 1, wherein the instructions further comprise highlighting multiple occurrences of the linked text in the textual instruction section displayed on the display interface of the display device.

### Claim 5 (depends on 1)

The non-transitory computer-readable medium of claim 1, wherein the instructions further comprise rotating the object in the 3D virtual model in response to identifying the component of the object in the 3D virtual model.

### Claim 6 (depends on 5)

The non-transitory computer-readable medium of claim 5, wherein the instructions further comprise displaying a zoomed in view of the component of the object in the 3D virtual model in response to identifying the component of the object in the 3D virtual model.

### Claim 7 (depends on 1)

The non-transitory computer-readable medium of claim 1, wherein the instructions further comprise tilting the object in the 3D virtual model in response to identifying the component of the object in the 3D virtual model.

### Claim 8 (depends on 1)

The non-transitory computer-readable medium of claim 1, wherein the textual instruction section includes operating instructions related to the object and wherein the operating instructions include the linked text.

### Claim 9 (depends on 8)

The non-transitory computer-readable medium of claim 8, wherein the linked text includes a name of the component.

### Claim 10

A method of providing an electronic manual with three-dimensional (3D) virtual models, the method performed by a computer-readable modeling engine comprising instructions executed by a processor, the method comprising:
retrieving, by the computer-readable modeling engine, an electronic manual from a memory device;
displaying, by the computer-readable modeling engine, the electronic manual on a display interface of a display device, the electronic manual comprising a textual instruction section and a virtual model section, wherein the virtual model section includes a 3D virtual model of an object;
receiving, by a user interface of the display device, a user input selecting a linked text displayed in the textual instruction section;
identifying, by the computer-readable modeling engine, in response to receiving the user input selecting the linked text, a component of the object in the 3D virtual model that is linked to the linked text; and
highlighting, by the computer-readable modeling engine, in response to identifying the component of the object in the 3D virtual model, the component of the object in the 3D virtual model displayed on display interface of the display device.

### Claim 11 (depends on 10)

The method of claim 10, wherein the linked text includes a name of the component.

### Claim 12 (depends on 10)

The method of claim 10, further comprising rotating the object in response to the user input selecting the linked text.

### Claim 13 (depends on 12)

The method of claim 12, further comprising providing a zoomed in view of the object in response to receiving the user input selecting the linked text.

### Claim 14 (depends on 10)

The method of claim 10, further comprising tilting the object in response to receiving the user input selecting the linked text.

### Claim 15 (depends on 10)

The method of claim 10, further comprising highlighting multiple occurrences of the linked text in response to receiving the user input selecting the linked text.

### Claim 16

A method of providing an electronic manual with three-dimensional (3D) virtual models, the method performed by a computer-readable modeling engine comprising instructions executed by a processor, the method comprising:
retrieving, by the computer-readable modeling engine, an electronic manual from a memory device;
displaying, by the computer-readable modeling engine, the electronic manual on a display interface of the display device, the electronic manual comprising a textual instruction section and a virtual model section, wherein the virtual model section includes a 3D virtual model of an object;
receiving, by a user interface of the display device, a user input selecting a component of the object in the 3D virtual model;
identifying by the computer-readable modeling engine, in response to receiving the user input selecting the component of the object in the 3D virtual model, a linked text in the textual instruction section that is linked to the component of the object in the 3D virtual model; and
highlighting, by the computer-readable modeling engine, in response to identifying the component of the object in the 3D virtual model, the linked text in the textual instruction section displayed on display interface of the display device.

### Claim 17 (depends on 16)

The method of claim 16, further comprising highlighting, by the user interface of the display device, multiple occurrences of the linked text in response to receiving the user input selecting the component of the object in the 3D virtual model.

### Claim 18 (depends on 16)

The method of claim 16, wherein the linked text includes a name of the component.

### Claim 19 (depends on 16)

The method of claim 16, further comprising:
receiving, by the computer-readable modeling engine, a second user input from the user interface of the display device; and
rotating the object in response to receiving the second user input.

### Claim 20 (depends on 19)

The method of claim 19, further comprising:
receiving, by the computer-readable modeling engine, a third user input from the user interface of the display device; and
providing a zoomed in view of the object in response to receiving the third user input.
