# US 11,909,779 B2 · Providing enhanced functionality in an interactive electronic technical manual

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 11,909,779 B2
- Document ID: US11909779B2
- Status: Granted
- Kind: B2
- Application number: 17/818,109
- Filed: 2022-08-08
- Published: 2023-01-26
- Granted: 2024-02-20
- Earliest claimed: 2020-09-21
- Assignees: MBTE Holdings Sweden AB
- Applicants: Mbte Holdings Sweden AB
- Inventors: Ran Meriaz; Yoram Meriaz; Alexander Tkachman
- Web page: https://patentgrep.com/patent/US11909779B2

## CPC

- G06Q 10/103: {Workflow collaboration or project management}
- B64F 5/40: Maintaining or repairing aircraft
- G06F 3/0481: based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
- G06F 3/04815: Interaction with a metaphor-based environment or interaction object displayed as three-dimensional [3D], e.g. changing the user viewpoint with respect to the environment or object
- G06F 3/0482: Interaction with lists of selectable items, e.g. menus
- G06F 3/0483: Interaction with page-structured environments, e.g. book metaphor
- G06F 3/04842: Selection of displayed objects or displayed text elements (G06F3/0482 takes precedence)
- G06F 3/04845: for image manipulation, e.g. dragging, rotation, expansion or change of colour
- G06F 3/04847: Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
- G06F 3/04855: Interaction with scrollbars
- G06F 3/1454: {involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay}
- G06F 9/451: Execution arrangements for user interfaces
- G06F 9/452: {Remote windowing, e.g. X-Window System, desktop virtualisation (protocols for virtual reality H04L67/131)}
- G06F 9/453: {Help systems}
- G06F 16/116: {Details of conversion of file system types or formats}
- G06F 16/13: File access structures, e.g. distributed indices (arrangements of input from, or output to, record carriers G06F3/06)
- G06F 16/44: Browsing; Visualisation therefor
- G06F 16/838: Presentation of query results
- G06F 16/90328: {using search space presentation or visualization, e.g. category or range presentation and selection}
- G06F 16/90348: {by searching ordered data, e.g. alpha-numerically ordered data}
- G06F 16/908: using metadata automatically derived from the content
- G06F 16/93: Document management systems
- G06F 16/94: {Hypermedia (Hyperlinking G06F40/134)}
- G06F 16/953: Querying, e.g. by the use of web search engines
- G06F 16/9554: {by using bar codes}
- G06F 21/6218: {to a system of files or objects, e.g. local or distributed file system or database}
- G06F 21/6227: {where protection concerns the structure of data, e.g. records, types, queries}
- G06F 30/12: characterised by design entry means specially adapted for CAD, e.g. graphical user interfaces [GUI] specially adapted for CAD
- G06F 30/31: Design entry, e.g. editors specifically adapted for circuit design
- G06F 40/106: Display of layout of documents; Previewing
- G06F 40/117: Tagging; Marking up (details of markup languages G06F40/143); Designating a block; Setting of attributes (style sheets, e.g. eXtensible Stylesheet Language Transformation [XSLT], G06F40/154)
- G06F 40/14: Tree-structured documents (parsing G06F40/205; validation G06F40/226)
- G06F 40/143: Markup, e.g. Standard Generalized Markup Language [SGML] or Document Type Definition [DTD]
- G06F 40/169: Annotation, e.g. comment data or footnotes
- G06F 40/174: Form filling; Merging
- G06K 7/1417: {2D bar codes}
- G06K 19/06028: {using bar codes}
- G06K 19/06037: {multi-dimensional coding}
- G06Q 10/06311: {Scheduling, planning or task assignment for a person or group}
- G06Q 10/063114: {Status monitoring or status determination for a person or group}
- G06Q 10/06316: {Sequencing of tasks or work}
- G06Q 10/0875: Itemisation or classification of parts, supplies or services, e.g. bill of materials
- G06Q 10/10: Office automation; Time management
- G06Q 10/107: Computer-aided management of electronic mailing [e-mailing]
- G06Q 10/20: Administration of product repair or maintenance
- G06Q 30/0185: {Product, service or business identity fraud}
- G06Q 30/0635: {replenishment orders; recurring orders}
- G06Q 30/0643: {graphically representing goods, e.g. 3D product representation}
- G06T 19/003: {Navigation within 3D models or images}
- G06T 19/20: Editing of three-dimensional [3D] images, e.g. changing shapes or colours, aligning objects or positioning parts
- G09B 5/02: with visual presentation of the material to be studied, e.g. using film strip
- G09G 5/14: Display of multiple viewports
- H04L 12/4641: {Virtual LANs, VLANs, e.g. virtual private networks [VPN] (LAN interconnection over a bridge based backbone H04L12/462; encapsulation techniques H04L12/4633; routing of packets H04L45/00; packet switches H04L49/00; virtual private networks for security H04L63/0272)}
- H04L 63/08: {for authentication of entities (cryptographic mechanisms or cryptographic arrangements for entity authentication H04L9/32)}
- H04L 63/102: {Entity profiles}
- H04L 65/1069: Session establishment or de-establishment
- H04W 12/08: Access security
- G06F 3/0485: Scrolling or panning
- G06F 21/128: {involving web programs, i.e. using technology especially used in internet, generally interacting with a web browser, e.g. hypertext markup language [HTML], applets, java}
- G06F 21/31: User authentication
- G06F 2203/04802: 3D-info-object: information is displayed on the internal or external surface of a three dimensional manipulable object, e.g. on the faces of a cube that can be rotated by the user
- G06F 2203/04803: Split screen, i.e. subdividing the display area or the window area into separate subareas
- G06F 2203/04806: Zoom, i.e. interaction techniques or interactors for controlling the zooming operation
- G06F 2221/2141: Access rights, e.g. capability lists, access control lists, access tables, access matrices
- G06Q 10/087: Inventory or stock management, e.g. order filling, procurement or balancing against orders
- G06Q 10/101: Collaborative creation, e.g. joint development of products or services
- G06Q 10/105: Human resources
- G06Q 10/40: Business processes related to social networking or social networking services
- G06T 2219/004: Annotating, labelling
- G06T 2219/2012: Colour editing, changing, or manipulating; Use of colour codes
- G06T 2219/2016: Rotation, translation, scaling
- G09B 19/0069: {Engineering, e.g. mechanical, electrical design (computer engineering G09B19/0053)}
- G09G 2354/00: Aspects of interface with display user
- G09G 2358/00: Arrangements for display data security
- G09G 2380/12: Avionics applications
- H04L 63/0272: {Virtual private networks}
- H04L 63/04: {for providing a confidential data exchange among entities communicating through data packet networks}
- H04W 12/77: Graphical identity
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- B64F: GROUND OR AIRCRAFT-CARRIER-DECK INSTALLATIONS SPECIALLY ADAPTED FOR USE IN CONNECTION WITH AIRCRAFT; DESIGNING, MANUFACTURING, ASSEMBLING, CLEANING, MAINTAINING OR REPAIRING AIRCRAFT, NOT OTHERWISE PROVIDED FOR; HANDLING, TRANSPORTING, TESTING OR INSPECTING AIRCRAFT COMPONENTS, NOT OTHERWISE PROVIDED FOR
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06K: GRAPHICAL DATA READING (image or video recognition or understanding G06V); PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G09B: EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS (devices for psychotechnics or for testing reaction times A61B5/16; games, sports, amusements A63; projectors, projector screens G03B)
- G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00)
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)
- H04W: WIRELESS COMMUNICATION NETWORKS (broadcast communication H04H; communication systems using wireless links for non-selective communication, e.g. wireless extensions H04M1/72)

## Abstract

Embodiments of the present disclosure provide methods, apparatus, systems, computer program products for displaying a data source of data found in technical documentation for an item via an interactive electronic technical manual system (IETM) configured to provide electronic and credentialed access to the technical documentation via an IETM viewer. In one embodiment, a method is provided comprising: providing a window comprising (1) textual information from and/or an illustration related to the data and (2) a selection mechanism; receiving a first type or a second type of selection of the mechanism; responsive to receiving the first type of selection, generating a data source window comprising a relevant section of the data source that relates to the textual information and/or the illustration; responsive to receiving the second type of selection, generating the data source window comprising the data source; and providing the data source window for display via the IETM viewer.

## Claims

### Claim 1

A method for displaying a dataset of technical documentation for an item via an interactive electronic technical manual system (IETM) in a source format structure and a converted format structure, the method comprising:
accessing a dataset in a converted format structure, wherein (1) the converted format structure represents the dataset after having been converted from a source format structure to the converted format structure, (2) the converted format structure indicates a converted organizational framework for the dataset, and (3) the source format structure indicates a source organizational framework for the dataset, wherein converting the dataset from the source format structure to the converted format structure comprises:
(a) identifying the source format structure for the dataset based at least in part on metadata in the dataset;
(b) assigning a first indicator to a first portion of the dataset in the converted format structure, wherein the first indicator (i) identifies the source format structure and the first portion of the dataset in the converted format structure, (ii) enables display of the first portion of the dataset in the source format structure, and (iii) the first indicator maps the first portion of the dataset to the source format structure;
(c) assigning a second indicator to a second portion of the dataset in the converted format structure, wherein the second indicator (i) identifies the source format structure and the second portion of the dataset in the converted format structure, (ii) enables display of the second portion of the dataset in the source format structure, and (iii) maps the first portion of the dataset to the source format structure;
generating a window based at least in part on the converted format structure, the first indicator, and the second indicator;
providing the window for display via an IETM viewer executing on a user computing entity, wherein the window displays (1) textual information from the dataset in the converted format structure and (2) a plurality of selection mechanisms;
receiving input of a selection mechanism of the plurality of selection mechanisms;
responsive to receiving input of a first type of selection mechanism of the plurality of selection mechanisms, generating a data source window comprising a corresponding section for the textual information of the dataset in the source format structure, wherein the data source window comprises the textual information from the dataset in the source format structure;
responsive to receiving input of a second type of selection mechanism of the plurality of selection mechanisms, generating the data source window comprising an entire dataset in the source format structure, wherein the entire dataset in the source format structure comprises the textual information; and
providing the data source window for display via the IETM viewer.

### Claim 2 (depends on 1)

The method of claim 1, wherein the source format structure comprises a portable document format (PDF) file and the corresponding section for the textual information of the dataset in the source format structure comprises relevant pages of the PDF file corresponding to the textual information.

### Claim 3 (depends on 1)

The method of claim 1, wherein the data source window is superimposed on at least a portion of the window.

### Claim 4 (depends on 1)

The method of claim 1, wherein the data source window is configured to allow a user to scroll through the corresponding section.

### Claim 5

An apparatus for displaying a dataset of technical documentation for an item via an interactive electronic technical manual system (IETM) in a source format structure and a converted format structure, the apparatus comprising memory and computer program code configured to, with one or more processors, cause the apparatus to:
access a dataset in a converted format structure, wherein (1) the converted format structure represents the dataset after having been converted from a source format structure to the converted format structure, (2) the converted format structure indicates a converted organizational framework for the dataset, and (3) the source format structure indicates a source organizational framework for the dataset, wherein converting the dataset from the source format structure to the converted format structure comprises:
(a) identifying the source format structure for the dataset based at least in part on metadata in the dataset;
(b) assigning a first indicator to a first portion of the dataset in the converted format structure, wherein the first indicator (i) identifies the source format structure and the first portion of the dataset in the converted format structure, (ii) enables display of the first portion of the dataset in the source format structure, and (iii) the first indicator maps the first portion of the dataset to the source format structure;
(c) assigning a second indicator to a second portion of the dataset in the converted format structure, wherein the second indicator (i) identifies the source format structure and the second portion of the dataset in the converted format structure, (ii) enables display of the second portion of the dataset in the source format structure, and (iii) maps the first portion of the dataset to the source format structure;
generate a window based at least in part on the converted format structure, the first indicator, and the second indicator;
provide the window for display via an IETM viewer executing on a user computing entity, wherein the window displays (1) textual information from the dataset in the converted format structure and (2) a plurality of selection mechanisms;
receive input of a selection mechanism of the plurality of selection mechanisms;
responsive to receiving input of a first type of selection mechanism of the plurality of selection mechanisms, generate a data source window comprising a corresponding section for the textual information of the dataset in the source format structure, wherein the data source window comprises the textual information from the dataset in the source format structure;
responsive to receiving input of a second type of selection mechanism of the plurality of selection mechanisms, generate the data source window comprising an entire dataset in the source format structure, wherein the entire dataset in the source format structure comprises the textual information; and
provide the data source window for display via the IETM viewer.

### Claim 6 (depends on 5)

The apparatus of claim 5, wherein the source format structure comprises a portable document format (PDF) file and the corresponding section for the textual information of the dataset in the source format structure comprises relevant pages of the PDF file corresponding to the textual information.

### Claim 7 (depends on 5)

The apparatus of claim 5, wherein the data source window is superimposed on at least a portion of the window.

### Claim 8 (depends on 5)

The apparatus of claim 5, wherein the data source window is configured to allow a user to scroll through the corresponding section.

### Claim 9

A non-transitory computer storage medium comprising instructions for displaying a dataset of technical documentation for an item via an interactive electronic technical manual system (IETM) in a source format structure and a converted format structure, the instructions being configured to cause one or more processors to at least perform operations configured to:
access a dataset in a converted format structure, wherein (1) the converted format structure represents the dataset after having been converted from a source format structure to the converted format structure, (2) the converted format structure indicates a converted organizational framework for the dataset, and (3) the source format structure indicates a source organizational framework for the dataset, wherein converting the dataset from the source format structure to the converted format structure comprises:
(a) identifying the source format structure for the dataset based at least in part on metadata in the dataset;
(b) assigning a first indicator to a first portion of the dataset in the converted format structure, wherein the first indicator (i) identifies the source format structure and the first portion of the dataset in the converted format structure, (ii) enables display of the first portion of the dataset in the source format structure, and (iii) the first indicator maps the first portion of the dataset to the source format structure;
(c) assigning a second indicator to a second portion of the dataset in the converted format structure, wherein the second indicator (i) identifies the source format structure and the second portion of the dataset in the converted format structure, (ii) enables display of the second portion of the dataset in the source format structure, and (iii) maps the first portion of the dataset to the source format structure;
generate a window based at least in part on the converted format structure, the first indicator, and the second indicator;
provide the window for display via an IETM viewer executing on a user computing entity, wherein the window displays (1) textual information from the dataset in the converted format structure and (2) a plurality of selection mechanisms;
receive input of a selection mechanism of the plurality of selection mechanisms;
responsive to receiving input of a first type of selection mechanism of the plurality of selection mechanisms, generate a data source window comprising a corresponding section for the textual information of the dataset in the source format structure, wherein the data source window comprises the textual information from the dataset in the source format structure;
responsive to receiving input of a second type of selection mechanism of the plurality of selection mechanisms, generate the data source window comprising an entire dataset in the source format structure, wherein the entire dataset in the source format structure comprises the textual information; and
provide the data source window for display via the IETM viewer.

### Claim 10 (depends on 9)

The non-transitory computer storage medium of claim 9, wherein the source format structure comprises a portable document format (PDF) file and the corresponding section for the textual information of the dataset in the source format structure comprises relevant pages of the PDF file corresponding to the textual information.

### Claim 11 (depends on 9)

The non-transitory computer storage medium of claim 9, wherein the data source window is superimposed on at least a portion of the window.

### Claim 12 (depends on 9)

The non-transitory computer storage medium of claim 9, wherein the data source window is configured to allow a user to scroll through the corresponding section.