# US 2022/0091711 A1 · Providing enhanced functionality in an interactive electronic technical manual

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2022/0091711 A1
- Document ID: US20220091711A1
- Status: Published application
- Kind: A1
- Application number: 17/030,471
- Filed: 2020-09-24
- Published: 2022-03-24
- Earliest claimed: 2020-09-21
- Assignees: MBTE Holdings Sweden AB
- Applicants: Mbte Holdings Sweden AB
- Inventors: Ran Meriaz; Yoram Meriaz; Alexander Tkachman
- Web page: https://patentgrep.com/patent/US20220091711A1

## CPC

- G06Q 10/103: {Workflow collaboration or project management}
- B64F 5/40: Maintaining or repairing aircraft
- G06F 3/0481: based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
- G06F 3/04815: Interaction with a metaphor-based environment or interaction object displayed as three-dimensional [3D], e.g. changing the user viewpoint with respect to the environment or object
- G06F 3/0482: Interaction with lists of selectable items, e.g. menus
- G06F 3/0483: Interaction with page-structured environments, e.g. book metaphor
- G06F 3/04842: Selection of displayed objects or displayed text elements (G06F3/0482 takes precedence)
- G06F 3/04845: for image manipulation, e.g. dragging, rotation, expansion or change of colour
- G06F 3/04847: Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
- G06F 3/04855: Interaction with scrollbars
- G06F 3/1454: {involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay}
- G06F 9/451: Execution arrangements for user interfaces
- G06F 9/452: {Remote windowing, e.g. X-Window System, desktop virtualisation (protocols for virtual reality H04L67/131)}
- G06F 9/453: {Help systems}
- G06F 16/116: {Details of conversion of file system types or formats}
- G06F 16/13: File access structures, e.g. distributed indices (arrangements of input from, or output to, record carriers G06F3/06)
- G06F 16/44: Browsing; Visualisation therefor
- G06F 16/838: Presentation of query results
- G06F 16/90328: {using search space presentation or visualization, e.g. category or range presentation and selection}
- G06F 16/90348: {by searching ordered data, e.g. alpha-numerically ordered data}
- G06F 16/908: using metadata automatically derived from the content
- G06F 16/93: Document management systems
- G06F 16/94: {Hypermedia (Hyperlinking G06F40/134)}
- G06F 16/951: Indexing; Web crawling techniques
- G06F 16/953: Querying, e.g. by the use of web search engines
- G06F 16/9554: {by using bar codes}
- G06F 21/6218: {to a system of files or objects, e.g. local or distributed file system or database}
- G06F 21/6227: {where protection concerns the structure of data, e.g. records, types, queries}
- G06F 30/12: characterised by design entry means specially adapted for CAD, e.g. graphical user interfaces [GUI] specially adapted for CAD
- G06F 30/31: Design entry, e.g. editors specifically adapted for circuit design
- G06F 40/106: Display of layout of documents; Previewing
- G06F 40/117: Tagging; Marking up (details of markup languages G06F40/143); Designating a block; Setting of attributes (style sheets, e.g. eXtensible Stylesheet Language Transformation [XSLT], G06F40/154)
- G06F 40/14: Tree-structured documents (parsing G06F40/205; validation G06F40/226)
- G06F 40/143: Markup, e.g. Standard Generalized Markup Language [SGML] or Document Type Definition [DTD]
- G06F 40/169: Annotation, e.g. comment data or footnotes
- G06F 40/174: Form filling; Merging
- G06K 7/1417: {2D bar codes}
- G06K 19/06028: {using bar codes}
- G06K 19/06037: {multi-dimensional coding}
- G06Q 10/06311: {Scheduling, planning or task assignment for a person or group}
- G06Q 10/063114: {Status monitoring or status determination for a person or group}
- G06Q 10/06316: {Sequencing of tasks or work}
- G06Q 10/0875: Itemisation or classification of parts, supplies or services, e.g. bill of materials
- G06Q 10/10: Office automation; Time management
- G06Q 10/107: Computer-aided management of electronic mailing [e-mailing]
- G06Q 10/20: Administration of product repair or maintenance
- G06Q 30/0185: {Product, service or business identity fraud}
- G06Q 30/0635: {replenishment orders; recurring orders}
- G06Q 30/0643: {graphically representing goods, e.g. 3D product representation}
- G06T 19/003: {Navigation within 3D models or images}
- G06T 19/20: Editing of three-dimensional [3D] images, e.g. changing shapes or colours, aligning objects or positioning parts
- G09B 5/02: with visual presentation of the material to be studied, e.g. using film strip
- G09G 5/14: Display of multiple viewports
- H04L 12/4641: {Virtual LANs, VLANs, e.g. virtual private networks [VPN] (LAN interconnection over a bridge based backbone H04L12/462; encapsulation techniques H04L12/4633; routing of packets H04L45/00; packet switches H04L49/00; virtual private networks for security H04L63/0272)}
- H04L 63/08: {for authentication of entities (cryptographic mechanisms or cryptographic arrangements for entity authentication H04L9/32)}
- H04L 63/102: {Entity profiles}
- H04L 65/1069: Session establishment or de-establishment
- H04W 12/08: Access security
- G06F 3/0485: Scrolling or panning
- G06F 21/128: {involving web programs, i.e. using technology especially used in internet, generally interacting with a web browser, e.g. hypertext markup language [HTML], applets, java}
- G06F 21/31: User authentication
- G06F 2203/04802: 3D-info-object: information is displayed on the internal or external surface of a three dimensional manipulable object, e.g. on the faces of a cube that can be rotated by the user
- G06F 2203/04803: Split screen, i.e. subdividing the display area or the window area into separate subareas
- G06F 2203/04806: Zoom, i.e. interaction techniques or interactors for controlling the zooming operation
- G06F 2221/2141: Access rights, e.g. capability lists, access control lists, access tables, access matrices
- G06Q 10/087: Inventory or stock management, e.g. order filling, procurement or balancing against orders
- G06Q 10/101: Collaborative creation, e.g. joint development of products or services
- G06Q 10/105: Human resources
- G06Q 10/40: Business processes related to social networking or social networking services
- G06T 2219/004: Annotating, labelling
- G06T 2219/2012: Colour editing, changing, or manipulating; Use of colour codes
- G06T 2219/2016: Rotation, translation, scaling
- G09B 19/0069: {Engineering, e.g. mechanical, electrical design (computer engineering G09B19/0053)}
- G09G 2354/00: Aspects of interface with display user
- G09G 2358/00: Arrangements for display data security
- G09G 2380/12: Avionics applications
- H04L 63/0272: {Virtual private networks}
- H04L 63/04: {for providing a confidential data exchange among entities communicating through data packet networks}
- H04W 12/77: Graphical identity
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- B64F: GROUND OR AIRCRAFT-CARRIER-DECK INSTALLATIONS SPECIALLY ADAPTED FOR USE IN CONNECTION WITH AIRCRAFT; DESIGNING, MANUFACTURING, ASSEMBLING, CLEANING, MAINTAINING OR REPAIRING AIRCRAFT, NOT OTHERWISE PROVIDED FOR; HANDLING, TRANSPORTING, TESTING OR INSPECTING AIRCRAFT COMPONENTS, NOT OTHERWISE PROVIDED FOR
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06K: GRAPHICAL DATA READING (image or video recognition or understanding G06V); PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G09B: EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS (devices for psychotechnics or for testing reaction times A61B5/16; games, sports, amusements A63; projectors, projector screens G03B)
- G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00)
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)
- H04W: WIRELESS COMMUNICATION NETWORKS (broadcast communication H04H; communication systems using wireless links for non-selective communication, e.g. wireless extensions H04M1/72)

## Abstract

Embodiments of the present disclosure provide methods, apparatus, systems, computer program products for importing a dataset comprising content for technical documentation for an item provided as a plurality of data modules adhering to S1000D standards and a data source comprising content for the technical documentation for the item provided as a plurality of files not adhering to S1000D standards into an interactive electronic technical manual system (IETM) configured to provide electronic and credentialed access to the technical documentation via an IETM viewer. In one embodiment, a method is provided comprising: converting each data module for the dataset into a file in JSON format; converting each file for the data source into a file in JSON format; storing each of the files in JSON format in the IETM, wherein the content for the technical documentation from both the dataset and the data source can be accessed interchangeably within the IETM.

## Claims

### Claim 1

A method for importing a dataset comprising content for technical documentation for an item provided as a plurality of data modules adhering to S1000D standards and a data source comprising content for the technical documentation for the item provided as a plurality of files not adhering to S1000D standards into an interactive electronic technical manual system (IETM) configured to provide electronic and credentialed access to the technical documentation for the item via an IETM viewer, the method comprising:
converting each data module of the plurality of data modules for the dataset into a file in JSON format;
converting each file of the plurality of files for the data source into a file in JSON format;
storing each of the files in JSON format in the IETM, wherein the content for the technical documentation for the item from both the dataset and the data source can be accessed interchangeably within the IETM;
providing a table of contents to display via a window via the IETM viewer being executed on a user computing device being used by a user signed into the IETM, wherein the window (1) comprises a first view pane displaying the table of contents and a second view pane and (2) is configured to display the first view pane and the second view pane on non-overlapping portions of the window, and the table of contents comprises a plurality of topics associated with the content for the technical documentation for the item from both the dataset and the data source;
receiving input of a selection of a particular topic from the plurality of topics provided in the table of contents, wherein the selection of the particular topic is performed by the user via the IETM viewer and the particular topic is associated with particular content found in the content for the technical documentation for the item provided in the data source as the plurality of files not adhering to S1000D standards;
responsive to receiving the input of the selection of the particular topic:
retrieving one or more files from the files in JSON format that contain the particular content; and
providing the particular content for display, wherein the particular content is displayed on the second view pane of the window in a format structure found in one or more of the plurality of files for the data source configured to contribute to an organization framework for readability of the particular content.

### Claim 2 (depends on 1)

The method of claim 1, wherein the format structure comprises at least one of a title description, a chapter description, a paragraph description, a heading description, a sub-heading description, a figure description, and a table description.

### Claim 3 (depends on 1)

The method of claim 1, wherein the organizational framework comprises a hierarchical framework for the content of the data source.

### Claim 4 (depends on 1)

The method of claim 1, wherein the plurality of files for the data source are in at least one of a portable document format and a standard generalized markup language format.

### Claim 5 (depends on 1)

The method for claim 1, wherein the IETM is configured to provide the same functionality with respect to the technical documentation for the item from both the dataset and the data source.

### Claim 6 (depends on 5)

The method of claim 5, wherein the same functionality comprises placing a plurality of links in the content for the technical documentation for the item from both the dataset and the data source in which each link of the plurality of links is configured when selected to provide a preview of a part found in the technical documentation for the item.

### Claim 7 (depends on 1)

The method for claim 1, wherein converting each file of the plurality of files for the data source into the file in JSON format further comprises:
initially converting each file of the plurality of files into a file in an intermediate format; and
converting each file in the intermediate format to the file in the JSON format.

### Claim 8

An apparatus for importing a dataset comprising content for technical documentation for an item provided as a plurality of data modules adhering to S1000D standards and a data source comprising content for the technical documentation for the item provided as a plurality of files not adhering to S1000D standards into an interactive electronic technical manual system (IETM) configured to provide electronic and credentialed access to the technical documentation for the item via an IETM viewer, the apparatus comprising at least one processor and at least one memory including a computer program code, the at least one memory and the computer program code configured to, with the at least one processor, cause the apparatus to:
convert each data module of the plurality of data modules for the dataset into a file in JSON format;
convert each file of the plurality of files for the data source into a file in JSON format;
store each of the files in JSON format in the IETM, wherein the content for the technical documentation for the item from both the dataset and the data source can be accessed interchangeably within the IETM;
provide a table of contents to display via a window via the IETM viewer being executed on a user computing device being used by a user signed into the IETM, wherein the window (1) comprises a first view pane displaying the table of contents and a second view pane and (2) is configured to display the first view pane and the second view pane on non-overlapping portions of the window, and the table of contents comprises a plurality of topics associated with the content for the technical documentation for the item from both the dataset and the data source;
receive input of a selection of a particular topic from the plurality of topics provided in the table of contents, wherein the selection of the particular topic is performed by the user via the IETM viewer and the particular topic is associated with particular content found in the content for the technical documentation for the item provided in the data source as the plurality of files not adhering to S1000D standards;
responsive to receiving the input of the selection of the particular topic:
retrieve one or more files from the files in JSON format that contain the particular content; and
provide the particular content for display, wherein the particular content is displayed on the second view pane of the window in a format structure found in one or more of the plurality of files for the data source configured to contribute to an organization framework for readability of the particular content.

### Claim 9 (depends on 8)

The apparatus of claim 8, wherein the format structure comprises at least one of a title description, a chapter description, a paragraph description, a heading description, a sub-heading description, a figure description, and a table description.

### Claim 10 (depends on 8)

The apparatus of claim 8, wherein the organizational framework comprises a hierarchical framework for the content of the data source.

### Claim 11 (depends on 8)

The apparatus of claim 8, wherein the plurality of files for the data source are in at least one of a portable document format and a standard generalized markup language format.

### Claim 12 (depends on 8)

The apparatus for claim 8, wherein the IETM is configured to provide the same functionality with respect to the technical documentation for the item from both the dataset and the data source.

### Claim 13 (depends on 12)

The apparatus of claim 12, wherein the same functionality comprises placing a plurality of links in the content for the technical documentation for the item from both the dataset and the data source in which each link of the plurality of links is configured when selected to provide a preview of a part found in the technical documentation for the item.

### Claim 14 (depends on 8)

The apparatus for claim 8, wherein the at least one memory and the computer program code are configured to, with the at least one processor, cause the apparatus to convert each file of the plurality of files for the data source into the file in JSON format by:
initially converting each file of the plurality of files into a file in an intermediate format; and
converting each file in the intermediate format to the file in the JSON format.

### Claim 15

A non-transitory computer storage medium comprising instructions for importing a dataset comprising content for technical documentation for an item provided as a plurality of data modules adhering to S1000D standards and a data source comprising content for the technical documentation for the item provided as a plurality of files not adhering to S1000D standards into an interactive electronic technical manual system (IETM) configured to provide electronic and credentialed access to the technical documentation for the item via an IETM viewer, the instructions being configured to cause one or more processors to at least perform operations configured to:
convert each data module of the plurality of data modules for the dataset into a file in JSON format;
convert each file of the plurality of files for the data source into a file in JSON format;
store each of the files in JSON format in the IETM, wherein the content for the technical documentation for the item from both the dataset and the data source can be accessed interchangeably within the IETM;
provide a table of contents to display via a window via the IETM viewer being executed on a user computing device being used by a user signed into the IETM, wherein the window (1) comprises a first view pane displaying the table of contents and a second view pane and (2) is configured to display the first view pane and the second view pane on non-overlapping portions of the window, and the table of contents comprises a plurality of topics associated with the content for the technical documentation for the item from both the dataset and the data source;
receive input of a selection of a particular topic from the plurality of topics provided in the table of contents, wherein the selection of the particular topic is performed by the user via the IETM viewer and the particular topic is associated with particular content found in the content for the technical documentation for the item provided in the data source as the plurality of files not adhering to S1000D standards;
responsive to receiving the input of the selection of the particular topic:
retrieve one or more files from the files in JSON format that contain the particular content; and
provide the particular content for display, wherein the particular content is displayed on the second view pane of the window in a format structure found in one or more of the plurality of files for the data source configured to contribute to an organization framework for readability of the particular content.

### Claim 16 (depends on 15)

The non-transitory computer storage medium of claim 15, wherein the format structure comprises at least one of a title description, a chapter description, a paragraph description, a heading description, a sub-heading description, a figure description, and a table description.

### Claim 17 (depends on 15)

The non-transitory computer storage medium of claim 15, wherein the organizational framework comprises a hierarchical framework for the content of the data source.

### Claim 18 (depends on 15)

The non-transitory computer storage medium of claim 15, wherein the plurality of files for the data source are in at least one of a portable document format and a standard generalized markup language format.

### Claim 19 (depends on 15)

The non-transitory computer storage medium for claim 15, wherein the IETM is configured to provide the same functionality with respect to the technical documentation for the item from both the dataset and the data source.

### Claim 20 (depends on 19)

The non-transitory computer storage medium of claim 19, wherein the same functionality comprises placing a plurality of links in the content for the technical documentation for the item from both the dataset and the data source in which each link of the plurality of links is configured when selected to provide a preview of a part found in the technical documentation for the item.

### Claim 21 (depends on 15)

The non-transitory computer storage medium for claim 15, wherein the instructions are configured to cause the one or more processors to at least perform operations configured to convert each file of the plurality of files for the data source into the file in JSON format by:
initially converting each file of the plurality of files into a file in an intermediate format; and
converting each file in the intermediate format to the file in the JSON format.
