# US 2022/0092542 A1 · Providing enhanced functionality in an interactive electronic technical manual

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2022/0092542 A1
- Document ID: US20220092542A1
- Status: Published application
- Kind: A1
- Application number: 17/030,455
- Filed: 2020-09-24
- Published: 2022-03-24
- Earliest claimed: 2020-09-21
- Assignees: MBTE Holdings Sweden AB
- Applicants: Mbte Holdings Sweden AB
- Inventors: Ran Meriaz; Yoram Meriaz; Alexander Tkachman
- Web page: https://patentgrep.com/patent/US20220092542A1

## CPC

- G06Q 10/103: {Workflow collaboration or project management}
- B64F 5/40: Maintaining or repairing aircraft
- G06F 3/0481: based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
- G06F 3/04815: Interaction with a metaphor-based environment or interaction object displayed as three-dimensional [3D], e.g. changing the user viewpoint with respect to the environment or object
- G06F 3/0482: Interaction with lists of selectable items, e.g. menus
- G06F 3/0483: Interaction with page-structured environments, e.g. book metaphor
- G06F 3/04842: Selection of displayed objects or displayed text elements (G06F3/0482 takes precedence)
- G06F 3/04845: for image manipulation, e.g. dragging, rotation, expansion or change of colour
- G06F 3/04847: Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
- G06F 3/04855: Interaction with scrollbars
- G06F 3/1454: {involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay}
- G06F 9/451: Execution arrangements for user interfaces
- G06F 9/452: {Remote windowing, e.g. X-Window System, desktop virtualisation (protocols for virtual reality H04L67/131)}
- G06F 9/453: {Help systems}
- G06F 16/116: {Details of conversion of file system types or formats}
- G06F 16/13: File access structures, e.g. distributed indices (arrangements of input from, or output to, record carriers G06F3/06)
- G06F 16/44: Browsing; Visualisation therefor
- G06F 16/838: Presentation of query results
- G06F 16/90328: {using search space presentation or visualization, e.g. category or range presentation and selection}
- G06F 16/90348: {by searching ordered data, e.g. alpha-numerically ordered data}
- G06F 16/908: using metadata automatically derived from the content
- G06F 16/93: Document management systems
- G06F 16/94: {Hypermedia (Hyperlinking G06F40/134)}
- G06F 16/951: Indexing; Web crawling techniques
- G06F 16/953: Querying, e.g. by the use of web search engines
- G06F 16/9554: {by using bar codes}
- G06F 21/6218: {to a system of files or objects, e.g. local or distributed file system or database}
- G06F 21/6227: {where protection concerns the structure of data, e.g. records, types, queries}
- G06F 30/12: characterised by design entry means specially adapted for CAD, e.g. graphical user interfaces [GUI] specially adapted for CAD
- G06F 30/31: Design entry, e.g. editors specifically adapted for circuit design
- G06F 40/106: Display of layout of documents; Previewing
- G06F 40/117: Tagging; Marking up (details of markup languages G06F40/143); Designating a block; Setting of attributes (style sheets, e.g. eXtensible Stylesheet Language Transformation [XSLT], G06F40/154)
- G06F 40/14: Tree-structured documents (parsing G06F40/205; validation G06F40/226)
- G06F 40/143: Markup, e.g. Standard Generalized Markup Language [SGML] or Document Type Definition [DTD]
- G06F 40/169: Annotation, e.g. comment data or footnotes
- G06F 40/174: Form filling; Merging
- G06K 7/1417: {2D bar codes}
- G06K 19/06028: {using bar codes}
- G06K 19/06037: {multi-dimensional coding}
- G06Q 10/06311: {Scheduling, planning or task assignment for a person or group}
- G06Q 10/063114: {Status monitoring or status determination for a person or group}
- G06Q 10/06316: {Sequencing of tasks or work}
- G06Q 10/0875: Itemisation or classification of parts, supplies or services, e.g. bill of materials
- G06Q 10/10: Office automation; Time management
- G06Q 10/107: Computer-aided management of electronic mailing [e-mailing]
- G06Q 10/20: Administration of product repair or maintenance
- G06Q 30/0185: {Product, service or business identity fraud}
- G06Q 30/0635: {replenishment orders; recurring orders}
- G06Q 30/0643: {graphically representing goods, e.g. 3D product representation}
- G06T 19/003: {Navigation within 3D models or images}
- G06T 19/20: Editing of three-dimensional [3D] images, e.g. changing shapes or colours, aligning objects or positioning parts
- G09B 5/02: with visual presentation of the material to be studied, e.g. using film strip
- G09G 5/14: Display of multiple viewports
- H04L 12/4641: {Virtual LANs, VLANs, e.g. virtual private networks [VPN] (LAN interconnection over a bridge based backbone H04L12/462; encapsulation techniques H04L12/4633; routing of packets H04L45/00; packet switches H04L49/00; virtual private networks for security H04L63/0272)}
- H04L 63/08: {for authentication of entities (cryptographic mechanisms or cryptographic arrangements for entity authentication H04L9/32)}
- H04L 63/102: {Entity profiles}
- H04L 65/1069: Session establishment or de-establishment
- H04W 12/08: Access security
- G06F 3/0485: Scrolling or panning
- G06F 21/128: {involving web programs, i.e. using technology especially used in internet, generally interacting with a web browser, e.g. hypertext markup language [HTML], applets, java}
- G06F 21/31: User authentication
- G06F 2203/04802: 3D-info-object: information is displayed on the internal or external surface of a three dimensional manipulable object, e.g. on the faces of a cube that can be rotated by the user
- G06F 2203/04803: Split screen, i.e. subdividing the display area or the window area into separate subareas
- G06F 2203/04806: Zoom, i.e. interaction techniques or interactors for controlling the zooming operation
- G06F 2221/2141: Access rights, e.g. capability lists, access control lists, access tables, access matrices
- G06Q 10/087: Inventory or stock management, e.g. order filling, procurement or balancing against orders
- G06Q 10/101: Collaborative creation, e.g. joint development of products or services
- G06Q 10/105: Human resources
- G06Q 10/40: Business processes related to social networking or social networking services
- G06T 2219/004: Annotating, labelling
- G06T 2219/2012: Colour editing, changing, or manipulating; Use of colour codes
- G06T 2219/2016: Rotation, translation, scaling
- G09B 19/0069: {Engineering, e.g. mechanical, electrical design (computer engineering G09B19/0053)}
- G09G 2354/00: Aspects of interface with display user
- G09G 2358/00: Arrangements for display data security
- G09G 2380/12: Avionics applications
- H04L 63/0272: {Virtual private networks}
- H04L 63/04: {for providing a confidential data exchange among entities communicating through data packet networks}
- H04W 12/77: Graphical identity
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- B64F: GROUND OR AIRCRAFT-CARRIER-DECK INSTALLATIONS SPECIALLY ADAPTED FOR USE IN CONNECTION WITH AIRCRAFT; DESIGNING, MANUFACTURING, ASSEMBLING, CLEANING, MAINTAINING OR REPAIRING AIRCRAFT, NOT OTHERWISE PROVIDED FOR; HANDLING, TRANSPORTING, TESTING OR INSPECTING AIRCRAFT COMPONENTS, NOT OTHERWISE PROVIDED FOR
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06K: GRAPHICAL DATA READING (image or video recognition or understanding G06V); PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G09B: EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS (devices for psychotechnics or for testing reaction times A61B5/16; games, sports, amusements A63; projectors, projector screens G03B)
- G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00)
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)
- H04W: WIRELESS COMMUNICATION NETWORKS (broadcast communication H04H; communication systems using wireless links for non-selective communication, e.g. wireless extensions H04M1/72)

## Abstract

Embodiments of the present disclosure provide methods, apparatus, systems, computer program products for supporting communication functionality in an interactive electronic technical manual system (IETM) configured to provide electronic and credentialed access via an IETM viewer to technical documentation for an item. In one embodiment, a method is provided comprising: providing a window comprising a communication session option; receiving input of a selection of the communication session option; responsive to receiving the input: identifying active users who are signed into the IETM for a particular object of the item based on credentials for the user and the user being signed into the IETM for the particular object; and causing display of an identifier for each active user on the window as selectable; receiving input of a selection of an indicator for an active user; and responsive to receiving the input, initiating a communication session with the active user within the IETM.

## Claims

### Claim 1

A method for supporting communication functionality in an interactive electronic technical manual system (IETM) configured to provide electronic and credentialed access via an IETM viewer to technical documentation for an item, the method comprising:
providing a window for display via the IETM viewer executing on a user computing entity being used by a user signed into the IETM, the window comprising a communication session option;
receiving input of a selection of the communication session option, wherein the selection of the communication session option is performed by the user via the IETM viewer;
responsive to receiving the input of the selection of the communication session option:
identifying a plurality of active users who are signed into the IETM for a particular object of the item to view the technical documentation for the item based at least in part on credentials for the user and the user being signed into the IETM for the particular object; and
causing display of an identifier for each of the plurality of active users on the window as selectable;
receiving input of a selection of an indicator for an active user of the plurality of active users, wherein the selection of the indicator for the active user is performed by the user via the IETM viewer; and
responsive to receiving the input of the selection of the indicator for the active user, initiating a communication session with the active user within the IETM, wherein the communication session is initiated over an internet protocol based network between the user computing entity being used by the user and a second user computing entity being used by the active user.

### Claim 2 (depends on 1)

The method of claim 1, wherein the communication session comprises at least one of an audio call, a video call, a chat session, and a text session.

### Claim 3 (depends on 1)

The method of claim 1 further comprising:
receiving input indicating the active user accepting the communication session, wherein the active user accepts activation of the communication session via a second IETM viewer executing on the second user computing entity; and
responsive to receiving the input indicating the active user accepting activation of the communication session, conducting the communication session between the user and the active user, wherein the communication session is conducted within the IETM over the internet protocol based network.

### Claim 4 (depends on 1)

The method of claim 1 further comprising:
receiving input of a selection of an indicator for a second active user of the plurality of active users, wherein the selection of the indicator for the second active user is performed by the user via the IETM viewer; and
responsive to receiving the input of the selection of the indicator for the second active user:
initiating a second communication session to the second active user within the IETM, wherein the second communication session is initiated over the internet protocol based network between the user computing entity being used by the user and a third user computing entity being used by the second active user;
receiving input indicating the second active user accepting the second communication session, wherein the second active user accepts the second communication session via a third IETM viewer executing on the third user computing entity; and
responsive to receiving the input indicating the second active user accepting activation of the second communication session, bridging the second communication session onto the communication session so that the user, active user, and the second active user can interact with one another over the communication session within the IETM over the internet protocol based network.

### Claim 5 (depends on 1)

The method of claim 1 further comprising:
responsive to receiving the input of the selection of the communication session option:
identifying one or more special users based at least in part on the credentials for the user; and
causing display of an identifier for each of the one or more special users on the window as selectable, wherein the user can initiate a communication session to a special user of the one or more special users by selecting the special user.

### Claim 6 (depends on 1)

The method of claim 1 further comprising:
receiving input of a selection of a share mechanism, wherein the selection of the share mechanism is performed by the user via the IETM viewer; and
responsive to receiving the input of the share mechanism, causing the window to be shared over the communication session so that the active user can view the window via the second IETM viewer.

### Claim 7 (depends on 1)

The method of claim 1 further comprising automatically saving a record of the communication session in a log in the IETM upon a completion of the communication session.

### Claim 8

An apparatus for supporting communication functionality in an interactive electronic technical manual system (IETM) configured to provide electronic and credentialed access via an IETM viewer to technical documentation for an item, the apparatus comprising at least one processor and at least one memory including a computer program code, the at least one memory and the computer program code configured to, with the at least one processor, cause the apparatus to:
provide a window for display via the IETM viewer executing on a user computing entity being used by a user signed into the IETM, the window comprising a communication session option;
receive input of a selection of the communication session option, wherein the selection of the communication session option is performed by the user via the IETM viewer;
responsive to receiving the input of the selection of the communication session option:
identify a plurality of active users who are signed into the IETM for a particular object of the item to view the technical documentation for the item based at least in part on credentials for the user and the user being signed into the IETM for the particular object; and
cause display of an identifier for each of the plurality of active users on the window as selectable;
receive input of a selection of an indicator for an active user of the plurality of active users, wherein the selection of the indicator for the active user is performed by the user via the IETM viewer; and
responsive to receiving the input of the selection of the indicator for the active user, initiate a communication session with the active user within the IETM, wherein the communication session is initiated over an internet protocol based network between the user computing entity being used by the user and a second user computing entity being used by the active user.

### Claim 9 (depends on 8)

The apparatus of claim 8, wherein the communication session comprises at least one of an audio call, a video call, a chat session, and a text session.

### Claim 10 (depends on 8)

The apparatus of claim 8, wherein the at least one memory and the computer program code are configured to, with the at least one processor, cause the apparatus to:
receive input indicating the active user accepting the communication session, wherein the active user accepts activation of the communication session via a second IETM viewer executing on the second user computing entity; and
responsive to receiving the input indicating the active user accepting activation of the communication session, conduct the communication session between the user and the active user, wherein the communication session is conducted within the IETM over the internet protocol based network.

### Claim 11 (depends on 8)

The apparatus of claim 8, wherein the at least one memory and the computer program code are configured to, with the at least one processor, cause the apparatus to:
receive input of a selection of an indicator for a second active user of the plurality of active users, wherein the selection of the indicator for the second active user is performed by the user via the IETM viewer; and
responsive to receiving the input of the selection of the indicator for the second active user:
initiate a second communication session to the second active user within the IETM, wherein the second communication session is initiated over the internet protocol based network between the user computing entity being used by the user and a third user computing entity being used by the second active user;
receive input indicating the second active user accepting the second communication session, wherein the second active user accepts the second communication session via a third IETM viewer executing on the third user computing entity; and
responsive to receiving the input indicating the second active user accepting activation of the second communication session, bridge the second communication session onto the communication session so that the user, active user, and the second active user can interact with one another over the communication session within the IETM over the internet protocol based network.

### Claim 12 (depends on 8)

The apparatus of claim 8, wherein the at least one memory and the computer program code are configured to, with the at least one processor, cause the apparatus to:
responsive to receiving the input of the selection of the communication session option:
identify one or more special users based at least in part on the credentials for the user; and
cause display of an identifier for each of the one or more special users on the window as selectable, wherein the user can initiate a communication session to a special user of the one or more special users by selecting the special user.

### Claim 13 (depends on 8)

The apparatus of claim 8, wherein the at least one memory and the computer program code are configured to, with the at least one processor, cause the apparatus to:
receive input of a selection of a share mechanism, wherein the selection of the share mechanism is performed by the user via the IETM viewer; and
responsive to receiving the input of the share mechanism, cause the window to be shared over the communication session so that the active user can view the window via the second IETM viewer.

### Claim 14 (depends on 8)

The apparatus of claim 8, wherein the at least one memory and the computer program code are configured to, with the at least one processor, cause the apparatus to automatically save a record of the communication session in a log in the IETM upon a completion of the communication session.

### Claim 15

A non-transitory computer storage medium comprising instructions for supporting communication functionality in an interactive electronic technical manual system (IETM) configured to provide electronic and credentialed access via an IETM viewer to technical documentation for an item, the instructions being configured to cause one or more processors to at least perform operations configured to:
provide a window for display via the IETM viewer executing on a user computing entity being used by a user signed into the IETM, the window comprising a communication session option;
receive input of a selection of the communication session option, wherein the selection of the communication session option is performed by the user via the IETM viewer;
responsive to receiving the input of the selection of the communication session option:
identify a plurality of active users who are signed into the IETM for a particular object of the item to view the technical documentation for the item based at least in part on credentials for the user and the user being signed into the IETM for the particular object; and
cause display of an identifier for each of the plurality of active users on the window as selectable;
receive input of a selection of an indicator for an active user of the plurality of active users, wherein the selection of the indicator for the active user is performed by the user via the IETM viewer; and
responsive to receiving the input of the selection of the indicator for the active user, initiate a communication session with the active user within the IETM, wherein the communication session is initiated over an internet protocol based network between the user computing entity being used by the user and a second user computing entity being used by the active user.

### Claim 16 (depends on 15)

The non-transitory computer storage medium of claim 15, wherein the communication session comprises at least one of an audio call, a video call, a chat session, and a text session.

### Claim 17 (depends on 15)

The non-transitory computer storage medium of claim 15, wherein the instructions are configured to cause the one or more processors to at least perform operations configured to:
receive input indicating the active user accepting the communication session, wherein the active user accepts activation of the communication session via a second IETM viewer executing on the second user computing entity; and
responsive to receiving the input indicating the active user accepting activation of the communication session, conduct the communication session between the user and the active user, wherein the communication session is conducted within the IETM over the internet protocol based network.

### Claim 18 (depends on 15)

The non-transitory computer storage medium of claim 15, wherein the instructions are configured to cause the one or more processors to at least perform operations configured to:
receive input of a selection of an indicator for a second active user of the plurality of active users, wherein the selection of the indicator for the second active user is performed by the user via the IETM viewer; and
responsive to receiving the input of the selection of the indicator for the second active user:
initiate a second communication session to the second active user within the IETM, wherein the second communication session is initiated over the internet protocol based network between the user computing entity being used by the user and a third user computing entity being used by the second active user;
receive input indicating the second active user accepting the second communication session, wherein the second active user accepts the second communication session via a third IETM viewer executing on the third user computing entity; and
responsive to receiving the input indicating the second active user accepting activation of the second communication session, bridge the second communication session onto the communication session so that the user, active user, and the second active user can interact with one another over the communication session within the IETM over the internet protocol based network.

### Claim 19 (depends on 15)

The non-transitory computer storage medium of claim 15, wherein the instructions are configured to cause the one or more processors to at least perform operations configured to:
responsive to receiving the input of the selection of the communication session option:
identify one or more special users based at least in part on the credentials for the user; and
cause display of an identifier for each of the one or more special users on the window as selectable, wherein the user can initiate a communication session to a special user of the one or more special users by selecting the special user.

### Claim 20 (depends on 15)

The non-transitory computer storage medium of claim 15, wherein the instructions are configured to cause the one or more processors to at least perform operations configured to:
receive input of a selection of a share mechanism, wherein the selection of the share mechanism is performed by the user via the IETM viewer; and
responsive to receiving the input of the share mechanism, cause the window to be shared over the communication session so that the active user can view the window via the second IETM viewer.

### Claim 21 (depends on 15)

The non-transitory computer storage medium of claim 15, wherein the instructions are configured to cause the one or more processors to at least perform operations configured to automatically save a record of the communication session in a log in the IETM upon a completion of the communication session.
