# US 2021/0081099 A1 · Graphical user interface (gui) systems and methods for refactoring full-size process plant displays at various zoom and detail levels for visualization on mobile user interface devices

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0081099 A1
- Document ID: US20210081099A1
- Status: Published application
- Kind: A1
- Application number: 16/573,066
- Filed: 2019-09-17
- Published: 2021-03-18
- Earliest claimed: 2019-09-17
- Assignees: Fisher-Rosemount Systems, Inc.
- Applicants: Fisher-Rosemount Systems, Inc.
- Inventors: Cristopher Ian Sarmiento Uy; Ryan Gallardo Valderama; Dino Anton Yu; Mariana Dionisio; Mark J. Nixon; Daniel R. Strinden
- Web page: https://patentgrep.com/patent/US20210081099A1

## CPC

- G06F 3/04845: for image manipulation, e.g. dragging, rotation, expansion or change of colour
- G05B 19/409: characterised by using manual data input [MDI] or by using control panel, e.g. controlling functions with the panel; characterised by control panel details or by setting parameters (G05B19/408, G05B19/4093 take precedence)
- G05B 19/41865: {characterised by job scheduling, process planning, material flow}
- G06F 3/04817: using icons (graphical or visual programming using iconic symbols G06F8/34)
- G06F 3/04847: Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
- G06F 3/0488: using a touch-screen or digitiser, e.g. input of commands through traced gestures
- G06F 3/04883: for inputting data by handwriting, e.g. gesture or text
- G06F 3/147: using display panels
- G06F 9/451: Execution arrangements for user interfaces
- H04L 67/75: Indicating network or usage conditions on the user display
- G05B 2219/31472: Graphical display of process
- G05B 2219/32128: Gui graphical user interface
- G05B 2219/35481: Display, panel
- G05B 2219/36159: Detachable or portable programming unit, display, pc, pda
- G06F 2203/04806: Zoom, i.e. interaction techniques or interactors for controlling the zooming operation
- G09G 2340/045: Zooming at least part of an image, i.e. enlarging it or shrinking it
- G09G 2340/145: related to small screens
- G09G 2354/00: Aspects of interface with display user
- G09G 2360/02: Graphics controller able to handle multiple formats, e.g. input or output formats
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G05B: CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS (systems for controlling or regulating non-electric variables G05D; systems for regulating electric or magnetic variables G05F; control devices or systems insofar as characterised by mechanical features only G05G)
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)
- G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00)

## Abstract

Graphical user interface (GUI) based systems and methods are disclosed for regionizing full-size process plant displays for rendering on mobile user interface devices. A regionizer application receives a full-size process plant display that graphically represents at least a portion of a process plant that includes graphic representations of a plurality of process plant entities. The regionizer app determines display region(s) of the full-size process plant display that define corresponding view portions of the full-size process plant display. The display regions are transmitted to a mobile user interface device for rendering by a mobile display navigation app. The GUI based systems and methods can also automatically detect graphical process control loop display portions within full-size process plant displays for rendering on mobile user interface devices. The GUI based systems and methods can further refactor full-size process plant displays at various zoom and detail levels for visualization on mobile user interface devices.

## Claims

### Claim 1

A graphical user interface (GUI) based method for refactoring full-size process plant displays at various zoom and detail levels for visualization on mobile user interface devices, the GUI based method comprising:
transmitting, by one or more processors, a full-size process plant display to a mobile user interface device, the full-size process plant display graphically representing at least a portion of a process plant, the full-size process plant display including graphic representations of a plurality of process plant entities within the process plant,
wherein the a full-size process plant display is a GUI adapted for rendering on a full-size display screen of the process plant;
rendering, by a mobile display navigation app executing on a processor of the mobile user interface device, a first view portion of the full-size process plant display on a display screen of the mobile user interface device, the first view portion defining a first zoom level and a first detail level of a process plant entity selected from the plurality of process plant entities,
wherein the display screen of the mobile user interface device comprises a surface area that is less than a full-size surface area of the full-size display screen;
receiving, at the mobile display navigation app, a gesture command corresponding to a user manipulation of the surface area of the mobile user interface device; and
rendering, by the mobile display navigation app upon receiving the gesture command, a second view portion of the full-size process plant display on the display screen of the mobile user interface device, the second view portion defining a second zoom level and a second detail level of the process plant entity,
wherein the first zoom level differs from the second zoom level, and
wherein the first detail level differs from the second detail level.

### Claim 2 (depends on 1)

The GUI based method of claim 1,
wherein the mobile display navigation app renders a focused view of the process plant entity at the second zoom level compared with the first zoom level, and
wherein the mobile display navigation app renders, on the display screen of the mobile user interface device, detail information of the process plant entity at the second detail level.

### Claim 3 (depends on 2)

The GUI based method of claim 2, wherein the detail information includes at least one of an alarm adorner graphic or a measurement parameter of the process plant entity.

### Claim 4 (depends on 3)

The GUI based method of claim 3, wherein the information includes the alarm adorner graphic, and wherein mobile display navigation app renders the focused view when the alarm adorner graphic is triggered for display.

### Claim 5 (depends on 2)

The GUI based method of claim 2, wherein the mobile display navigation app renders, on the display screen of the mobile user interface device, the detail information in real time or near-real time.

### Claim 6 (depends on 2)

The GUI based method of claim 2, wherein the first view portion comprises a first graphic resolution and the second view portion comprises a second graphic resolution, the first graphic resolution being different from the second graphic resolution.

### Claim 7 (depends on 6)

The GUI based method of claim 6, wherein the mobile display navigation app determines each of the first graphic resolution and the second graphic resolution based on a size of the display screen of the mobile user interface device.

### Claim 8 (depends on 2)

The GUI based method of claim 2, wherein the full-size process plant display is comprised of a plurality of graphical view layers,
wherein the first view portion associated with a first graphical layer having a first zoom range, and wherein the second view portion is associated with a second graphical layer having a second zoom range, and
wherein the mobile display navigation app, upon receiving the gesture command, detects a transition from the first zoom range to the second zoom range,
the transition causing the mobile display navigation app to render the second view portion at the second graphical layer.

### Claim 9 (depends on 2)

The GUI based method of claim 2, further comprising receiving, at the one or more processors, a configuration command causing the one or more processors to execute instructions to implement one or more of the following:
(a) predefine a graphic resolution of the first view portion or the second view portion,
(b) modify the detail information, or
(c) define a set of view layers associated with the first zoom level and the second zoom level.

### Claim 10 (depends on 2)

The GUI based method of claim 2, wherein the full-size process plant display is a browser based display and the mobile display navigation app comprises a browser,
wherein the browser renders the first view portion on the display screen of the mobile user interface device,
wherein receiving the gesture command at the mobile display navigation app, causes the browser to execute instructions requesting electronic transmission of the detail information from a server associated with the process plant, and
wherein the browser, upon receiving the detail information, renders the second view portion with the detail information.

### Claim 11 (depends on 2)

The GUI based method of claim 2, wherein the mobile display navigation app comprises a native mobile app,
wherein the native mobile app renders the first view portion on the display screen of the mobile user interface device,
wherein receiving the gesture command at the mobile display navigation app, causes the native mobile app to execute instructions requesting electronic transmission of the detail information from a server associated with the process plant, and
wherein the native mobile app, upon receiving the detail information, renders the second view portion with the detail information.

### Claim 12 (depends on 1)

The GUI based method of claim 1, wherein the surface area of the display screen of the mobile user interface device is less than half the full-size surface area of the full-size display screen.

### Claim 13 (depends on 1)

The GUI based method of claim 1, wherein each of the first view portion and the second view portion is sized to render fully on the display screen of the mobile user interface device.

### Claim 14 (depends on 1)

The GUI based method of claim 1, wherein the full-size process plant display is a comprehensive representation of the process plant.

### Claim 15 (depends on 1)

The GUI based method of claim 1, wherein the full-size process plant display natively integrated with a process control network of the process plant.

### Claim 16 (depends on 1)

The GUI based method of claim 1 further comprising:
receiving a selection from the mobile user interface device, the selection corresponding to the process plant entity of the plurality of process plant entities, and
wherein the selection initiates control of the process plant entity within the process plant.

### Claim 17

A graphical user interface (GUI) based system configured to refactor full-size process plant displays at various zoom and detail levels for visualization on mobile user interface devices, the GUI based system comprising:
a server comprising one or more processors, the server communicatively coupled to a process control network of a process plant comprising a plurality of process plant entities; and
a mobile display navigation app executing on one or more processors of a mobile user interface device, the mobile display navigation app communicatively coupled to the server,
wherein the server is configured to transmit a full-size process plant display to the mobile user interface device, the full-size process plant display graphically representing at least a portion of the process plant, the full-size process plant display including graphic representations of the plurality of process plant entities within the process plant, wherein the a full-size process plant display is a GUI adapted for rendering on a full-size display screen of the process plant,
wherein the display mobile navigation app is configured to:
render, on a processor of the mobile user interface device, a first view portion of the full-size process plant display on a display screen of the mobile user interface device, the first view portion defining a first zoom level and a first detail level of a process plant entity selected from the plurality of process plant entities, wherein the display screen of the mobile user interface device comprises a surface area that is less than a full-size surface area of the full-size display screen,
receive a gesture command corresponding to a user manipulation of the surface area of the mobile user interface device, and
render, upon the mobile display navigation app receiving the gesture command, a second view portion of the full-size process plant display on the display screen of the mobile user interface device, the second view portion defining a second zoom level and a second detail level of the process plant entity,
wherein the first zoom level differs from the second zoom level, and
wherein the first detail level differs from the second detail level.

### Claim 18 (depends on 17)

The GUI based system of claim 17,
wherein the mobile display navigation app renders a focused view of the process plant entity at the second zoom level compared with the first zoom level, and
wherein the mobile display navigation app renders, on the display screen of the mobile user interface device, detail information of the process plant entity at the second detail level.

### Claim 19 (depends on 18)

The GUI based system of claim 18, wherein the detail information includes at least one of an alarm adorner graphic or a measurement parameter of the process plant entity.

### Claim 20 (depends on 19)

The GUI based system of claim 19, wherein the information includes the alarm adorner graphic, and wherein mobile display navigation app renders the focused view when the alarm adorner graphic is triggered for display.

### Claim 21 (depends on 18)

The GUI based system of claim 18, wherein the mobile display navigation app renders, on the display screen of the mobile user interface device, the detail information in real time or near-real time.

### Claim 22 (depends on 18)

The GUI based system of claim 18, wherein the first view portion comprises a first graphic resolution and the second view portion comprises a second graphic resolution, the first graphic resolution being different from the second graphic resolution.

### Claim 23 (depends on 21)

The GUI based system of claim 21, wherein the mobile display navigation app determines each of the first graphic resolution and the second graphic resolution based on a size of the display screen of the mobile user interface device.

### Claim 24 (depends on 18)

The GUI based system of claim 18, wherein the full-size process plant display is comprised of a plurality of graphical view layers,
wherein the first view portion associated with a first graphical layer having a first zoom range, and wherein the second view portion is associated with a second graphical layer having a second zoom range, and
wherein the mobile display navigation app, upon receiving the gesture command, detects a transition from the first zoom range to the second zoom range,
the transition causing the mobile display navigation app to render the second view portion at the second graphical layer.

### Claim 25 (depends on 18)

The GUI based system of claim 18, further comprising receiving, at the one or more processors, a configuration command causing the one or more processors to execute instructions to implement one or more of the following:
(a) predefine a graphic resolution of the first view portion or the second view portion,
(b) modify the detail information, or
(c) define a set of view layers associated with the first zoom level and the second zoom level.

### Claim 26 (depends on 18)

The GUI based system of claim 18, wherein the full-size process plant display is a browser based display and the mobile display navigation app comprises a browser,
wherein the browser renders the first view portion on the display screen of the mobile user interface device,
wherein receiving the gesture command at the mobile display navigation app, causes the browser to execute instructions requesting electronic transmission of the detail information from a server associated with the process plant, and
wherein the browser, upon receiving the detail information, renders the second view portion with the detail information.

### Claim 27 (depends on 18)

The GUI based system of claim 18, wherein the mobile display navigation app comprises a native mobile app,
wherein the native mobile app renders the first view portion on the display screen of the mobile user interface device,
wherein receiving the gesture command at the mobile display navigation app, causes the native mobile app to execute instructions requesting electronic transmission of the detail information from a server associated with the process plant, and
wherein the native mobile app, upon receiving the detail information, renders the second view portion with the detail information.

### Claim 28 (depends on 17)

The GUI based system of claim 17, wherein the surface area of the display screen of the mobile user interface device is less than half the full-size surface area of the full-size display screen.

### Claim 29 (depends on 17)

The GUI based system of claim 17, wherein each of the first view portion and the second view portion is sized to render fully on the display screen of the mobile user interface device.

### Claim 30 (depends on 17)

The GUI based system of claim 17, wherein the full-size process plant display is a comprehensive representation of the process plant.

### Claim 31 (depends on 17)

The GUI based system of claim 17, wherein the full-size process plant display natively integrated with a process control network of the process plant.

### Claim 32 (depends on 17)

The GUI based system of claim 17 wherein the mobile display navigation app receives a selection from the mobile user interface device, the selection corresponding to the process plant entity of the plurality of process plant entities, and
wherein the selection initiates control of the process plant entity within the process plant.

### Claim 33

A tangible, non-transitory computer-readable medium storing instructions for refactoring full-size process plant displays at various zoom and detail levels for visualization on mobile user interface devices, that when executed by one or more processors of a computing device cause the computing device to:
transmitting, by one or more processors, a full-size process plant display to a mobile user interface device, the full-size process plant display graphically representing at least a portion of a process plant, the full-size process plant display including graphic representations of a plurality of process plant entities within the process plant,
wherein the full-size process plant display is a GUI adapted for rendering on a full-size display screen of the process plant;
rendering, by a mobile display navigation app executing on a processor of the mobile user interface device, a first view portion of the full-size process plant display on a display screen of the mobile user interface device, the first view portion defining a first zoom level and a first detail level of a process plant entity selected from the plurality of process plant entities,
wherein the display screen of the mobile user interface device comprises a surface area that is less than a full-size surface area of the full-size display screen;
receiving, at the mobile display navigation app, a gesture command corresponding to a user manipulation of the surface area of the mobile user interface device; and
rendering, by a mobile display navigation app upon receiving the gesture command, a second view portion of the full-size process plant display on the display screen of the mobile user interface device, the second view portion defining a second zoom level and a second detail level of the process plant entity,
wherein the first zoom level differs from the second zoom level, and
wherein the first detail level differs from the second detail level.
