# US 2017/0255192 A1 · Methods, Apparatuses, and Systems for Human Machine Interface (HMI) Operations

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2017/0255192 A1
- Document ID: US20170255192A1
- Status: Published application
- Kind: A1
- Application number: 15/449,447
- Filed: 2017-03-03
- Published: 2017-09-07
- Earliest claimed: 2016-03-04
- Assignees: Transocean Innovation Labs Ltd.
- Applicants: Transocean Innovation Labs Ltd
- Inventors: Kurt Thwaites; Steven Hand; Kevin Hoffmann; Nate Bishop; Bridget Monahan; Amy Ferchak; Jeffrey A. Senn
- Web page: https://patentgrep.com/patent/US20170255192A1

## CPC

- G05B 23/0289: {Reconfiguration to prevent failure, e.g. usually as a reaction to incipient failure detection}
- E21B 34/16: Control means therefor being outside the borehole {(control systems for submerged well heads E21B33/0355)}
- E21B 44/00: Automatic control systems specially adapted for drilling operations, i.e. self-operating systems which function to carry out or modify a drilling operation without intervention of a human operator, e.g. computer-controlled drilling systems; Systems specially adapted for monitoring a plurality of drilling variables or conditions
- G06F 3/04817: using icons (graphical or visual programming using iconic symbols G06F8/34)
- G06F 3/0482: Interaction with lists of selectable items, e.g. menus
- G06F 3/04845: for image manipulation, e.g. dragging, rotation, expansion or change of colour
- G06F 3/04847: Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
- G05B 23/0272: {Presentation of monitored results, e.g. selection of status reports to be displayed; Filtering information to the user}
- G06F 3/0488: using a touch-screen or digitiser, e.g. input of commands through traced gestures
- G05B: CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS (systems for controlling or regulating non-electric variables G05D; systems for regulating electric or magnetic variables G05F; control devices or systems insofar as characterised by mechanical features only G05G)
- E21B: EARTH OR ROCK DRILLING; OBTAINING OIL, GAS, WATER, SOLUBLE OR MELTABLE MATERIALS OR A SLURRY OF MINERALS FROM WELLS
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

Methods, apparatuses, systems, and implementations of an HMI control system for BOP rigs are disclosed. At least some versions of the disclosed systems enable a user to configure interface settings, perform actions on a BOP stack, view diagnostics, perform testing, and observe and rectify alarms. The disclosed systems may enable a user to more efficiently navigate between different interfaces and perform HMI functions due to a control zone configuration. Additionally, the control zone configuration may reduce operator error by assigning certain control zones to particular functions and requiring the user to take affirmative steps to perform destructive functions.

## Claims

### Claim 1

A computing system for implementing a human machine interface (HMI) application, the computing system comprising:
a memory device; and
at least one processor configured to enable the display of a graphical user interface (GUI) comprising one or more graphical elements configured to implement, using the at least one processor, one or more software applications stored on one or more servers, the one or more software applications configured to:
initiate a session of the HMI application by receiving a user input on a user interface running or stored on a hardware device comprising at least one processor;
enable the display of a plurality of non-overlapping zones comprising an action zone and one or more of:
a high-level navigation zone comprising one or more selectable navigation options; and
a system header zone;
enable the display of a plurality of selectable action options in the action zone, the action zone comprising a plurality of non-overlapping subzones, the subzones comprising:
an interface control subzone,
an information subzone, and
a system control subzone;
enable the display of one or more selectable action options, the one or more selectable action options being displayed in predesignated subzones, wherein the plurality of selectable action options is modified based on a selection of the one or more selectable navigation options, wherein the selection is one or more of a user selection and a default selection;
receive, at the hardware device, data representing a user selection of one of the one or more selectable action options; and
control an operating state of one or more physical offshore drilling rig components based on the user selection.

### Claim 2 (depends on 1)

The computing system of claim 1, where the HMI application is configured to implement one or more standard operating procedures applicable to one or more offshore drilling rigs.

### Claim 3 (depends on 2)

The computing system of claim 2, the HMI application further configured to:
receive, at the hardware device, data representing one or more modifications to the one or more standard operating procedures;
apply the one or more modifications to the one or more standard operating procedures to create one or more modified standard operating procedures; and
apply the one or more modified standard operating procedures to the one or more offshore drilling rigs.

### Claim 4 (depends on 1)

The computing system of claim 1, the one or more selectable navigation options comprising one or more of:
a blowout preventer (BOP) stack control option;
a diagnostics option;
a testing option;
a settings option;
an alarms option;
a diverter option;
a surface system option;
an electronic riser angle option; and
an emergency disconnect option.

### Claim 5 (depends on 4)

The computing system of claim 4, the one or more software applications being further configured to, after receiving a user selection of the BOP stack control option:
enable the display of a layout diagram comprising one or more selectable components in the information subzone, the layout diagram representing a current stack arrangement of the one or more physical offshore drilling rig components; and
enable the display of one or more control options in the interface control subzone, the one or more control options comprising one or more of:
one or more control procedures, and
one or more destructive function control modes.

### Claim 6 (depends on 5)

The computing system of claim 5, the one or more software applications being further configured to:
enable the display of one or more visual status displays in the system control subzone; and
after receiving a user selection of one of the selectable components or control options, enable the display of one or more function control options in the system control subzone, the one or more function control options corresponding to the user selection of one of the selectable components or control options.

### Claim 7 (depends on 5)

The computing system of claim 5, the one or more software applications being further configured to:
enable the display of a flowpath within the layout diagram;
enable the display of one or more colors for the flowpath, the one or more highlighted colors corresponding to one or more predicted flowpath states of the flowpath, wherein the one or more predicted flowpath states comprise:
a predicted fluid flow state;
a predicted fluid non-flow state; and/or
a predicted fluid pressure buildup state; and
after receiving a user selection of one of the selectable components or control options, enable the display of one or more function control options in the system control subzone, the one or more function control options corresponding to the user selection of one of the selectable components or control options.

### Claim 8 (depends on 5)

The computing system of claim 5, the one or more software applications being further configured to:
receive a user input activating one or more destructive function control modes;
receive a user selection of one or more destructive functions;
enable the display of a destructive function confirmation option; and
upon receipt of a user selection of the destructive function confirmation option, perform one or more actions on one or more physical rig components corresponding to the selected one or more destructive functions.

### Claim 9 (depends on 5)

The computing system of claim 5, the one or more software applications being further configured to, after receipt of a user selection of one of the selectable components, control options, or destructive function confirmation option, perform an audible feedback function, the audible feedback function comprising providing an audible confirmation of the user selection before a function corresponding to the user selection is initiated.

### Claim 10 (depends on 8)

The computing system of claim 8, where the one or more destructive functions comprise one or more of:
a pipe cutting action; and
a BOP disconnect action.

### Claim 11 (depends on 4)

The computing system of claim 4, the one or more software applications being further configured to, after receiving a user selection of the settings option:
enable the display of a drag-and-drop interface comprising one or more component icons located in the interface control subzone, the component icons representing one or more physical rig components; and
enable the display of metadata, the metadata describing the one or more physical rig components.

### Claim 12 (depends on 11)

The computing system of claim 11, the one or more software applications being further configured to, after receiving a user selection of the at least one component operation option:
receive a user selection of the one or more component icons;
enable a user to drag the selected one or more component icons onto a layout diagram located in the information subzone, the layout diagram representing a current stack arrangement of the one or more physical rig components; and
upon receipt of the selected one or more component icons onto the layout diagram, modify the layout diagram; and
control a movement operation of the one or more physical rig components into a modified current stack arrangement to match the one or more component icons comprising the modified layout diagram.

### Claim 13 (depends on 4)

The computing system of claim 4, the one or more software applications being further configured to, after receiving a user selection of the diagnostics option:
enable the display of one or more system diagnostic options in the interface control subzone, the one or more system diagnostic options comprising one or more of:
a component diagnostic option,
a function diagnostic option, and
an event diagnostic option; and
enable the display of one or more control options in the system control subzone, the one or more control options corresponding to the user selection of one of the one or more system diagnostic options.

### Claim 14 (depends on 13)

The computing system of claim 13, the one or more software applications further configured to, after receiving a user selection of the event diagnostic option:
enable a display of an event timeline in the information subzone, the event timeline comprising a linear display of one or more events corresponding to one or more events logged by the HMI application and showing a causal relationship between the one or more events and one or more user actions;
enable a display of an event log in the information subzone, the event log comprising a list of the one or more logged events.

### Claim 15 (depends on 13)

The computing system of claim 13, the one or more software applications further configured to:
enable a display of a component timeline in the information subzone, the component timeline comprising a linear display of one or more component statuses corresponding to one or more component status events logged by the HMI application; and
enable a display of a component log in the information subzone, the component log comprising a list of the one or more logged component status events.

### Claim 16 (depends on 13)

The computing system of claim 13, the one or more software applications further configured to:
enable a display of a pressure and temperature timeline in the information subzone, the pressure and temperature timeline comprising a linear display of one or more pressure and temperature statuses corresponding to one or more fluid flow status events logged by the HMI application; and
enable a display of a pressure and temperature log in the information subzone, the pressure and temperature log comprising a list of the one or more logged fluid flow status events.

### Claim 17 (depends on 4)

The computing system of claim 4, the one or more software applications being further configured to, after receiving a user selection of the testing option:
enable the display of one or more system testing type options in the interface control subzone, the one or more system testing type options comprising one or more of:
a function testing option, and
a pressure testing option;
enable the display of one or more test information fields in the information subzone, the one or more test information fields comprising one or more of:
test status information, and
test history information; and
after receiving a user selection of one of the one or more system testing type options, enable the display of one or more selectable test options.

### Claim 18 (depends on 17)

The computing system of claim 17, the one or more software applications being further configured to, after receiving a user selection of one or more of the one or more selectable test options:
perform one or more tests corresponding to the selected one or more selectable test options; and
delay performing one or more tests corresponding to the unselected one or more selectable test options.

### Claim 19 (depends on 1)

The computing system of claim 1, where the GUI comprises a single active interface window or a plurality of active interface windows and where the GUI displays:
the action zone in a central portion of the GUI;
the interface control subzone on a right side portion of the action zone;
the information subzone in a central portion of the action zone; and/or
the system control subzone on a left side portion of the action zone.

### Claim 20 (depends on 1)

The computing system of claim 1, the HMI application further configured to:
enable a display of a color palette comprising a red color and a green color;
display a red color to indicate one or more abnormal component states; and
display a green color to indicate one or more of an error-free operating status and a physical rig configuration having all rig components correctly configured for a particular rig operation.

### Claim 21 (depends on 14)

The computing system of claim 14, where the one or more events comprise one or more of a component failure and an alarm.

### Claim 22 (depends on 1)

The computing system of claim 1, where the GUI comprises a touch screen interface configured to enable a user to select one of the one or more selectable navigation options and one of the one or more selectable action options by touching an icon corresponding to the one or more selectable navigation options or the one or more selectable action options.

### Claim 23 (depends on 4)

The computing system of claim 4, the one or more software applications being further configured to, after receiving a user selection of the diagnostics option, enable the display of one or more system diagnostic options comprising one or more of:
a regulatory compliance option;
an operational status option; and
an event log option.

### Claim 24 (depends on 23)

The computing system of claim 23, the one or more software applications being further configured to, after receiving a user selection of the regulatory compliance option, enable the display of a diagnostic decision path tree comprising one or more levels, one or more nodes, and one or more pathways connecting the one or more nodes, each of the one or more nodes comprising an icon representing a current diagnostic state of one or more rig components.

### Claim 25 (depends on 24)

The computing system of claim 24, where the one or more icons comprises a first symbol to indicate one or more abnormal component states and a second symbol to indicate one or more error-free component states.

### Claim 26 (depends on 24)

The computing system of claim 24, where the one or more levels correspond to one or more rig components and the one or more nodes correspond to one or more component functions.

### Claim 27 (depends on 26)

The computing system of claim 26, where the one or more rig components comprise:
an integrated manifold assembly;
a regulator assembly;
a common rail; and/or
a rigid conduit and hot line valve package.

### Claim 28 (depends on 26)

The computing system of claim 26, the one or more software applications being further configured to:
receive a user selection of a level from the one or more levels;
enable the display of one or more diagnostic details corresponding to the selected level; and
enable the display of one or more functions, each of the one or more functions corresponding to the one or more rig components represented by the selected level.

### Claim 29

A method of implementing a human machine interface (HMI) application, the method comprising:
initiating a session of the HMI application by receiving a user input on a user interface running or stored on a hardware device comprising at least one processor;
enabling the display of a plurality of non-overlapping zones comprising an action zone and one or more of:
a high-level navigation zone comprising one or more selectable navigation options; and
a system header zone;
enabling the display of a plurality of selectable action options in the action zone, the action zone comprising a plurality of non-overlapping subzones, the subzones comprising:
an interface control subzone,
an information subzone, and
a system control subzone;
enabling the display of one or more selectable action options, the one or more selectable action options being displayed in predesignated subzones, wherein the plurality of selectable action options is modified based on a selection of the one or more selectable navigation options, wherein the selection is one or more of a user selection and a default selection; and
receiving, at the hardware device, data representing a user selection of one of the one or more selectable action options; and
controlling an operating state of one or more physical offshore drilling rig components based on the user selection.

### Claim 30 (depends on 29)

The method of claim 29, further comprising implementing one or more standard operating procedures applicable to one or more offshore drilling rigs.

### Claim 31 (depends on 30)

The method of claim 30, further comprising:
receiving, at the hardware device, data representing one or more modifications to the one or more standard operating procedures;
applying the one or more modifications to the one or more standard operating procedures to create one or more modified standard operating procedures; and
applying the one or more modified standard operating procedures to the one or more offshore drilling rigs.

### Claim 32 (depends on 29)

The method of claim 29, the one or more selectable navigation options comprising one or more of:
a blowout preventer (BOP) stack control option;
a diagnostics option;
a testing option;
a settings option;
an alarms option;
a diverter option;
a surface system option;
an electronic riser angle option; and
an emergency disconnect option.

### Claim 33 (depends on 32)

The method of claim 32, further comprising, after receiving a user selection of the BOP stack control option:
enabling the display of a layout diagram comprising one or more selectable components in the information subzone, the layout diagram representing a current stack arrangement of the one or more physical offshore drilling rig components; and
enabling the display of one or more control options in the interface control subzone, the one or more control options comprising one or more of:
one or more control procedures, and
one or more destructive function control modes.

### Claim 34 (depends on 29)

The method of claim 29, further comprising:
enabling the display of one or more visual status displays in the system control subzone; and
after receiving a user selection of one of the selectable components or control options, enabling the display of one or more function control options in the system control subzone, the one or more function control options corresponding to the user selection of one of the selectable components or control options.

### Claim 35 (depends on 33)

The method of claim 33, further comprising:
enabling the display of a flowpath within the layout diagram;
enabling the display of one or more colors for the flowpath, the one or more highlighted colors corresponding to one or more predicted flowpath states of the flowpath, wherein the one or more predicted flowpath states comprise:
a predicted fluid flow state;
a predicted fluid non-flow state; and/or
a predicted fluid pressure buildup state.
after receiving a user selection of one of the selectable components or control options, enabling the display of one or more function control options in the system control subzone, the one or more function control options corresponding to the user selection of one of the selectable components or control options.

### Claim 36 (depends on 33)

The method of claim 33, further comprising:
receiving a user input activating one or more destructive function control modes;
receiving a user selection of one or more destructive functions;
enabling the display of a destructive function confirmation option; and
upon receipt of a user selection of the destructive function confirmation option, performing one or more actions on the one or more physical rig components corresponding to the selected one or more destructive functions.

### Claim 37 (depends on 33)

The method of claim 33, further comprising, after receipt of a user selection of one of the selectable components, control options, or destructive function confirmation option, performing an audible feedback function, the audible feedback function comprising providing an audible confirmation of the user selection before a function corresponding to the user selection is initiated.

### Claim 38 (depends on 36)

The method of claim 36, where the one or more destructive functions comprise one or more of:
a pipe cutting action; and
a BOP disconnect action.

### Claim 39 (depends on 32)

The method of claim 32, further comprising, after receiving a user selection of the settings option:
enabling the display of a drag-and-drop interface comprising one or more component icons located in the interface control subzone, the component icons representing the one or more physical rig components; and
enabling the display of metadata, the metadata describing the one or more physical rig components.

### Claim 40 (depends on 39)

The method of claim 39, further comprising, after receiving a user selection of the at least one component operation option:
receiving a user selection of the one or more component icons;
enabling a user to drag the selected one or more component icons onto a layout diagram located in the information subzone, the layout diagram representing a current stack arrangement of the one or more physical rig components; and
upon receipt of the selected one or more component icons onto the layout diagram, modifying the layout diagram; and
controlling a movement operation of the one or more physical rig components into a modified current stack arrangement to match the one or more component icons comprising the modified layout diagram.

### Claim 41 (depends on 32)

The method of claim 32, further comprising, after receiving a user selection of the diagnostics option:
enabling the display of one or more system diagnostic options in the interface control subzone, the one or more system diagnostic options comprising one or more of:
a component diagnostic option,
a function diagnostic option, and
an event diagnostic option; and
enabling the display of one or more control options in the system control subzone, the one or more control options corresponding to the user selection of one of the one or more system diagnostic options.

### Claim 42 (depends on 41)

The method of claim 41, further comprising, after receiving a user selection of the event diagnostic option:
enabling a display of an event timeline in the information subzone, the event timeline comprising a linear display of one or more events corresponding to one or more events logged by the HMI application and showing a causal relationship between the one or more events and one or more user actions;
enabling a display of an event log in the information subzone, the event log comprising a list of the one or more logged events.

### Claim 43 (depends on 41)

The method of claim 41, further comprising:
enabling a display of a component timeline in the information subzone, the component timeline comprising a linear display of one or more component statuses corresponding to one or more component status events logged by the HMI application; and
enabling a display of a component log in the information subzone, the component log comprising a list of the one or more logged component status events.

### Claim 44 (depends on 41)

The method of claim 41, further comprising:
enabling a display of a pressure and temperature timeline in the information subzone, the pressure and temperature timeline comprising a linear display of one or more pressure and temperature statuses corresponding to one or more fluid flow status events logged by the HMI application; and
enabling a display of a pressure and temperature log in the information subzone, the pressure and temperature log comprising a list of the one or more logged fluid flow status events.

### Claim 45 (depends on 32)

The method of claim 32, further comprising, after receiving a user selection of the testing option:
enabling the display of one or more system testing type options in the interface control subzone, the one or more system testing type options comprising one or more of:
a function testing option, and
a pressure testing option;
enabling the display of one or more test information fields in the information subzone, the one or more test information fields comprising one or more of:
test status information, and
test history information; and
after receiving a user selection of one of the one or more system testing type options, enabling the display of one or more selectable test options.

### Claim 46 (depends on 45)

The method of claim 45, further comprising, after receiving a user selection of one or more of the one or more selectable test options:
performing one or more tests corresponding to the selected one or more selectable test options; and
delaying performing one or more tests corresponding to the unselected one or more selectable test options.

### Claim 47 (depends on 29)

The method of claim 29, where the GUI comprises a single active interface window or a plurality of active interface windows and where the GUI displays:
the action zone in a central portion of the GUI;
the interface control subzone on a right side portion of the action zone;
the information subzone in a central portion of the action zone; and/or
the system control subzone on a left side portion of the action zone.

### Claim 48 (depends on 29)

The method of claim 29, further comprising:
enabling a display of a color palette comprising a red color and a green color;
displaying a red color to indicate one or more abnormal component states; and
displaying a green color to indicate one or more of an error-free operating status and a physical rig configuration having all rig components correctly configured for a particular rig operation.

### Claim 49 (depends on 42)

The method of claim 42, where the one or more events comprise one or more of a component failure and an alarm.

### Claim 50 (depends on 29)

The method of claim 29, where the GUI comprises a touch screen interface configured to enable a user to select one of the one or more selectable navigation options and one of the one or more selectable action options by touching an icon corresponding to the one or more selectable navigation options or the one or more selectable action options.

### Claim 51 (depends on 32)

The method of claim 32, further comprising, after receiving a user selection of the diagnostics option, enabling the display of one or more system diagnostic options comprising one or more of:
a regulatory compliance option;
an operational status option; and
an event log option.

### Claim 52 (depends on 51)

The method of claim 51, further comprising, after receiving a user selection of the regulatory compliance option, enabling the display of a diagnostic decision path tree comprising one or more levels, one or more nodes, and one or more pathways connecting the one or more nodes, each of the one or more nodes comprising an icon representing a current diagnostic state of one or more rig components.

### Claim 53 (depends on 52)

The method of claim 52, where the one or more icons comprises a first symbol to indicate one or more abnormal component states and a second symbol to indicate one or more error-free component states.

### Claim 54 (depends on 52)

The method of claim 52, where the one or more levels correspond to one or more rig components and the one or more nodes correspond to one or more component functions.

### Claim 55 (depends on 54)

The method of claim 54, where the one or more rig components comprise:
an integrated manifold assembly;
a regulator assembly;
a common rail; and/or
a rigid conduit and hot line valve package.

### Claim 56 (depends on 54)

The method of claim 54, further comprising:
receiving a user selection of a level from the one or more levels;
enabling the display of one or more diagnostic details corresponding to the selected level; and
enabling the display of one or more functions, each of the one or more functions corresponding to the one or more rig components represented by the selected level.

### Claim 57

An apparatus for implementing a human machine interface (HMI) application, the apparatus comprising:
at least one processor configured to:
initiate a session of the HMI application by receiving a user input on a user interface running or stored on a hardware device comprising at least one processor;
receiving a user input activating one or more destructive function control modes;
receiving a user selection of one or more destructive functions;
enabling the display of a destructive function confirmation option; and
upon receipt of a user selection of the destructive function confirmation option, performing one or more actions on one or more physical offshore rig components corresponding to the selected one or more destructive functions.
