# US 8,786,399 B2 · Computer implemented method to display technical data for monitoring an industrial installation > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 8,786,399 B2 - Document ID: US8786399B2 - Status: Granted - Kind: B2 - Application number: 12/594,053 - Filed: 2008-03-27 - Published: 2010-08-19 - Granted: 2014-07-22 - Earliest claimed: 2007-03-30 - Assignees: ABB Research Ltd. - Applicants: Charlotte Skourup; Siri Breen; Nicolas-Alexander Hall - Inventors: Charlotte Skourup; Siri Breen; Nicolas-Alexander Hall - Web page: https://patentgrep.com/patent/US8786399B2 ## CPC - G05B 23/0267: {Fault communication, e.g. human machine interface [HMI]} - G05B: CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS (systems for controlling or regulating non-electric variables G05D; systems for regulating electric or magnetic variables G05F; control devices or systems insofar as characterised by mechanical features only G05G) ## Abstract A computer implemented method to display an industrial installation, which display may also display information about an event or an alarm in the installation. The method includes displaying an image which appears to the viewer to be a three dimensional holographic image including a view of the industrial installation. The image may also include one or more points in three dimensional space and which point or points are each mapped to a corresponding point or position in the industrial installation. A pointing device for actively indicating position on the image reflecting objects or positions in the installation is also described. ## Claims ### Claim 1 A computer implemented method to generate a display of an industrial installation including information about an event or an alarm, the method comprising: displaying on at least one display device a holographic image comprising a view of said industrial installation, wherein the view comprises at least one point in three dimensional space; mapping the at least one point to a corresponding point or position in said industrial installation; placing by a user a pointer object near to one of the at least one point in the holographic image; detecting a change in a transmission, reflection, refraction or scattering of at least one ray of light making up the holographic image; and mapping the changed or disrupted at least one ray of light to at least one point in three dimensional space and subsequently to at least one point in three dimensional space in a computer implemented three dimensional model of said industrial installation. ### Claim 2 (depends on 1) The method according to claim 1, further comprising: generating an enlarged view of a first part of the holographic image containing the process section or part thereof associated with the at least one point that has been selected. ### Claim 3 (depends on 1) The method according to claim 1, further comprising: generating an enlarged view of a second part of the holographic image which is a view adjacent to or overlapping the view of the process section or part thereof. ### Claim 4 (depends on 1) The method according to claim 1, further comprising: generating a display comprising information about a selected equipment, process or operator. ### Claim 5 (depends on 1) The method according to claim 1, further comprising: rotating the holographic image about a vertical axis and providing a view of other parts of the holographic image. ### Claim 6 (depends on 1) The method according to claim 1, further comprising: rotating the holographic image about a non-vertical axis and providing a view of other parts of the holographic image. ### Claim 7 (depends on 1) The method according to claim 1, further comprising: detecting a change or disruption of the at least one ray of light making up the holographic image; and identifying the one of the at least one point in three dimensional space that has been selected. ### Claim 8 (depends on 1) The method according to claim 1, further comprising: displaying at least one point in three dimensional space that represents the event or the alarm in said industrial installation. ### Claim 9 (depends on 8) The method according to claim 8, further comprising: selecting at least one of the at least one point in three dimensional space representing the event or the alarm; and generating a display of information about the event or alarm in said industrial installation. ### Claim 10 (depends on 1) The method according to claim 1, further comprising: mapping the one of the at least one point that has been identified to at least one personnel located at an equipment, process section or part thereof in said industrial installation; and generating a display of information on the holographic image showing a location of each of personnel on a platform. ### Claim 11 A computer program product, comprising: a non-transitory computer readable medium; and software code elements recorded on the non-transitory computer readable medium which when read into a computer or processor will cause the computer or processor to carry out a method to retrieve and display technical data for an industrial device using a computer program for control, the method comprising displaying on at least one display device a holographic image comprising a view of said industrial installation, wherein the view comprises at least one point in three dimensional space, mapping the at least one point to a corresponding point or position in said industrial installation, placing by a user a pointer object near to one of the at least one point in the holographic image, detecting a change in a transmission, reflection, refraction or scattering of at least one ray of light making up the holographic image, and mapping the changed or disrupted at least one ray of light to at least one point in three dimensional space and subsequently to at least one point in three dimensional space in a computer implemented three dimensional model of said industrial installation. ### Claim 12 A control system for an industrial installation, the control system comprising: a computer program to generate a display of an industrial installation including information about an event or an alarm, and a computer configured to generate on at least one display device a display of a holographic image comprising a view of said industrial installation, said view comprising at least one point in three dimensional space, wherein the at least one point is mapped to a corresponding point or position in said industrial installation, wherein when a user places a pointer object near to one of the at least one point in the holographic image, at least one point is mapped to a detected change in a transmission, reflection, refraction or scattering of at least one ray of light making up the holographic image and subsequently to at least one point in three dimensional space in a computer implemented three dimensional model of said industrial installation. ### Claim 13 (depends on 12) The control system according to claim 12, further comprising: a determining element configured to determine that a pointer object has been placed by a user near to the one of the at least one point in the holographic image; and an identification element configured to identify the at least one point that has been selected by the user. ### Claim 14 (depends on 12) The control system according to claim 12, further comprising: an optical register configured to determine whether a pointer object has been placed near to the at least one of the at least one point in the holographic image; and an identification element configured to identify the at least one of the at least one point which has been selected. ### Claim 15 (depends on 12) The control system according to claim 12, further comprising: a computer program configured to map the at least one of the at least one point which has been identified to at least one equipment, process section or part thereof in said industrial installation or to at least one personnel located at an equipment, process section or part thereof in said industrial installation. ### Claim 16 (depends on 12) The control system according to claim 12, further comprising: a computer-implemented 3-D model of said industrial installation. ### Claim 17 (depends on 12) The control system according to claim 12, further comprising: a link to at least one of the control system for said industrial installation or at least one database storing data for said industrial installation. ### Claim 18 (depends on 12) The system according to claim 12, further comprising: a computer program stored in a memory device or on a non-transitory computer readable medium which when read into a computer or processor will cause the computer or processor to carry out one or more instructions for a method to retrieve and display technical data for an industrial device, the method comprising displaying on at least one display device a holographic image comprising a view of said industrial installation, wherein the view comprises at least one point in three dimensional space, mapping the at least one point to a corresponding point or position in said industrial installation, placing by a user a pointer object near to one of the at least one point in the holographic image, detecting a change in a transmission, reflection, refraction or scattering of at least one ray of light making up the holographic image, and mapping the changed or disrupted at least one ray of light to at least one point in three dimensional space and subsequently to at least one point in three dimensional space in a computer implemented three dimensional model of said industrial installation. ### Claim 19 A holographic user interface for providing a display of an industrial installation, or part thereof, including information about an event or an alarm, wherein a view of said industrial installation comprises displayed on at least one display device a holographic image, wherein the view comprises at least one point in three dimensional space, wherein the at least one point is each mapped to a corresponding point or position in said industrial installation, wherein a pointer object is placed by a user near to at least point in the holographic image, wherein at least one detected change in a transmission, reflection, refraction or scattering of at least one ray of light making up the holographic image is mapped to at least one point in three dimensional space and subsequently to at least one point in three dimensional space in a computer implemented three dimensional model of said industrial installation. ### Claim 20 (depends on 1) The method according to claim 1, wherein the method carries out any from the group of: providing an overview of a status of the installation, checking a status of an industrial device, checking a process variable. ### Claim 21 (depends on 1) The method according to claim 1, wherein the method carries out any from the list of: checking a status of an industrial device, tuning a process, checking a process variable, checking the event or the alarm, checking a status of an oil platform. ### Claim 22 (depends on 1) The method according to claim 1, further comprising: mapping the one of the at least one point that has been identified to an equipment, process section or part thereof in said industrial installation. ### Claim 23 (depends on 1) The method according to claim 1, further comprising: mapping the one of the at least one point that has been identified to at least one personnel located at an equipment, process section or part thereof in said industrial installation. ### Claim 24 (depends on 4) The method according to claim 4, further comprising: generating, on a display device that is separate from the at least one display device displaying the holographic image, a display comprising a graphic user interface navigation element.