Use of a live video stream in a process control system
AssigneeABB Schweiz AG
InventorTorbjörn Ottosson
Life of this patent
Estimating the term…
Abstract
A method, user interface control arrangement, and a computer program product for controlling a stationary user interface in an industrial process control system as well as to such a process control system. The user interface control arrangement obtains a first live video stream from a video camera monitoring an industrial process at a first location, obtains a process control view for the first location, overlays the process control view on the first live video stream and displays the first live video stream with the overlaid process control view on a display of the user interface.
Claims18
A method for controlling a stationary user interface in an industrial process control system, the method being performed by a user interface control arrangement and comprising the steps of:
- obtaining a first live video stream from a video camera monitoring an industrial process at a first location, where the industrial process comprises production of objects,
- obtaining a process control view for the first location, the process control view comprising at least one icon representing at least one process actuator,
- overlaying the process control view on the first live video stream,
- displaying the first live video stream with the overlaid process control view on a display of the user interface,
- detecting, in the first live video stream, an object being processed,
- determining the shape of the object using image recognition,
- comparing the shape of the object with a reference shape,
- determining an activity to be performed in the industrial process based on the difference between the shape of the object and the reference shape,
- providing a visual indication of the activity, which activity is an activity to be performed on the object,
- displaying the visual indication on the object in the first live video stream in order to assist the activity to be performed,
- detecting, via the user interface control arrangement, a control command from an operator, and
- sending the control command to a control device of the process control system for controlling the industrial process based on the control command, where the control command concerns the activity to be performed on the object.
A user interface control arrangement for controlling a stationary user interface in an industrial process control system, the user interface control arrangement comprising:
- a video obtaining unit configured to obtain a first live video stream from a video camera monitoring an industrial process at a first location, where the industrial process comprises production of objects,
- a control graphics unit configured to obtain a process control view for the first location, the process control view comprises at least one icon representing at least one process actuator,
- an image recognition unit configured to detect, in the first live video stream, an object being processed and determine the shape of the object,
- an activity determining unit configured to compare the shape of the object with a reference shape and determine an activity to be performed in the industrial process based on the difference between the shape of the object and the reference shape and provide a visual indication of the activity, which is an activity to be performed on the object, and
- a user interface control unit configured to overlay the process control view on the first live video stream, display the first live video stream with the overlaid process control view on a display of the user interface, display the visual indication on the object in the first live video stream in order to assist the activity to be performed, detect a control command from an operator and send the control command to a control device of the process control system for controlling the process based on the control command, where the control command concerns the activity to be performed on the object.
An industrial process control system for controlling an industrial process and comprising a user interface control arrangement having:
- a video obtaining unit configured to obtain a first live video stream from a video camera monitoring an industrial process at a first location, where the industrial process comprises production of objects,
- a control graphics unit configured to obtain a process control view for the first location, the process control view comprises at least one icon representing at least one process actuator,
- an image recognition unit configured to detect, in the first live video stream, an object being processed and determine the shape of the object,
- an activity determining unit configured to compare the shape of the object with a reference shape and determine an activity to be performed in the industrial process based on the difference between the shape of the object and the reference shape and provide a visual indication of the activity, which is an activity to be performed on the object, and
- a user interface control unit configured to overlay the process control view on the first live video stream, display the first live video stream with the overlaid process control view on a display of the user interface, display the visual indication on the object in the first live video stream in order to assist the activity to be performed, detect a control command from an operator and send the control command to a control device of the process control system for controlling the process based on the control command, where the control command concerns the activity to be performed on the object.
A computer program product for controlling a stationary user interface in an industrial process control system, said computer program product being provided on a data carrier comprising computer program code configured to cause a user interface control arrangement to, when said computer program code is loaded into at least one device providing the user interface control arrangement,
- obtain a first live video stream from a video camera monitoring an industrial process at a first location, where the industrial process comprises production of objects,
- obtain a process control view for the first location, the process control view comprising at least one icon representing at least one process actuator,
- overlay the process control view on the first live video stream,
- display the first live video stream with the overlaid process control view on a display of the user interface,
- detect, in the first live video stream, an object being processed,
- determine the shape of the object using image recognition,
- compare the shape of the object with a reference shape,
- determine an activity to be performed in the industrial process based on the difference between the shape of the object and the reference shape,
- provide a visual indication of the activity, which activity is an activity to be performed on the object,
- display the visual indication on the object in the first live video stream in order to assist the activity to be performed,
- detect, via the user interface control arrangement, a control command from an operator, and
- send the control command to a control device of the process control system for controlling the industrial process based on the control command, where the control command concerns the activity to be performed on the object.
Dependencies are inferred from the claim text.