# US 2025/0184453 A1 · Method and apparatus for monitoring an industrial plant

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0184453 A1
- Document ID: US20250184453A1
- Status: Published application
- Kind: A1
- Application number: 18/845,016
- Filed: 2023-03-23
- Published: 2025-06-05
- Earliest claimed: 2022-03-23
- Assignees: BASF SE
- Applicants: BASF SE
- Inventors: Katharina HACK; Benjamin PRIESE; Volker HILDEBRANDT
- Web page: https://patentgrep.com/patent/US20250184453A1

## CPC

- G05B 23/0216: {Human interface functionality, e.g. monitoring system providing help to the user in the selection of tests or in its configuration}
- H04N 7/181: {for receiving images from a plurality of remote sources}
- G05B 19/0428: {Safety, monitoring (G05B19/0423 takes precedence)}
- G06V 10/74: Image or video pattern matching; Proximity measures in feature spaces
- G06V 20/48: {Matching video sequences}
- G06V 20/52: Surveillance or monitoring of activities, e.g. for recognising suspicious objects (recognising microscopic objects G06V20/69)
- G05B 2219/24015: Monitoring
- G05B 2219/24216: Supervision of system
- G05B: CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS (systems for controlling or regulating non-electric variables G05D; systems for regulating electric or magnetic variables G05F; control devices or systems insofar as characterised by mechanical features only G05G)
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

Disclosed herein is a method for monitoring an industrial plant including plant objects, where the following steps are carried out: receiving (S1) a video stream (VS) of the plant generated with the aid of a video camera device; assigning (S2) two-dimensional image components (PT) of the video stream (VS) to plant objects (A′, B′, C′, D′) with the aid of a three-dimensional (3D) model (CAD) of the plant; determining (S3) a recording property of the image data depending on the image components (PT) assigned to one or more plant objects (C′) and the respective object property (XYZ); and outputting (S4) the video stream (VS′) together with the determined object properties (XYZ) and/or recording properties. Further disclosed herein are a computer program product and an apparatus.

## Claims

### Claim 1

A method for monitoring an industrial plant comprising plant objects, the method comprising the following steps:
receiving (S1) a video stream (VS) of the plant generated with the aid of a video camera device, wherein the video stream (VS) comprises a temporal sequence of two-dimensional image data;
assigning (S2) two-dimensional image components (PT) of the video stream (VS) to plant objects (A′, B′, C′, D′) with the aid of a three-dimensional (3D) model (CAD) of the plant, in which respective object properties (XYZ) are allocated to the plant objects (A′, B′, C′, D′);
determining (S3) a recording property of the image data depending on the image components (PT) assigned to one or more plant objects (C′) and the respective object property (XYZ), wherein the recording property comprises a position, an orientation and a zoom factor of the video camera device which captures the video stream; and
outputting (S4) the video stream (VS′) together with the determined object properties (XYZ) and recording properties.

### Claim 2 (depends on 1)

The method according to claim 1, wherein the industrial plant is arranged on a plant site and the position of the video camera device on the plant site is ascertained.

### Claim 3 (depends on 2)

The method according to claim 2, wherein the video camera device has a video capture region which is smaller than the plant site.

### Claim 4 (depends on 1)

The method according to claim 1, wherein the video camera device is mounted at an unknown position during the step of receiving the video stream (VS).

### Claim 5 (depends on 1)

The method according to claim 1, wherein the object properties (XYZ) comprise a location, a size and/or dimension, an alignment and/or orientation, a list of constituents, material properties and/or surface properties of the plant object (A′, B′, C′, D′).

### Claim 6 (depends on 1)

The method according to claim 1, further comprising:
creating (S11) a database which assigns further functional properties and/or context data to the plant objects (A′, B′, C′, D′).

### Claim 7 (depends on 6)

The method according to claim 6, wherein the functional properties and/or context data are updated.

### Claim 8 (depends on 1)

The method according to claim 1, wherein the assigning (S2) further takes place depending on functional properties of the plant objects (A′, B′, C′, D′).

### Claim 9 (depends on 1)

The method according to claim 1, wherein the three-dimensional model is a computer-aided design model of the industrial plant.

### Claim 10 (depends on 1)

The method according to claim 1, wherein a dynamic recording property is determined with the aid of a temporal sequence of two-dimensional image components of the video stream (VS).

### Claim 11 (depends on 10)

The method according to claim 10, wherein the camera movement and/or zoom speed are/is ascertained in real time.

### Claim 12 (depends on 1)

The method according to claim 1, wherein the video stream (VS) does not comprise information data about the recording property, and the recording property is ascertained exclusively by way of a comparison of the assigned two-dimensional image components (PT) and the data of the 3D model (CAD).

### Claim 13 (depends on 1)

The method according to claim 1, wherein the 3D model data comprise a position of the video camera device.

### Claim 14 (depends on 1)

The method according to claim 1, wherein a zoom factor is ascertained depending on a plurality of temporally successive two-dimensional image data of the video camera device.

### Claim 15 (depends on 1)

The method according to claim 1, further comprising:
representing (S5) the video stream (VS) together with the object properties (XYZ) and/or recording properties with the aid of a display device.

### Claim 16 (depends on 1)

The method according to claim 1, further comprising:
creating (S12) the three-dimensional (3D) model of the plant, wherein object properties (XYZ) are allocated to the plant objects.

### Claim 17 (depends on 1)

The method according to claim 1, further comprising:
transmitting the video stream (VS) to a processing platform;
transmitting the 3D model (CAD) to the processing platform; and
transmitting the determined recording property from the processing platform to a display device;
wherein the processing platform is designed like a cloud service (CLD) and is configured to carry out the steps of assigning (S2) two-dimensional image components and determining (S3) the respective recording property in a computer-implemented manner in a secure processing environment (CLD).

### Claim 18 (depends on 1)

The method according to claim 1, further comprising:
receiving a plurality of video streams (VS) from different video camera devices;
wherein the steps of assigning (S2) two-dimensional image components (PT), determining (S3) a respective recording property and outputting (S4) the video stream (VS) take place for each video stream and the associated video camera devices in each case using a respective 3D model (CAD).

### Claim 19 (depends on 18)

The method according to claim 18, further comprising:
optionally forwarding one of the plurality of video streams to a processing platform, wherein the processing platform is a cloud service (CLD) and is configured to carry out the steps of assigning (S2) two-dimensional image components and determining (S3) the respective recording property in a computer-implemented manner in a secure processing environment.

### Claim 20 (depends on 1)

A computer program product, comprising machine-readable instructions which, when they are processed by one or more processor devices of a processing environment (CLD), cause one or all method steps of the method according to claim 1 to be carried out.

### Claim 21 (depends on 1)

An apparatus for carrying out the method according to claim 1, comprising:
a video camera device for generating the video stream (VS) of the industrial plant;
a storage device for providing the three-dimensional (3D) model of the plant, in which respective object properties (XYZ) are allocated to the plant objects (A′, B′, C′, D′);
a processing device for assigning two-dimensional image components (PT) of the video stream (VS) to plant objects with the aid of the 3D model, and for determining the recording property; and
a display device for outputting the video stream (VS) together with the determined object properties and/or recording properties;
wherein the video camera device, the storage device, the processing device and the display device are communicatively coupled to one another.
