# US 2019/0094834 A1 · Method and Device for Planning and/or Controlling and/or Simulating the Operation of a Construction Machine

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0094834 A1
- Document ID: US20190094834A1
- Status: Published application
- Kind: A1
- Application number: 16/091,920
- Filed: 2017-04-06
- Published: 2019-03-28
- Earliest claimed: 2016-04-08
- Assignees: Liebherr-Werk Biberach GmbH
- Applicants: Liebherr-Werk Biberach GmbH
- Inventors: Robert Bramberger
- Web page: https://patentgrep.com/patent/US20190094834A1

## CPC

- G05B 19/19: characterised by positioning or contouring control systems, e.g. to control position from one programmed point to another or to control movement along a programmed continuous path
- G06F 30/13: Architectural design, e.g. computer-aided architectural design [CAAD] related to design of buildings, bridges, landscapes, production plants or roads
- G06Q 10/06313: {Resource planning in a project environment}
- G06Q 10/06315: {Needs-based resource requirements planning or analysis}
- G06Q 10/067: Enterprise or organisation modelling
- G06Q 10/0674: {using process simulation}
- G06Q 50/08: Construction
- G09B 9/04: for teaching control of land vehicles
- G09B 19/167: {Control of land vehicles}
- G05B 2219/31276: Transport a lot to stations, each with different types of manufacturing equipment
- G05B: CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS (systems for controlling or regulating non-electric variables G05D; systems for regulating electric or magnetic variables G05F; control devices or systems insofar as characterised by mechanical features only G05G)
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G09B: EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS (devices for psychotechnics or for testing reaction times A61B5/16; games, sports, amusements A63; projectors, projector screens G03B)

## Abstract

A method and a device for planning and/or controlling and/or simulating the operation of a construction machine, in particular in the form of a crane, using a structure data model which contains digital information on a structure to be erected and/or to be worked on. A construction machine which can be linked to such a structure data model and/or can be controlled using such a structure data model. A construction machine data model which contains digital information on different construction machine models is linked to the structure data model or the BIM, characteristics of the available construction machines are already taken into consideration during the planning process, a simulator for training construction machine tasks is configured using the structure data model, and the controller of the construction machine is adapted to the structure data model with respect to specific control functions.

## Claims

### Claim 1

A method of planning and/or controlling the operation of a construction machine comprising:
automatically selecting a construction machine suitable for the erection and/or working of a structure with reference to a structure data model that includes digital information on the structure, wherein the automatic selection comprises:
providing a machine data model that includes digital information on different construction machine models;
automatically identifying relevant information from the structure data model with reference to criteria that are specified by the machine data model and relate to machine data in which the different construction machine models differ;
automatically comparing the identified relevant information from the structure data model with the machine data of different construction machinery from the machine data model; and
automatically selecting the suitable construction machine with reference to the comparison.

### Claim 2 (depends on 1)

The method in accordance with claim 1, wherein at least one piece of relevant information read from the structure data model is selected from the group consisting of structure height, weight of the heaviest construction element to be moved, area of the structure in elevation, cross-sectional extent of the structure in elevation, and maximum distance between a construction element delivery station and a construction element destination; and
wherein at least one piece of machine data from the machine data model is selected from the group consisting of machine lifting height, maximum hoist weight, and machine range.

### Claim 3 (depends on 1)

The method in accordance with claim 1 further comprising:
determining an installation position and/or checking a specific installation position of the selected construction machine relative to the structure to be erected and/or to be worked using digital information from the structure data model, wherein the following steps are carried out when determining and/or checking the work position:
automatically identifying relevant information from the structure data model and relevant information from the machine data model, wherein the information from the structure data model at least comprises structure dimensions and the information from the machine data model at least comprises the working range of the selected construction machine; and
automatically comparing the working range of the construction machine with structure contours for checking a sufficient range and/or possible collisions.

### Claim 4 (depends on 3)

The method in accordance with claim 3, wherein the working range of the selected construction machine is automatically restricted with reference to the collision check and the structure data model is updated by the fixed working range restrictions.

### Claim 5 (depends on 1)

The method in accordance with claim 1, wherein the order and/or the times of a delivery of parts of the selected construction machine is/are automatically fixed with reference to the structure data model by a logistics module communicating with the structure data model.

### Claim 6 (depends on 5)

The method in accordance with claim 5, wherein transport units required for the delivery of the parts of the selected construction machine are automatically determined by the logistics module with reference to the structure data model.

### Claim 7 (depends on 1)

The method in accordance with the preamble of claim 1 further comprising:
providing digital information from the structure data model to a simulator for simulating the operation of the construction machine on the basis of the information provided; and
generating a virtual representation of the structure to be erected and/or to be worked on a display apparatus of a control station of the simulator with the aid of the provided digital information from the structure data model.

### Claim 8 (depends on 7)

The method in accordance with claim 7, wherein digital information on different construction phases of the structure to be erected and/or to be worked is accessed from the structure data model by a construction phase selection module and a virtual representation of the structure in different construction phases is represented on the display apparatus of the simulator.

### Claim 9 (depends on 7)

The method in accordance with claim 7, wherein digital information relating to the working and/or moving of a construction element is read out of the structure data model by a job simulation module and a virtual representation of the construction element to be worked and/or of the movement path of the construction element to be worked relative to the structure is represented on the display apparatus of the simulator.

### Claim 10 (depends on 1)

The method in accordance with claim 1, wherein digital information from the structure data model is provided to a plurality of simulators; and
wherein a respective virtual representation of the structure to be erected and/or to be worked is generated by graphical simulation modules of the plurality of simulators on the basis of the information provided from the structure data model and is displayed on display apparatus of the simulators.

### Claim 11 (depends on 10)

The method in accordance with claim 10, wherein the plurality of simulators are controlled in coordination with one another by a higher ranking simulator control apparatus; and
wherein the graphical simulation modules of the plurality of simulators are controlled in dependence on control commands that are input at a respective other simulator such that the virtual representation is generated at a simulator, also in dependence on construction machine operating procedures that are simulated at a different simulator.

### Claim 12 (depends on 1)

The method in accordance with claim 1 further comprising:
providing digital information from the structure data model to a construction machine; and
influencing at least one control function of a construction machine control device in dependence on the provided digital information from the structure data model.

### Claim 13 (depends on 12)

The method in accordance with claim 12, wherein a working region boundary function taken into account by the construction machine control apparatus is changed by a working range boundary setting module in dependence on digital information from the structure data model.

### Claim 14 (depends on 13)

The method in accordance with claim 13, wherein the working region boundary function is automatically updated and adapted in dependence on construction progresses at the structure to be erected and/or to be worked while taking account of digital information from the structure data model.

### Claim 15 (depends on 13)

The method in accordance with claim 13, wherein machine data of the construction machine that characterize its installation location and/or working range are compared by a collision determination module with structure data from the structure data model that characterize structure contours and/or topographic surrounding contours; and wherein the working range boundary function is adapted by the working range boundary setting module on the basis of the comparison.

### Claim 16 (depends on 1)

The method in accordance with claim 1, wherein an actual state of the structure is detected by means of at least one detection device;
wherein the detected actual state of the structure is compared with digital information from the structure data model by a construction progress determination module; and
wherein digital information from the structure data model determined in dependence on the comparison is provided to the construction machine control apparatus.

### Claim 17 (depends on 16)

The method in accordance with claim 16, wherein a virtual representation of the structure in accordance with the determined actual state and/or a virtual representation of the next work job to be carried out by the construction machine is presented on a display apparatus that is arranged at the construction machine or at a control station for the remote-control of the construction machine in dependence on the determined digital information from the structure data model that is provided to the construction machine in dependence on the determined construction progress.

### Claim 18 (depends on 17)

The method in accordance with claim 17, wherein a virtual representation of the next construction element to be worked and of the installation position of the construction element at the structure in dependence on the determined actual state of the structure is generated in dependence on digital information from the structure data model.

### Claim 19 (depends on 1)

The method in accordance with claim 1, wherein a construction element located in a pick-up region and/or working range of the construction machine is automatically detected by means of a detection apparatus;
wherein digital information relating to the working of the detected construction element is provided from the structure data model in dependence on the detected construction element; and
wherein a working step relating to the detected construction element is automatically carried out by the construction machine control apparatus on the basis of the digital information provided by the structure data model.

### Claim 20 (depends on 17)

The method in accordance with claim 17, wherein the digital information from the structure data model provide position data that indicate the destination of the construction element and/or travel path data that indicate the travel path of the construction element; and wherein the construction element is automatically lifted and/or traveled by the construction machine control apparatus in dependence on the position data and/or travel path data.

### Claim 21

An apparatus for planning and/or controlling the operation of a construction machine using a structure data model that includes digital information on a structure to be erected and/or to be worked comprising:
a machine selection module for the automatic selection of a construction machine suitable for the erection and/or working of the structure with reference to digital information of the structure data model;
a machine data model that includes digital information on different construction machine models;
a data selection module for automatically identifying and reading relevant information from the structure data model with reference to criteria that are specified by the machine data model and relate to machine data in which the different construction machine models differ; and
a comparison module for automatically comparing the read information from the structure data model with the machine data of different construction machines from the machine data model;
wherein the machine selection module is configured for the automatic selection of the suitable construction machine of the comparison.

### Claim 22 (depends on 21)

The apparatus in accordance with claim 21, wherein at least one piece of the information read out of the structure data model by the data selection module is selected from the group consisting of structure height, weight of the heaviest construction element to be moved, area of the structure in elevation, cross-sectional extent of the structure in elevation, and maximum distance between a construction element delivery station and a construction element destination; and
wherein at least one piece of machine data from the machine data model is selected from the group consisting of machine lift height, maximum machine payload, and machine range.

### Claim 23 (depends on 21)

The apparatus in accordance with claim 21 further comprising:
an installation location determination module for determining an installation position and/or for checking a specific installation position of the selected construction machine relative to the structure to be erected and/or to be worked using digital information from the structure data model;
a data selection module for automatically identifying and reading relevant information from the structure data model and relevant information from the machine data model, wherein the information from the structure data model at least comprises structure dimensions and the read information from the machine data model at least comprises the working range of the selected construction machine; and
a collision determination module for automatically comparing the working range of the construction machine with structure contours for checking a sufficient range and/or possible collisions.

### Claim 24 (depends on 23)

The apparatus in accordance with claim 23, wherein a working range boundary setting module is provided for setting the working range boundary of the selected construction machine with reference to the collision check and for updating the structure data model by the determined working range boundaries.

### Claim 25 (depends on 21)

The apparatus in accordance with claim 21 further comprising a logistics module for determining the order and/or the times of a delivery of parts of the selected construction machine with reference to digital information of the structure data model.

### Claim 26 (depends on 25)

The apparatus in accordance with claim 25, wherein the logistics module is configured to automatically determine transport units required for the delivery of the parts of the selected construction machine with reference to the structure data model.

### Claim 27 (depends on 21)

The apparatus in accordance with claim 21 further comprising:
a simulator for simulating the operation of the construction machine on the basis of information provided from the structure data model, with the simulator having an interface for communicating with the structure data model; and
a graphical simulation module for generating a virtual representation of the structure to be erected and/or to be worked on a display apparatus of a control station of the simulator with the aid of the provided digital information from the structure data model.

### Claim 28 (depends on 27)

The apparatus in accordance with claim 27 further comprising a construction phase selection module for selecting digital information on different construction phases of the structure to be erected and/or to be worked from the structure data model;
wherein the construction phase selection module is connected to the graphical simulation module such that a virtual representation of the structure can be displayed in different construction phases on the display apparatus of the simulator.

### Claim 29 (depends on 27)

The apparatus in accordance with claim 27 further comprising a job simulation module for reading digital information relating to the working and/or moving of a construction element from the structure data model;
wherein the job simulation module is connected to the graphical simulation module such that a virtual representation of the construction element to be worked and/or of the movement path of the construction element to be worked relative to the structure is represented on the display apparatus of the simulator.

### Claim 30 (depends on 27)

The apparatus in accordance with claim 27 further comprising a plurality of simulators linked to the structure data model; and
wherein a respective virtual representation of the structure to be erected and/or to be worked is generated by graphical simulation modules of the plurality of simulators on the basis of the information provided from the structure data model and is displayed on display apparatus of the simulators.

### Claim 31 (depends on 30)

The apparatus in accordance with claim 30, wherein the plurality of simulators are controlled in coordination with one another by a higher ranking simulator control apparatus; and
wherein the graphical simulation modules of the plurality of simulators are controlled in dependence control commands that are input at a respective other simulator such that the virtual representation is generated at a simulator, also in dependence on construction machine operating procedures that are simulated at a different simulator.

### Claim 32 (depends on 21)

The apparatus in accordance with claim 21 further comprising:
a data communication device for providing digital information from the structure data model to a construction machine; and
a control configuration module for influencing at least one control function of a construction machine control device in dependence on the provided digital information from the structure data model.

### Claim 33 (depends on 21)

The apparatus in accordance with claim 21 further comprising a control configuration module configured to change a working range boundary function taken into account by the construction machine control apparatus in dependence on digital information from the structure data model.

### Claim 34 (depends on 33)

The apparatus in accordance with claim 33, wherein the control configuration module is configured to automatically update and/or to automatically adapt cyclically or continuously the working range boundary function in dependence on construction progresses at the structure to be erected and/or to be worked while taking account of digital information from the structure data model.

### Claim 35 (depends on 33)

The apparatus in accordance with claim 33 further comprising a collision determination module for comparing machine data of the construction machine that characterize its installation location and/or working range with structure data from the structure data model that characterize structure contours and/or topographic structure surrounding contours;
wherein the control configuration module is configured to adapt the working range boundary function on the basis of the comparison.

### Claim 36 (depends on 21)

The apparatus in accordance with claim 21 further comprising:
at least one detection device for detecting an actual state of the structure;
a construction phase determination module for comparing the detected actual state of the structure with digital information from the structure data model and for determining the construction phase in dependence on the comparison; and
a data communication device for providing digital information from the structure data model to a construction machine configured to provide specific digital information from the structure data model to the construction machine control apparatus in dependence on the determined construction phase.

### Claim 37 (depends on 36)

The apparatus in accordance with claim 36, wherein the control configuration module is configured to display a virtual representation of the structure in accordance with the determined actual state and/or a virtual representation of the next work job to be carried out by the construction machine on a display apparatus that is arranged at the construction machine or at a control station for the remote-control of the construction machine in dependence on the specific digital information from the structure data model that is provided to the construction machine in dependence on the determined construction progress.

### Claim 38 (depends on 37)

The apparatus in accordance with claim 37, wherein the control configuration module is configured to display a virtual representation of the next construction element to be worked and of the installed position of the construction element at the structure in dependence on the determined actual state of the structure.

### Claim 39 (depends on 36)

The apparatus in accordance with claim 36, wherein at least one of the detection devices is for detecting an actual state of the structure is installed at a remote-controlled aerial drone.

### Claim 40 (depends on 21)

The apparatus in accordance with claim 21 further comprising:
a detection apparatus for detecting a construction element located in the pick-up region and/or working range of the construction machine;
a data communication device configured to provide digital information relating to the working of the detected construction element in dependence on the detected construction element from the structure data model to the construction machine control apparatus; and
a control configuration module configured to automatically carry out a working step relating to the detected construction element on the basis of the digital information provided by the structure data model.

### Claim 41 (depends on 40)

The apparatus in accordance with claim 40, wherein the digital information from the structure data model comprise position data that indicate the destination of the construction element and/or travel path data that indicate the travel path of the construction element; and
wherein the control configuration module is configured to raise and/or to travel the construction machine automatically in dependence on the position data and/or travel path data.

### Claim 42 (depends on 40)

The apparatus in accordance with claim 40, wherein the detection apparatus comprises one or more of a camera, an imaging sensor, a barcode scanner, and an RFID reader.

### Claim 43 (depends on 32)

The apparatus in accordance with claim 32, wherein the data communication device comprises a construction site computer that is provided on the construction site and that is communicationally connected to the construction machine.

### Claim 44

A construction machine, comprising:
a construction machine control apparatus for controlling the construction machine;
a data communication device for receiving and processing digital information from a structure data model; and
a control configuration module for influencing at least one control function of the construction machine control in dependence on the received digital information from the structure data model.

### Claim 45 (depends on 44)

The construction machine in accordance with claim 44, wherein the control configuration module is configured to one or more of:
change a working range boundary function taken into account by the construction machine control apparatus in dependence on digital information from the structure data model;
display a virtual representation of the structure in accordance with the determined actual state and/or a virtual representation of the next work job to be carried out by the construction machine on a display apparatus that is arranged at the construction machine or at a control station for the remote-control of the construction machine in dependence on digital information from the structure data model in dependence on a determined construction phase; and
display a virtual representation of the next construction element to be worked and the installed position of the construction element at the structure in dependence on digital data from the structure data model.

### Claim 46 (depends on 44)

The construction machine in accordance with claim 44 further comprising a detection apparatus for detecting a construction element located in a pick-up region and/or working range of the construction machine;
wherein the data communication device is configured to provide digital information relating to the working of the detected construction element in dependence on the detected construction element from the structure data model to the construction machine control apparatus; and
wherein the control configuration module is configured to automatically carry out a working step relating to the detected construction element on the basis of the digital information provided by the structure data model.

### Claim 47 (depends on 46)

The construction machine in accordance with claim 46, wherein the digital information from the structure data model comprise position data that indicate the destination of the construction element and/or travel path data that indicate the travel path of the construction element; and wherein the control configuration module is configured to raise and/or to travel the construction machine automatically in dependence on the position data and/or travel path data.

### Claim 48 (depends on 46)

The construction machine in accordance with claim 46, wherein the detection apparatus comprises one or more of a camera, an imaging sensor, a barcode scanner, and an RFID reader.

### Claim 49

A simulator for simulating the operation of a construction machine on the basis of information provided from a structure data model, wherein the simulator has an interface for communicating with the structure data model, a graphical simulation module for generating a virtual representation of the structure to be erected and/or worked, a display apparatus for displaying the virtual representation and a control station having input means for inputting control commands for the construction machine, characterized by a data communication device for receiving and processing digital information from a structure data model, and by a control configuration module for influencing at least one control function of the simulator in dependence on the digital information received from the structure data model.

### Claim 50 (depends on 49)

The simulator in accordance with claim 49, wherein a construction phase selection module is provided for selecting digital information on different construction phases of the structure to be erected and/or to be worked from the structure data model and is connected to the graphical simulation module such that a virtual representation of the structure can be displayed in different construction phases on the display apparatus of the simulator.

### Claim 51 (depends on 49)

The simulator in accordance with claim 49, wherein a job simulation module is provided for reading digital information relating to the working and/or moving of a construction element from the structure data model and is connected to the graphical simulation module such that a virtual representation of the construction element to be worked and/or of the movement path of the construction element to be worked relative to the structure is represented on the display apparatus of the simulator.

### Claim 52

A remote-control device for a construction machine having a control station that has at least one input means for inputting control commands and that has a signal transmission device for transmitting the input control commands to the control apparatus of the construction machine; and
having a display apparatus for displaying a representation of a piece of working equipment and/or of the machine surroundings;
wherein a data communication device is provided for receiving and processing digital information from a structure data model, and by a control configuration module for influencing at least one control function of the construction machine control device in dependence on the digital information received from the structure data model.

### Claim 53

A software program product for planning and/or controlling the operation of a construction machine using a structure data model that includes digital information on a structure to be erected and/or to be worked, comprising:
a machine selection program means for the automatic selection of a construction machine suitable for the erection and/or working of the structure with reference to digital information of the structure data model;
a machine data model that includes digital information on different construction machine models;
a data selection program means for automatically identifying and reading relevant information from the structure data model with reference to criteria that are specified by the machine data model and relate to machine data in which the different construction machine models differ; and
a comparison program means for automatically comparing the read information from the structure data model with the machine data of different construction machines from the machine data model;
wherein the machine selection program means is configured for the automatic selection of the suitable construction machine with reference to the comparison.

### Claim 54 (depends on 53)

The software program product in accordance with claim 53, wherein the information read out of the structure data model by the data selection program means comprises at least one of the following pieces of information:
structure height, weight of the heaviest construction element to be moved, area and/or cross-sectional extent of the structure in elevation, and maximum distance between a construction element delivery station and a construction element destination; and
wherein the machine data from the machine data model compared with the at least one piece of information read out of the structure data model include at least one of the following pieces of information: machine lift height, maximum machine payload, and machine range.

### Claim 55 (depends on 53)

The software program product in accordance with claim 53 further comprising:
an installation location determination program means for determining an installation position and/or for checking a specific installation position of the selected construction machine relative to the structure to be erected and/or to be worked using digital information from the structure data model;
a data selection program means for automatically identifying and reading relevant information from the structure data model and relevant information from the machine data model, wherein the information from the structure data model at least comprises structure dimensions and the read information from the machine data model at least comprises the working range of the selected construction machine; and
a collision determination program means for automatically comparing the working range of the construction machine with structure contours for checking a sufficient range and/or possible collisions.

### Claim 56 (depends on 55)

The software program product in accordance with claim 55, wherein a working range boundary setting program means is provided for setting the working range of the selected construction machine with reference to collision check and for updating the structure data model by the fixed working range restrictions.

### Claim 57 (depends on 53)

The software program product in accordance with claim 53, wherein a logistics program means is provided for determining the order and/or the times of the delivery of parts of the selected construction machine with reference to digital information of the structure data model.

### Claim 58 (depends on 57)

The software program product in accordance with claim 57, wherein the logistics program means is configured to automatically determine transport units required for the delivery of the parts of the selected construction machine with reference to the structure data model.
