# US 2022/0284366 A1 · Method and system for managing a crane and/or construction site

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2022/0284366 A1
- Document ID: US20220284366A1
- Status: Published application
- Kind: A1
- Application number: 17/631,931
- Filed: 2020-07-30
- Published: 2022-09-08
- Earliest claimed: 2019-08-02
- Assignees: Global Engineers Technology Pte. Ltd.
- Applicants: Global Engineers Technology Pte. Ltd.
- Inventors: Bernard KELLY; Damon HANLIN
- Web page: https://patentgrep.com/patent/US20220284366A1

## CPC

- B66C 13/46: Position indicators for suspended loads or for crane elements
- G06Q 10/06311: {Scheduling, planning or task assignment for a person or group}
- B66C 13/16: Applications of indicating, registering, or weighing devices (in crane hooks B66C1/40; in safety gear B66C15/00; weighing-apparatus G01G; remote indicating in general G08)
- B66C 13/18: Control systems or devices (exclusively for rope, cable, or chain winding mechanisms B66D1/40)
- B66C 13/48: Automatic control of crane drives for producing a single or repeated working cycle; Program control
- B66C 15/065: {electrical}
- B66C 23/88: Safety gear (for cranes in general B66C15/00; for rope, cable, or chain winding mechanisms B66D1/54)
- G06Q 50/08: Construction
- G06V 20/38: {Outdoor scenes}
- B66C: CRANES; LOAD-ENGAGING ELEMENTS OR DEVICES FOR CRANES, CAPSTANS, WINCHES, OR TACKLES ({specially adapted for lifting invalids A61G7/10;} rope, cable, or chain winding mechanisms, braking or detent devices therefor B66D; specially adapted for nuclear reactors G21)
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

An apparatus for managing a construction site comprises a memory storing sensor data received from a plurality of capture devices associated with the construction site. The memory stores one or more rules or thresholds. A processor is configured to process the sensor data by evaluating at least one of the rules, or by comparing a prediction computed from the sensor data with at least one of the thresholds. The processor is configured, in response to evaluation of a rule, or in response to comparison of a prediction with a threshold, to trigger an alert.

## Claims

### Claim 1

An apparatus for managing a construction site and/or crane, the apparatus comprising:
a memory storing sensor data received from a plurality of capture devices associated with the construction site and/or crane;
the memory storing one or more rules or thresholds;
a processor configured to process the sensor data by evaluating at least one of the rules, or by comparing a prediction computed from the sensor data with at least one of the thresholds;
the processor configured, in response to evaluation of a rule, or in response to comparison of a prediction with a threshold, to trigger an alert.

### Claim 2 (depends on 1)

The apparatus of claim 1 wherein:
the memory stores a schedule of activities forming a critical path of a construction project at the construction site;
the sensor data comprises information about the activities;
the processor is configured to detect differences between the schedule of activities and the information about the activities from the sensor data; and
in response to detecting differences, the processor is configured to mitigate risks by following one or more rules according to the detected differences.

### Claim 3 (depends on 2)

The apparatus of claim 2 wherein the processor is configured to send a message comprising the information about the activities and the detected differences to one or more end user devices in real time.

### Claim 4 (depends on 1)

The apparatus of claim 1 wherein the sensor data comprises video received from at least one capture device having a field of view including at least part of the construction site and wherein the processor is configured to carry out image processing on one or more frames of the video in order to evaluate at least one of the rules.

### Claim 5 (depends on 4)

The apparatus of claim 4 wherein the image processing comprises detecting people depicted in the video by inputting the video to a trained object recognition system, and for each detected person, to input a region of the video depicting the person to a trained classifier, which classifies the region as depicting personal protection equipment or not.

### Claim 6 (depends on 5)

The apparatus of claim 5 comprising, in response to the classifier classifying a region as not depicting personal protection equipment, triggering the alert by triggering a message to be sent to a specified destination, the message comprising an image of the region input to the trained classifier.

### Claim 7 (depends on 4)

The apparatus of claim 4 wherein the video is received from two or more capture devices and wherein the image processing comprises computing a 3D model of the construction site.

### Claim 8 (depends on 7)

The apparatus of claim 7 wherein the image processing comprises detecting a tower crane by inputting the video to a trained object recognition system, and computing a no-go zone around the tower crane in the 3D model of the construction site.

### Claim 9 (depends on 8)

The apparatus of claim 8 wherein the image processing comprises detecting a mobile crane by inputting the video to the trained object recognition system, and wherein the processor is configured to evaluate a rule by checking if the detected mobile crane is in the no-go zone of the 3D model.

### Claim 10 (depends on 1)

The apparatus of claim 1 wherein the sensor data comprises video received from at least one capture device having a field of view including at least part of the construction site and wherein the processor is configured to carry out image processing to detect a building being built at the construction site and to compute a timestamped model of the building; the processor configured to evaluate at least one of the rules by comparing the model with a template having a corresponding timestamp.

### Claim 11 (depends on 10)

The apparatus of claim 10 wherein the processor is configured, in response to the comparison identifying a difference between the model and the template, to send a message comprising information about the difference and including one or more frames of the video.

### Claim 12 (depends on 11)

The apparatus of claim 11 wherein the processor is configured to access a database of solutions and to select one of the solutions on the basis of the difference, and to send the solution as part of the message.

### Claim 13 (depends on 1)

The apparatus of claim 1 wherein the sensor data comprises video received from at least one capture device having a field of view including at least part of the construction site and wherein the processor is configured to carry out image processing to detect a concrete pour by inputting the video to a trained object recognition system.

### Claim 14 (depends on 13)

The apparatus of claim 13 wherein the processor is configured to evaluate one of the rules by comparing a time stamp of a frame of the video depicting the concrete pour with a specified time, and in response to the comparison indicating a difference bigger than a threshold amount, sending a message comprising the difference and one or more frames of the video.

### Claim 15 (depends on 1)

The apparatus of claim 1 wherein the sensor data comprises video received from at least one capture device having a field of view including at least part of the construction site and wherein the processor is configured to carry out image processing to detect cease of building work at the construction site and in response, to request information from a human.

### Claim 16 (depends on 15)

The apparatus of claim 15 wherein the sensor data comprises information about weather at the site and information about road traffic around the site; and wherein the processor selects a solution from a database of solutions according to the sensor data and information received from a human operator.

### Claim 17 (depends on 10)

The apparatus of claim 10 wherein the processor is configured, in response to the comparison identifying a difference between the model and the template, to compute an update to a schedule and send the updated schedule to members of a labor force.

### Claim 18 (depends on 4)

The apparatus of claim 4 wherein the image processing comprises detecting one or more of: fuel spillage, tree damage, waste disposal, by inputting the video to a trained object recognition system.

### Claim 19 (depends on 1)

The apparatus of claim 1 wherein at least one of the capture devices is a satellite and wherein the processor is configured to evaluate one of the rules by comparing a design plan with one of more images from the satellite depicting the construction site.

### Claim 20 (depends on 1)

The apparatus of claim 1 wherein at least one of the capture devices is either:
a stress sensor within a building being constructed at the construction site and wherein the processor is configured to evaluate one of the rules by comparing data from the stress sensor with a threshold; or
a sensor measuring reduced level, which is a vertical distance between a survey point and an adopted datum plane, and wherein the processor is configured to evaluate one of the rules by comparing data from the sensor measuring reduced level with a target value from a stamped design of a building being constructed at the construction site.

### Claim 21 (depends on 4)

The apparatus of claim 4 wherein at least one of the capture devices is a load-moment indicator or strain-gauge of a crane at the construction site and wherein the processor is configured to:
detect reinforcing metal carried on a hook of the crane by inputting the video to an object recognition system;
synchronize sensor data from the load-moment indicator or strain gauge with the video; and
compare data from the load-moment indicator or strain gauge at the time the reinforcing metal is detected, with data from the load-moment indicator when the reinforcing metal is absent from the crane hook.

### Claim 22 (depends on 1)

The apparatus of claim 1 wherein the prediction is a prediction that an occupational health and safely accident is likely to occur at the construction site and where the prediction is computed from the sensor data by inputting the sensor data to a trained machine learning model together with information about one or more site incidents which have occurred at the construction site, the machine learning model having been trained using historical sensor data and historical site incident data from other construction sites.

### Claim 23 (depends on 1)

The apparatus of claim 1, wherein:
the construction site comprises a crane system; and
the one or more rules or thresholds relate to at least one operation of the crane system.

### Claim 24 (depends on 23)

The apparatus of claim 23, wherein:
the memory further stores a schedule of operations of the crane system;
the sensor data comprises information about the operations of the crane system;
the processor is further configured to detect differences between the schedule of operations of the crane system and the information about the operations of the crane system from the sensor data; and
in response to detecting differences, the processor is configured to follow one or more actions according to the detected differences.

### Claim 25 (depends on 24)

The apparatus of claim 24 wherein the processor is further configured to send a notification comprising the detected differences to a user device in real time.

### Claim 26 (depends on 23)

The apparatus of claim 23 wherein the sensor data further comprises video data from at least one capture device, the video data depicting at least part of the crane system or at least part of an environment in the vicinity of the crane system and wherein the processor is configured to perform image processing on one or more frames of the video in order to evaluate at least one of the rules or thresholds.

### Claim 27 (depends on 23)

The apparatus of claim 23 wherein the sensor data comprises motion data from at least one capture device providing information about the movement of the crane system and wherein the processor is configured to process the motion data in order to evaluate at least one of the rules or thresholds.

### Claim 28 (depends on 27)

The apparatus of claim 27 wherein the motion data is time-stamped and includes an amount of load carried, radius, and environmental conditions.

### Claim 29 (depends on 23)

The apparatus of claim 23 wherein the sensor data comprises image depicting a termination rope of a tower crane and wherein the rules or thresholds relate to correct termination of the termination rope or to presence of abnormality in the termination rope.

### Claim 30 (depends on 23)

The apparatus of claim 23 wherein the sensor data comprises data relating to aviation lights of a crane and wherein the rules or thresholds relate to correct operation of the aviation lights.

### Claim 31 (depends on 23)

The apparatus of claim 23 configured to automatically generate a crane monitoring diagram providing an overview of the sensor data and a crane.

### Claim 32 (depends on 23)

The apparatus of claim 23 wherein the rules or thresholds relate to a misalignment in a hoist termination pin of a crane, and wherein the apparatus is configured, in response to the rules or thresholds being triggered, to send instructions to have the crane shut down using an emergency shut down procedure and to send an alert to specified addresses.