# US 2019/0378222 A1 · Providing information on construction errors based on construction site images

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0378222 A1
- Document ID: US20190378222A1
- Status: Published application
- Kind: A1
- Application number: 16/543,557
- Filed: 2019-08-18
- Published: 2019-12-12
- Earliest claimed: 2018-02-17
- Assignees: Constru Ltd
- Inventors: Michael Sasson; Ron Zass; Shalom Bellaish; Moshe Nachman
- Web page: https://patentgrep.com/patent/US20190378222A1

## CPC

- G06Q 50/08: Construction
- G06F 16/2379: {Updates performed during online database operations; commit processing}
- G06F 16/583: using metadata automatically derived from the content
- G06F 18/2113: by ranking or filtering the set of features, e.g. using a measure of variance or of feature cross-correlation
- G06F 18/214: Generating training patterns; Bootstrap methods, e.g. bagging or boosting
- G06F 18/22: Matching criteria, e.g. proximity measures
- G06N 3/02: Neural networks
- G06N 3/0464: Convolutional networks [CNN, ConvNet]
- G06N 3/08: Learning methods
- G06N 3/09: Supervised learning
- G06N 20/00: Machine learning
- G06Q 10/06311: {Scheduling, planning or task assignment for a person or group}
- G06Q 40/03: Credit; Loans; Processing thereof
- G06Q 40/08: Insurance
- G06Q 40/12: Accounting
- G06T 7/0004: {Industrial image inspection}
- G06T 7/0006: {using a design-rule based approach}
- G06T 7/001: {using an image reference approach}
- G06T 7/70: Determining position or orientation of objects or cameras (camera calibration G06T7/80)
- G06V 10/10: Image acquisition (document image scanning and transmission H04N1/00; control of digital cameras H04N23/60)
- G06V 20/00: Scenes; Scene-specific elements (control of digital cameras H04N23/60)
- G06V 20/10: Terrestrial scenes (scenes under surveillance with static cameras G06V20/52; scenes perceived from the exterior of a vehicle G06V20/56; scenes perceived from the interior of a vehicle G06V20/59)
- G06V 20/176: {Urban or other man-made structures}
- G06V 20/20: in augmented reality scenes
- G06T 2200/24: involving graphical user interfaces [GUIs]
- G06T 2207/20092: Interactive image processing based on input by user
- G06T 2207/30132: Masonry; Concrete
- G06T 2207/30242: Counting objects in image
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

Systems and methods for providing information on construction errors based on construction site images are provided. For example, image data captured from a construction site using at least one image sensor may be obtained. The image data may be analyzed to identify at least one construction error. Further, the image data may be analyzed to identify a type of the at least one construction error. In response to a first identified type of the at least one construction error, first information may be provided, and in response to a second identified type of the at least one construction error, providing the first information may be forgone.

## Claims

### Claim 1

A method for providing information based on construction site images, the method comprising:
obtaining image data captured from a construction site using at least one image sensor;
analyzing the image data to identify at least one construction error;
analyzing the image data to identify a type of the at least one construction error; and
in response to a first identified type of the at least one construction error, providing first information; and
in response to a second identified type of the at least one construction error, forgoing providing the first information.

### Claim 2 (depends on 1)

The method of claim 1, further comprising:
in response to the second identified type of the at least one construction error, providing second information, the second information differs from the first information.

### Claim 3 (depends on 1)

The method of claim 1, further comprising:
analyzing the image data to determine a severity associated with the at least one construction error; and
based on the determined severity, forgoing providing at least part of the first information.

### Claim 4 (depends on 3)

The method of claim 3, further comprising:
obtaining at least one electronic record associated with the construction site; and
analyzing the at least one electronic record associated with the construction site and the image data to determine the severity associated with the at least one construction error.

### Claim 5 (depends on 1)

The method of claim 1, further comprising:
analyzing the image data to determine a severity associated with the at least one construction error; and
in response to a first determined severity, providing second information; and
in response to a second determined severity, providing third information, the third information differs from the second information.

### Claim 6 (depends on 1)

The method of claim 1, wherein the first information comprises an indication of the at least one construction error.

### Claim 7 (depends on 1)

The method of claim 1, further comprising presenting an image depicting the at least one construction error with a visual indication of the at least one construction error.

### Claim 8 (depends on 1)

The method of claim 1, further comprising presenting a visual presentation of at least part of a project schedule associated with the construction site, with the at least one construction error presented in conjunction to a task in the project schedule associated with the at least one construction error.

### Claim 9 (depends on 1)

The method of claim 1, further comprising presenting information related to objects associated with the construction site, with the at least one construction error presented in conjunction to an object associated with the at least one construction error.

### Claim 10 (depends on 1)

The method of claim 1, further comprising presenting an indication of a location of the at least one construction error on a map.

### Claim 11 (depends on 1)

The method of claim 1, further comprising presenting an indication of a location of the at least one construction error on a construction plan.

### Claim 12 (depends on 1)

The method of claim 1, further comprising presenting an indication of a location of the at least one construction error on an as-built model.

### Claim 13 (depends on 1)

The method of claim 1, further comprising:
obtaining at least one electronic record associated with the construction site; and
analyzing the at least one electronic record associated with the construction site and the image data to identify the type of the at least one construction error.

### Claim 14 (depends on 1)

The method of claim 1, further comprising:
analyzing the image data to detect an object;
analyzing the image data to identify a position related to the object;
obtaining at least one electronic record associated with the construction site; and
comparing the identified position related to the object with a position associated with the object in the at least one electronic record associated with the construction site to identify the at least one construction error.

### Claim 15 (depends on 14)

The method of claim 14, further comprising:
obtaining a construction plan associated with the construction site; and
comparing the identified position related to the object with a position associated with the object in construction plan to identify the at least one construction error.

### Claim 16 (depends on 1)

The method of claim 1, further comprising:
analyzing the image data to detect an object;
analyzing the image data to identify a property related to the object;
obtaining at least one electronic record associated with the construction site; and
comparing the identified property related to the object with a property associated with the object in the at least one electronic record associated with the construction site to identify the at least one construction error when a difference in the property is above a selected threshold.

### Claim 17 (depends on 16)

The method of claim 16, further comprising:
obtaining a construction plan associated with the construction site; and
comparing the identified property related to the object with a property associated with the object in the construction plan to identify the at least one construction error.

### Claim 18 (depends on 16)

The method of claim 16, wherein the identified property related to the object is a type of the object.

### Claim 19

A system for providing information based on construction site images, the system comprising:
at least one processor configured to:
obtain image data captured from a construction site using at least one image sensor;
analyze the image data to identify at least one construction error;
analyze the image data to identify a type of the at least one construction error; and
in response to a first identified type of the at least one construction error, provide first information; and
in response to a second identified type of the at least one construction error, forgo providing the first information.

### Claim 20

A non-transitory computer readable medium storing data and computer implementable instructions for carrying out a method for providing information based on construction site images, the method comprising:
obtaining image data captured from a construction site using at least one image sensor;
analyzing the image data to identify at least one construction error;
analyzing the image data to identify a type of the at least one construction error; and
in response to a first identified type of the at least one construction error, providing first information; and
in response to a second identified type of the at least one construction error, forgoing providing the first information.
