# US 2023/0267392 A1 · Computer System and Method for Predicting Risk Level of Punch Items

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2023/0267392 A1
- Document ID: US20230267392A1
- Status: Published application
- Kind: A1
- Application number: 18/158,278
- Filed: 2023-01-23
- Published: 2023-08-24
- Earliest claimed: 2018-08-31
- Assignees: Procore Technologies, Inc.
- Applicants: Procore Technologies, Inc.
- Inventors: Carlos Torres; Nina Kaufman; Evin Sellin; Wojciech Peliks; Mark Weeks; Arshdeep Kaur; Nicholas Murphy; Fatima Howes
- Web page: https://patentgrep.com/patent/US20230267392A1

## CPC

- G06Q 10/06313: {Resource planning in a project environment}
- G06N 5/022: Knowledge engineering; Knowledge acquisition
- G06N 7/01: Probabilistic graphical models, e.g. probabilistic networks
- G06N 20/00: Machine learning
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS

## Abstract

A computing system such as a back-end platform for construction management software may employ a predictive model to provide individuals responsible for overseeing a construction project with a prediction of a “risk level” for a punch item, which indicates a risk of the punch item not being completed by the punch item's target completion date. Such a predictive model may be defined based on historical-punch-items data. After defining the predictive model, the computing system may receive data defining a given punch item and input such data into the predictive model, which may in turn output a given predicted risk level for the given punch item. Thereafter, the computing system may cause a client station to display an indication of the given predicted risk level for the given punch item.

## Claims

### Claim 1

A computing platform comprising:
a network interface;
at least one processor;
a non-transitory computer-readable medium; and
program instructions stored on the non-transitory computer-readable medium that are executable by the at least one processor such that the computing platform is configured to:
cause a first client station to display a user interface for creating punch items for a construction project by inputting data defining punch-items;
receive, from the first client station, respective punch-item data defining each of a plurality of punch items,
for each punch item in the plurality of punch items, derive, based on the received punch-item data, additional punch-item data, wherein (i) the received punch-item data and (ii) the derived additional punch-item data for each punch item comprise a respective set of punch-item variables;
for each punch item in the plurality of punch items, apply a trained machine learning model to analyze the punch item's respective punch-item data and thereby determine a predicted risk level that indicates a likelihood of the punch item not being completed by a target completion date for the punch item;
determine, based on applying the trained machine learning model, a given punch item for which the predicted risk level meets a threshold level;
identify, for the given punch item, a given punch-item variable of the respective punch-item data that indicates a reason for the predicted risk level for the given punch item; and
cause a second client station to display a representation of the plurality of punch items that includes:
an identification of each punch item;
an indicator of each punch item's respective predicted risk level; and
for the given punch item and any other punch items for which the respective predicted risk level meets the threshold level, an indication of a respective reason for the respective predicted risk level.

### Claim 2 (depends on 1)

The computing platform of claim 1, further comprising program instructions stored on the non-transitory computer-readable medium that are executable by the at least one processor such that the computing platform is configured to:
train a machine learning model by carrying out a machine learning process on a training data set that includes historical punch-item data, wherein the trained machine learning model is configured to (i) receive, as input, data defining a punch item, (ii) based on an evaluation of the data defining the punch item, output a predicted risk level for the punch item, and (iii) identify which one or more variables of the data defining the punch item contributed most to the predicted risk level for the punch item.

### Claim 3 (depends on 2)

The computing platform of claim 2, wherein the historical punch-item data comprises (i) respective data defining each of a plurality of completed punch items and (ii) a respective label for each of the plurality of completed punch items that indicates an actual completion date of the completed punch item relative to a target completion date of the completed punch item.

### Claim 4 (depends on 1)

The computing platform of claim 1, wherein the program instructions that are executable by the at least one processor such that the computing platform is configured to determine the predicted risk level for each punch item comprise program instructions that are executable by the at least one processor such that the computing platform is configured to:
determine a predicted future time during which the punch item is most likely to be completed; and
based at least on (i) the predicted future time during which the punch item is most likely to be completed and (ii) the target completion date of the punch item, determine the respective predicted risk level for the punch item.

### Claim 5 (depends on 4)

The computing platform of claim 4, further comprising program instructions stored on the non-transitory computer-readable medium that are executable by the at least one processor such that the computing platform is configured to:
predict a respective likelihood of the punch item being completed in each of a plurality of different future times,
wherein the program instructions that are executable by the at least one processor such that the computing platform is configured to determine the predicted future time during which the punch item is most likely to be completed comprise program instructions that are executable by the at least one processor such that the computing platform is configured to determine, from the plurality of future times, a given future time corresponding to a highest likelihood of the punch item being completed.

### Claim 6 (depends on 1)

The computing platform of claim 1, wherein the program instructions that are executable by the at least one processor such that the computing platform is configured to identify the given variable of the respective punch-item data that indicates the reason for the predicted risk level for the given punch item comprise program instructions that are executable by the at least one processor such that the computing platform is configured to:
identify one or more punch-item variables of the respective punch-item data for the given punch item that contributed to the predicted risk level for the given punch item;
evaluate each identified punch-item variable's respective contribution to the predicted risk level for the given punch item; and
determine which of the identified one or more variables contributed most to the respective predicted risk level for the given punch item.

### Claim 7 (depends on 1)

The computing platform of claim 1, further comprising program instructions stored on the non-transitory computer-readable medium that are executable by the at least one processor such that the computing platform is configured to:
for each punch item in the plurality of punch items, store (i) the respective punch-item data for the punch item and (ii) the respective predicted risk level for the punch item; and
for the given punch item and any other punch items for which the respective predicted risk level meets the threshold level, store the respective reason for the respective predicted risk level.

### Claim 8 (depends on 1)

The computing platform of claim 1, further comprising program instructions stored on the non-transitory computer-readable medium that are executable by the at least one processor such that the computing platform is configured to:
for each punch item in the plurality of punch items, determine a respective confidence level associated with the punch item's respective predicted risk level; and
cause the second client station to display an indication of the respective confidence level associated with the punch item's respective predicted risk level.

### Claim 9 (depends on 1)

The computing platform of claim 1, wherein the trained machine learning model comprises one of (i) a random forest classifier model, (i) a gradient boosting model, or (iii) a logistic regression model.

### Claim 10 (depends on 1)

The computing platform of claim 1, further comprising program instructions stored on the non-transitory computer-readable medium that are executable by the at least one processor such that the computing platform is configured to:
re-train the trained machine learning model using one or both of (i) newly-available historical punch-item data or (ii) modified model parameters for the trained machine learning model.

### Claim 11 (depends on 1)

The computing platform of claim 1, wherein the received punch-item data for each punch item comprises one or both of (i) item-specific data for the punch item or (ii) project-specific data for the punch item.

### Claim 12 (depends on 1)

The computing platform of claim 1, wherein the derived additional punch-item data for each punch item comprises one or more of (i) item-specific punch-item data, (ii) project-specific punch-item data, (iii) timing punch-item data, (iv) sentiment punch-item data, or (v) data determined via one or more natural language processing (NLP) techniques.

### Claim 13

A non-transitory computer-readable medium, wherein the non-transitory computer-readable medium is provisioned with program instructions that, when executed by at least one processor, cause a computing platform to:
cause a first client station to display a user interface for creating punch items for a construction project by inputting data defining punch-items;
receive, from the first client station, respective punch-item data defining each of a plurality of punch items,
for each punch item in the plurality of punch items, derive, based on the received punch-item data, additional punch-item data, wherein (i) the received punch-item data and (ii) the derived additional punch-item data for each punch item comprise a respective set of punch-item variables;
for each punch item in the plurality of punch items, apply a trained machine learning model to analyze the punch item's respective punch-item data and thereby determine a predicted risk level that indicates a likelihood of the punch item not being completed by a target completion date for the punch item;
determine, based on applying the trained machine learning model, a given punch item for which the predicted risk level meets a threshold level;
identify, for the given punch item, a given punch-item variable of the respective punch-item data that indicates a reason for the predicted risk level for the given punch item; and
cause a second client station to display a representation of the plurality of punch items that includes:
an identification of each punch item;
an indicator of each punch item's respective predicted risk level; and
for the given punch item and any other punch items for which the respective predicted risk level meets the threshold level, an indication of a respective reason for the respective predicted risk level.

### Claim 14 (depends on 13)

The non-transitory computer-readable medium of claim 13, wherein the non-transitory computer-readable medium is also provisioned with program instructions that, when executed by at least one processor, cause the computing platform to:
train a machine learning model by carrying out a machine learning process on a training data set that includes historical punch-item data, wherein the trained machine learning model is configured to (i) receive, as input, data defining a punch item, (ii) based on an evaluation of the data defining the punch item, output a predicted risk level for the punch item, and (iii) identify which one or more variables of the data defining the punch item contributed most to the predicted risk level for the punch item.

### Claim 15 (depends on 14)

The non-transitory computer-readable medium of claim 14, wherein the historical punch-item data comprises (i) respective data defining each of a plurality of completed punch items and (ii) a respective label for each of the plurality of completed punch items that indicates an actual completion date of the completed punch item relative to a target completion date of the completed punch item.

### Claim 16 (depends on 13)

The non-transitory computer-readable medium of claim 13, wherein the program instructions that, when executed by at least one processor, cause the computing platform to determine the predicted risk level for each punch item comprise program instructions that, when executed by at least one processor, cause the computing platform to:
determine a predicted future time during which the punch item is most likely to be completed; and
based at least on (i) the predicted future time during which the punch item is most likely to be completed and (ii) the target completion date of the punch item, determine the respective predicted risk level for the punch item.

### Claim 17 (depends on 16)

The non-transitory computer-readable medium of claim 16, wherein the non-transitory computer-readable medium is also provisioned with program instructions that, when executed by at least one processor, cause the computing platform to:
predict a respective likelihood of the punch item being completed in each of a plurality of different future times,
wherein the program instructions that are executable by the at least one processor such that the computing platform is configured to determine the predicted future time during which the punch item is most likely to be completed comprise program instructions that are executable by the at least one processor such that the computing platform is configured to determine, from the plurality of future times, a given future time corresponding to a highest likelihood of the punch item being completed.

### Claim 18 (depends on 13)

The non-transitory computer-readable medium of claim 13, wherein the program instructions that, when executed by at least one processor, cause the computing platform to identify the given variable of the respective punch-item data that indicates the reason for the predicted risk level for the given punch item comprise program instructions that, when executed by at least one processor, cause the computing platform to:
identify one or more punch-item variables of the respective punch-item data for the given punch item that contributed to the predicted risk level for the given punch item;
evaluate each identified punch-item variable's respective contribution to the predicted risk level for the given punch item; and
determine which of the identified one or more variables contributed most to the respective predicted risk level for the given punch item.

### Claim 19

A method carried out by a computing platform, the method comprising:
causing a first client station to display a user interface for creating punch items for a construction project by inputting data defining punch-items;
receiving, from the first client station, respective punch-item data defining each of a plurality of punch items,
for each punch item in the plurality of punch items, deriving, based on the received punch-item data, additional punch-item data, wherein (i) the received punch-item data and (ii) the derived additional punch-item data for each punch item comprise a respective set of punch-item variables;
for each punch item in the plurality of punch items, applying a trained machine learning model to analyze the punch item's respective punch-item data and thereby determine a predicted risk level that indicates a likelihood of the punch item not being completed by a target completion date for the punch item;
determining, based on applying the trained machine learning model, a given punch item for which the predicted risk level meets a threshold level;
identifying, for the given punch item, a given punch-item variable of the respective punch-item data that indicates a reason for the predicted risk level for the given punch item; and
causing a second client station to display a representation of the plurality of punch items that includes:
an identification of each punch item;
an indicator of each punch item's respective predicted risk level; and
for the given punch item and any other punch items for which the respective predicted risk level meets the threshold level, an indication of a respective reason for the respective predicted risk level.

### Claim 20 (depends on 19)

The method of claim 19, further comprising:
training a machine learning model by carrying out a machine learning process on a training data set that includes historical punch-item data, wherein the trained machine learning model is configured to (i) receive, as input, data defining a punch item, (ii) based on an evaluation of the data defining the punch item, output a predicted risk level for the punch item, and (iii) identify which one or more variables of the data defining the punch item contributed most to the predicted risk level for the punch item.
