# US 2024/0203054 A1 · Streamlined single software workflow with ml-based point cloud clustering for virtual reality building inspection

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2024/0203054 A1
- Document ID: US20240203054A1
- Status: Published application
- Kind: A1
- Application number: 18/543,650
- Filed: 2023-12-18
- Published: 2024-06-20
- Earliest claimed: 2022-12-20
- Assignees: University of Florida Research Foundation, Inc.
- Applicants: University of Florida Research Foundation, Inc.
- Inventors: Jithin Gopinadhan; Ravi Shankar Srinivasan
- Web page: https://patentgrep.com/patent/US20240203054A1

## CPC

- G06T 17/20: Finite element generation, e.g. wire-frame surface description, {tesselation}
- G06F 30/13: Architectural design, e.g. computer-aided architectural design [CAAD] related to design of buildings, bridges, landscapes, production plants or roads
- G06F 30/27: using machine learning, e.g. artificial intelligence, neural networks, support vector machines [SVM] or training a model
- G06T 7/60: Analysis of geometric attributes
- G06V 10/761: {Proximity, similarity or dissimilarity measures}
- G06V 10/762: using clustering, e.g. of similar faces in social networks
- G06F 2111/10: Numerical modelling
- G06F 2111/18: using virtual or augmented reality
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

The present disclosure presents system and methods for virtual building construction inspection. One such method, among others, comprises storing, by a computing device, an as-planned building information model (BIM) data for a building project, wherein the as-planned BIM data comprises a 3D design model of the building project; acquiring, by the computing device, an as-built point cloud data of the building project; processing, by the computing device, the as-built point cloud data to generate cluster points; generating, by the computing device, 3D geometry and mesh data for each cluster point set; and performing, by the computing device, virtual reality visualization of the 3D geometries generated from the as-built point cloud data and correlating the 3D geometries with the as-planned BIM data.

## Claims

### Claim 1

A method comprising:
storing, by a computing device, an as-planned building information model (BIM) data for a building project, wherein the as-planned BIM data comprises a 3D design model of the building project;
acquiring, by the computing device, an as-built point cloud data of the building project;
processing, by the computing device, the as-built point cloud data to generate cluster points;
generating, by the computing device, 3D geometry and mesh data for each cluster point set; and
performing, by the computing device, virtual reality visualization of the 3D geometries generated from the as-built point cloud data and correlating the 3D geometries with the as-planned BIM data.

### Claim 2 (depends on 1)

The method of claim 1, wherein the cluster points are generated using a density-based spatial clustering of applications with a noise (DBSCAN) algorithm performed by the computing device.

### Claim 3 (depends on 1)

The method of claim 1, wherein the as-planned BIM data is imported from an Autodesk Revit file.

### Claim 4 (depends on 1)

The method of claim 1, wherein the as-built point cloud data is acquired from an imaging device or camera using LiDAR technology.

### Claim 5 (depends on 1)

The method of claim 1, wherein an as-planned 3D model is overlayed on top of an as-built 3D model of the building project, wherein the as-built 3D model comprises 3D geometries generated from the as-built point cloud data and the as-planned BIM data comprises the as-planned 3D model.

### Claim 6 (depends on 1)

The method of claim 1, wherein the as-built point cloud data comprises thermal imaging data and/or LiDAR data and/or digital laser scanned and/or digital photographs of the building project.

### Claim 7 (depends on 1)

The method of claim 1, further comprising outputting an inspection report identifying a discrepancy between geometries of the as-built point cloud data and the as-planned BIM data.

### Claim 8

A system comprising:
at least one processor; and
memory configured to communicate with the at least one processor, wherein the memory stores instructions that, in response to execution by the at least one processor, cause the at least one processor to perform operations comprising:
storing an as-planned building information model (BIM) data for a building project, wherein the as-planned BIM data comprises a 3D design model of the building project;
acquiring an as-built point cloud data of the building project;
processing the as-built point cloud data to generate cluster points;
generating a 3D geometry and mesh data for each cluster point; and
performing virtual reality visualization of the 3D geometries generated from the as-built point cloud data and correlating the 3D geometries with the as-planned BIM data.

### Claim 9 (depends on 8)

The system of claim 8, wherein the cluster points are generated using a density-based spatial clustering of applications with noise (DBSCAN) algorithm performed by the at least one processor.

### Claim 10 (depends on 8)

The system of claim 8, wherein an as-planned 3D model is overlayed on top of an as-built 3D model of the building project, wherein the as-built 3D model comprises 3D geometries generated from the as-built point cloud data and the as-planned BIM data comprises the as-planned 3D model.

### Claim 11 (depends on 8)

The system of claim 8, wherein the as-built point cloud data is acquired from an imaging device or camera using LiDAR technology.

### Claim 12 (depends on 8)

The system of claim 8, wherein the as-built point cloud data comprises thermal imaging data and/or LiDAR data and/or digital laser scanned and/or digital photographs of the building project.

### Claim 13 (depends on 8)

The system of claim 8, wherein the operations further comprise outputting an inspection report identifying a discrepancy between geometries of the as-built point cloud data and the as-planned BIM data.

### Claim 14 (depends on 8)

The system of claim 8, wherein the processing and generating operations are performed using machine learning techniques performed by the at least one processor.

### Claim 15

A non-transitory, tangible computer-readable storage medium having instructions stored thereon that, in response to execution by a computer-based system, cause the computer-based system to perform operations comprising:
storing an as-planned building information model (BIM) data for a building project, wherein the as-planned BIM data comprises a 3D design model of the building project;
acquiring an as-built point cloud data of the building project;
processing the as-built point cloud data to generate cluster points;
generating a 3D geometry and mesh data for each cluster point; and
performing virtual reality visualization of the 3D geometries generated from the as-built point cloud data and correlating the 3D geometries with the as-planned BIM data.

### Claim 16 (depends on 15)

The non-transitory, tangible computer-readable storage medium of claim 15, wherein the cluster points are generated using a density-based spatial clustering of applications with noise (DBSCAN) algorithm performed by the computer-based system.

### Claim 17 (depends on 15)

The non-transitory, tangible computer-readable storage medium of claim 15, wherein an as-planned 3D model is overlayed on top of an as-built 3D model of the building project, wherein the as-built 3D model comprises 3D geometries generated from the as-built point cloud data and the as-planned BIM data comprises the as-planned 3D model.

### Claim 18 (depends on 15)

The non-transitory, tangible computer-readable storage medium of claim 15, wherein the as-built point cloud data comprises thermal imaging data and/or LiDAR data and/or digital laser scanned and/or digital photographs of the building project.

### Claim 19 (depends on 15)

The non-transitory, tangible computer-readable storage medium of claim 15, wherein the operations further comprise outputting an inspection report identifying a discrepancy between geometries of the as-built point cloud data and the as-planned BIM data.

### Claim 20 (depends on 15)

The non-transitory, tangible computer-readable storage medium of claim 15, wherein the processing and generating operations are performed using machine learning techniques performed by the computer-based system.
