# US 2024/0257335 A1 · Vehicle damage detection system and method

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2024/0257335 A1
- Document ID: US20240257335A1
- Status: Published application
- Kind: A1
- Application number: 18/554,181
- Filed: 2022-04-25
- Published: 2024-08-01
- Earliest claimed: 2021-04-26
- Assignees: 2872475 Ontario Limited
- Applicants: 2872475 Ontario Limited
- Inventors: Philip Zylstra; Matthew James Gibson
- Web page: https://patentgrep.com/patent/US20240257335A1

## CPC

- G01S 17/89: for mapping or imaging
- G06T 7/001: {using an image reference approach}
- G01S 17/42: Simultaneous measurement of distance and other co-ordinates (indirect measurement G01S17/46)
- G01S 17/88: Lidar systems specially adapted for specific applications
- G06Q 10/0875: Itemisation or classification of parts, supplies or services, e.g. bill of materials
- G06Q 10/10: Office automation; Time management
- G06Q 10/20: Administration of product repair or maintenance
- G06Q 30/0278: {Product appraisal}
- G06Q 30/0283: Price estimation or determination
- G06Q 40/08: Insurance
- G06Q 50/40: Business processes related to the transportation industry (shipping G06Q10/083)
- G06T 7/0002: {Inspection of images, e.g. flaw detection}
- G06T 17/00: Three-dimensional [3D] modelling for computer graphics
- B60S 5/00: Servicing, maintaining, repairing, or refitting of vehicles (vehicles adapted to carry a workshop for servicing or maintenance B60P3/14; servicing rail locomotives B61K)
- G01B 11/25: by projecting a pattern, e.g. {one or more lines,} moiré fringes on the object (G01B11/255 takes precedence {; image analysis for depth or shape recovery G06T7/50})
- G06T 2200/24: involving graphical user interfaces [GUIs]
- G06T 2207/10024: Color image
- G06T 2207/10028: Range image; Depth image; 3D point clouds
- G06T 2207/20081: Training; Learning
- G06T 2207/20084: Artificial neural networks [ANN]
- G06T 2207/30108: Industrial image inspection
- G06T 2210/56: Particle system, point based geometry or rendering
- G01S: RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- B60S: SERVICING, CLEANING, REPAIRING, SUPPORTING, LIFTING, OR MANOEUVRING OF VEHICLES, NOT OTHERWISE PROVIDED FOR
- G01B: MEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS

## Abstract

A vehicle damage detection system operating on a computer system for evaluating specific damage to a vehicle. The vehicle damage detection system capturing a 3D point cloud of a damaged vehicle with a 3D scanner and identifies one or more sites of vehicle damage based on comparison of the captured 3D point cloud of the damaged vehicle to a baseline 3D file by identifying points within the 3D point cloud of the damaged vehicle that deviate from an original equipment manufacturer (OEM) standard vehicle of the same type. The damage detection system can be used to determine and identify replacement parts and components and generate an estimate and parts list based on previously damaged vehicles having a similar damage pattern, allowing an improved method for vehicle damage assessment and repair.

## Claims

### Claim 1

A computer-implemented method for assessing damage to a vehicle, the method comprising:
capturing a 3D point cloud of a damaged vehicle and its damaged components with a 3D scanner;
comparing the 3D point cloud of the damaged vehicle to a baseline 3D file of an original equipment manufacturer (OEM) standard vehicle of the same type;
identifying a site of vehicle damage on the damaged vehicle based on the comparison of the captured 3D point cloud of the damaged vehicle to the baseline 3D file by identifying a set of deviating points within the 3D point cloud of the damaged vehicle that deviate from the baseline 3D file of the OEM standard vehicle;
quantifying the deviation of the identified set of deviating points on a x,y,z, plot based on location of points in the 3D point cloud of the damaged vehicle at the site of vehicle damage compared to the OEM standard; and
displaying, on a user interface, an image overlay of the captured 3D point cloud of the damaged vehicle and the baseline 3D OEM standard vehicle and identifying points within the scanned point cloud of the damage vehicle that are beyond a predetermined threshold of deviation from the OEM standard vehicle.

### Claim 2 (depends on 1)

The method of claim 1, wherein the baseline 3D file of the OEM vehicle of the same type is a point cloud file.

### Claim 3 (depends on 1, 2)

The method of claim 1 or 2, wherein the 3D scanner uses LASER triangulation 3D scanning technology, structured light 3D scanning technology, modulated light 3D scanning technology, contact-based 3D scanning technology, LASER pulse-based 3D scanning technology, time-of-flight 3D laser scanning technology, or laser-based 3D scanning technology.

### Claim 4 (depends on 1)

The method of claim 1 wherein the 3D point cloud of the damaged vehicle is accurate to less than about 2 mm.

### Claim 5 (depends on 1)

The method of claim 1, further comprising matching the identified site of vehicle damage to a previously damaged vehicle in a damaged vehicle database and importing at least one of a repair estimate and a repair procedure for the previously damaged vehicle.

### Claim 6 (depends on 5)

The method of claim 5, wherein the repair estimate comprises a listing of one or more parts for replacement, part repair labor time, part replacement labor time, paint cost, coating cost, refinishing labor time, paint or coating dry time, disposal cost, and administrative cost.

### Claim 7 (depends on 1)

The method of claim 1, wherein comparing the captured 3D composite file of the damaged vehicle and the baseline 3D composite file is executed by one or more convoluted neural network connected to a processing system.

### Claim 8 (depends on 1)

The method of claim 1, wherein comparing the captured vehicle 3D point cloud to a baseline 3D file of an original equipment manufacturer (OEM) standard vehicle of the same type uses a Nearest Neighbor (NN) algorithm or a Nearest Neighbor Distance Ratio (NNDR) algorithm.

### Claim 9 (depends on 1)

The method of claim 1, wherein comparing the 3D point cloud of the damaged vehicle and the baseline 3D file capture at least one of curvature, smoothness, and geometrical edge similarities.

### Claim 10 (depends on 1)

The method of claim 1, wherein comparing the 3D point cloud of the damaged vehicle to a baseline 3D file comprises matching the damaged vehicle and baseline vehicle by one or more of vehicle model, vehicle year, vehicle make, and vehicle features.

### Claim 11 (depends on 1)

The method of claim 1, wherein the 3D point cloud of the damaged vehicle is displayed in a first color and the baseline 3D file of OEM standard vehicle in a second color.

### Claim 12 (depends on 1)

The method of claim 1, wherein displaying the image overlay comprises displaying the set of differentiating points and deviation distance on the x,y,z, plot.

### Claim 13 (depends on 1)

The method of claim 1, further comprising displaying the image overlay as a heatmap, where each color represents a varying degree of deviation of the 3D point cloud of the damaged vehicle to the baseline 3D file of the OEM standard vehicle.

### Claim 14

A system for isolating vehicle damage on a damaged vehicle comprising:
a 3D scanner capable of capturing a point cloud of a damaged vehicle and its components to provide a 3D point cloud image of the damaged vehicle;
an original equipment manufacturer (OEM) vehicle database comprising a plurality of baseline 3D files of undamaged vehicles identified by vehicle model, vehicle year, and vehicle make;
a processor for storing and processing information relating to the 3D point cloud of the damaged vehicle and baseline 3D file to:
compare the captured vehicle 3D point cloud of the damaged vehicle to a baseline 3D file of an OEM standard vehicle of the same vehicle model, vehicle year, and vehicle make from the OEM vehicle database;
identify, based on the compared 3D point cloud of the damaged vehicle to the baseline 3D file of the OEM standard vehicle, a plurality of differentiating points between the 3D point cloud of the damaged vehicle and the baseline 3D file of the OEM standard vehicle;
quantify the deviation of the identified set of deviating points on a x,y,z, plot based on location of points in the 3D point cloud of the damaged vehicle at the site of vehicle damage compared to the OEM standard; and
overlay the captured 3D point cloud of the damaged vehicle and the baseline 3D file to create an image overlay; and
a graphical user interface for displaying the image overlay of the 3D point cloud of the damaged vehicle and the baseline 3D file and deviating points within the scanned point cloud of the damage vehicle that are beyond a predetermined threshold of deviation from the OEM standard.

### Claim 15 (depends on 14)

The system of claim 14, wherein the processor allows the image overlay on the user interface to be manipulated in 360 degrees and zoomed in and out.

### Claim 16 (depends on 14)

The system of claim 14, further comprising a parts database comprising a parts list mapped to particular areas of damage on the damaged vehicle, and wherein the processor generates a parts list for repairing the damaged vehicle.

### Claim 17 (depends on 14)

The system of claim 14, further comprising a damaged vehicle database, wherein the processor matches the 3D point cloud of the damaged vehicle to a previously damaged vehicle of the same type, the damaged vehicle database comprising at least one of a repair estimate and a repair procedure for the previously damaged vehicle.

### Claim 18 (depends on 14)

The system of claim 14, wherein the graphical user interface allows selection of specific points on each of the 3D point cloud of the damaged vehicle and the baseline 3D file to isolate a measured and angular difference of the specific points.

### Claim 19 (depends on 14)

The system of claim 14, wherein the 3D scanner is one or more of a LASER triangulation 3D scanner, structured light 3D scanner, time-of-flight 3D laser scanner, modulated light 3D scanner, contact-based 3D scanner, LASER pulse-based 3D scanner, and other laser-based 3D scanner.

### Claim 20 (depends on 14)

The system of claim 14, wherein the predetermined threshold of difference is less than about 2 mm.
