# US 12,008,658 B2 · Deep learning image processing method for determining vehicle damage > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,008,658 B2 - Document ID: US12008658B2 - Status: Granted - Kind: B2 - Application number: 18/110,510 - Filed: 2023-02-16 - Published: 2023-07-13 - Granted: 2024-06-11 - Earliest claimed: 2017-06-29 - Assignees: State Farm Mutual Automobile Insurance Company - Applicants: State Farm Mutual Automobile Insurance Company - Inventors: He Yang; Bradley A. Sliz; Carlee A. Clymer; Jennifer Malia Andrus - Web page: https://patentgrep.com/patent/US12008658B2 ## CPC - G06Q 40/08: Insurance - G06F 16/583: using metadata automatically derived from the content - G06F 18/214: Generating training patterns; Bootstrap methods, e.g. bagging or boosting - G06F 18/22: Matching criteria, e.g. proximity measures - G06N 3/0464: Convolutional networks [CNN, ConvNet] - G06N 3/08: Learning methods - G06N 3/09: Supervised learning - G06V 10/761: {Proximity, similarity or dissimilarity measures} - G06V 10/82: using neural networks - G06V 2201/08: Detecting or categorising vehicles - G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING ## Abstract In a computer-implemented method and associated tangible non-transitory computer-readable medium, an image of a damaged vehicle may be analyzed to generate a repair estimate. A dataset populated with digital images of damaged vehicles and associated claim data may be used to train a deep learning neural network to learn damaged vehicle image characteristics that are predictive of claim data characteristics, and a predictive similarity model may be generated. Using the predictive similarity model, one or more similarity scores may be generated for a digital image of a newly damaged vehicle, indicating its similarity to one or more digital images of damaged vehicles with known damage level, repair time, and/or repair cost. A repair estimate may be generated for the newly damaged vehicle based on the claim data associated with images that are most similar to the image of the newly damaged vehicle. ## Claims ### Claim 1 A computer-implemented method, comprising: determining, using a predictive similarity model, a similarity score for a given two digital images of damaged vehicles, wherein the predictive similarity model is trained using a historical training dataset populated with digital images of damaged vehicles and historical claim data related to the damaged vehicles, to identify damaged vehicle image characteristics that are predictive of one or more of damage level, repair time, or repair cost; and based on the similarity score for the given two digital images, predicting a damage level, repair time, or repair cost for a first damaged vehicle depicted in a first digital image of the given two digital images based on a known damage level, repair time, or repair cost for a second damaged vehicle depicted in a second digital image of the given two digital images. ### Claim 2 (depends on 1) The computer-implemented method of claim 1, wherein determining the similarity score for the given two digital images of damaged vehicles further comprises weighting the damaged vehicle image characteristics based on a degree to which each characteristic is predictive of at least one of damage level, repair time, or repair cost. ### Claim 3 (depends on 1) The computer-implemented method of claim 1, wherein determining the similarity score for the given two digital images of damaged vehicles includes: determining a plurality of similarity scores each corresponding to a digital image of a newly damaged vehicle and a respective one of a plurality of digital images in a given dataset of damaged vehicles; and the method further comprising finding, using an image search engine, a set of one or more digital images of damaged vehicles from the given dataset for which the similarity score is above a threshold similarity score. ### Claim 4 (depends on 3) The computer-implemented method of claim 3, wherein the given dataset of damaged vehicles is populated with digital images of at least one different damaged vehicle than the historical training dataset. ### Claim 5 (depends on 3) The computer-implemented method of claim 3, further comprising displaying the set of digital images found using the image search engine. ### Claim 6 (depends on 5) The computer-implemented method of claim 5, further comprising displaying one or more of a damage level, a repair time, or a repair cost associated with the one or more digital images of damaged vehicles found using the search engine. ### Claim 7 (depends on 3) The computer-implemented method of claim 3, further comprising: generating predictive statistics for a damage level, repair time, or repair cost for the newly damaged vehicle based on a damage level, repair time, or repair cost for damaged vehicles depicted in the set of one or more digital images of damaged vehicles found using the image search engine; and displaying the predictive statistics. ### Claim 8 A tangible, non-transitory computer-readable medium storing instructions that, when executed by one or more processors, cause the one or more processors to: determine, using a predictive similarity model, a similarity score for a given two digital images of damaged vehicles, wherein the predictive similarity model is trained using a historical training dataset populated with digital images of damaged vehicles and historical claim data related to the damaged vehicles, to identify damaged vehicle image characteristics that are predictive of one or more of damage level, repair time, or repair cost; and based on the similarity score for the given two digital images, predict a damage level, repair time, or repair cost for a first damaged vehicle depicted in a first digital image of the given two digital images based on a known damage level, repair time, or repair cost for a second damaged vehicle depicted in a second digital image of the given two digital images. ### Claim 9 (depends on 8) The tangible, non-transitory computer-readable medium of claim 8, wherein the instructions to determine the similarity score for the given two digital images of damaged vehicles further include instructions to weight the damaged vehicle image characteristics based on a degree to which each characteristic is predictive of at least one of damage level, repair time, or repair cost. ### Claim 10 (depends on 8) The tangible, non-transitory computer-readable medium of claim 8, wherein: the instructions to determine the similarity score for the given two digital images of damaged vehicles further include instructions to determine a plurality of similarity scores each corresponding to a digital image of a newly damaged vehicle and a respective one of a plurality of digital images in a given dataset of damaged vehicles; and wherein the instructions further cause the one or more processors to find, using an image search engine, a set of one or more digital images of damaged vehicles from the given dataset for which the similarity score is above a threshold similarity score. ### Claim 11 (depends on 10) The tangible, non-transitory computer-readable medium of claim 10, wherein the given dataset of damaged vehicles is populated with digital images of at least one different damaged vehicle than the historical training dataset. ### Claim 12 (depends on 10) The tangible, non-transitory computer-readable medium of claim 10, wherein the instructions further include instructions to display the set of digital images found using the image search engine. ### Claim 13 (depends on 12) The tangible, non-transitory computer-readable medium of claim 12, further including instructions to display one or more of a damage level, a repair time, or a repair cost associated with the one or more digital images of damaged vehicles found using the search engine. ### Claim 14 (depends on 10) The tangible, non-transitory computer-readable medium of claim 10, further including instructions to: generate predictive statistics for a damage level, repair time, or repair cost for the newly damaged vehicle based on a damage level, repair time, or repair cost for damaged vehicles depicted in the set of one or more digital images of damaged vehicles found using the image search engine; and display the predictive statistics. ### Claim 15 A computer system comprising: one or more processors; and a memory storing instructions that, when executed by the one or more processors, cause the one or more processors to: determine, using a predictive similarity model, a similarity score for a given two digital images of damaged vehicles, wherein the predictive similarity model is trained using a historical training dataset populated with digital images of damaged vehicles and historical claim data related to the damaged vehicles, to identify damaged vehicle image characteristics that are predictive of one or more of damage level, repair time, or repair cost; and based on the similarity score for the given two digital images, predict a damage level, repair time, or repair cost for a first damaged vehicle depicted in a first digital image of the given two digital images based on a known damage level, repair time, or repair cost for a second damaged vehicle depicted in a second digital image of the given two digital images. ### Claim 16 (depends on 15) The computer system of claim 15, wherein the instructions to determine the similarity score for the given two digital images of damaged vehicles further include instructions to weight the damaged vehicle image characteristics based on a degree to which each characteristic is predictive of at least one of damage level, repair time, or repair cost. ### Claim 17 (depends on 15) The computer system of claim 15, wherein: the instructions to determine the similarity score for the given two digital images of damaged vehicles further include instructions to determine a plurality of similarity scores each corresponding to a digital image of a newly damaged vehicle and a respective one of a plurality of digital images in a given dataset of damaged vehicles; and wherein the instructions further cause the one or more processors to find, using an image search engine, a set of one or more digital images of damaged vehicles from the given dataset for which the similarity score is above a threshold similarity score. ### Claim 18 (depends on 17) The computer system of claim 17, wherein the given dataset of damaged vehicles is populated with digital images of at least one different damaged vehicle than the historical training dataset. ### Claim 19 (depends on 17) The computer system of claim 17, wherein the instructions further include instructions to display the set of digital images found using the image search engine. ### Claim 20 (depends on 19) The computer system of claim 19, further including instructions to display one or more of a damage level, a repair time, or a repair cost associated with the one or more digital images of damaged vehicles found using the search engine.