# US 2023/0066290 A1 · Method and system for remote virtual visualization of physical locations

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2023/0066290 A1
- Document ID: US20230066290A1
- Status: Published application
- Kind: A1
- Application number: 17/982,087
- Filed: 2022-11-07
- Published: 2023-03-02
- Earliest claimed: 2018-04-30
- Assignees: State Farm Mutual Automobile Insurance Company
- Applicants: State Farm Mutual Automobile Insurance Company
- Inventors: Bryan R. Nussbaum; An Ho; Nathan C. Summers; Kevin L. Mitchell; Rebecca A. Little
- Web page: https://patentgrep.com/patent/US20230066290A1

## CPC

- G06Q 40/08: Insurance
- G06F 3/04815: Interaction with a metaphor-based environment or interaction object displayed as three-dimensional [3D], e.g. changing the user viewpoint with respect to the environment or object
- G06F 3/04845: for image manipulation, e.g. dragging, rotation, expansion or change of colour
- G06T 7/0004: {Industrial image inspection}
- G06T 7/579: from motion
- G06T 17/20: Finite element generation, e.g. wire-frame surface description, {tesselation}
- G06T 19/00: Manipulating three-dimensional [3D] models or images for computer graphics
- G06T 19/20: Editing of three-dimensional [3D] images, e.g. changing shapes or colours, aligning objects or positioning parts
- G06V 20/13: Satellite images
- G06V 20/17: taken from planes or by drones
- G06V 20/20: in augmented reality scenes
- G06V 20/653: {by matching three-dimensional models, e.g. conformal mapping of Riemann surfaces}
- G06T 2200/08: involving all processing steps from image acquisition to 3D model generation
- G06T 2200/24: involving graphical user interfaces [GUIs]
- G06T 2207/10016: Video; Image sequence
- G06T 2207/10032: Satellite or aerial image; Remote sensing
- G06T 2207/30184: Infrastructure
- G06T 2219/004: Annotating, labelling
- G06T 2219/024: Multi-user, collaborative environment
- G06T 2219/2016: Rotation, translation, scaling
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

This application discloses methods, systems, and computer-implemented virtualization software applications and computer-implemented graphical user interface tools for remote virtual visualization of structures. Images are captured by an imaging vehicle of a structure and the captured images are transmitted to a remote server via a communication network. Using virtual 3D digital modeling software the server, using the images received from the imaging vehicle, generates a virtual 3D digital model of the structure and stores it in a database. This virtual 3D digital model can be accessed by remote users, using virtualization software applications, and used to view images of the structure. The user is able to manipulate the images and to view them from various perspectives and compare the before-the-damage images with images taken after damage have occurred. Based on all this the user is enabled to remotely communicate with an insurance agent and/or file an insurance claim.

## Claims

### Claim 1

(canceled)

### Claim 2

A computer-implemented method comprising:
receiving a plurality of images of a physical structure, the plurality of images illustrating damage to the physical structure;
generating a first virtual 3D model of the physical structure based at least in part on the plurality of images;
accessing a second virtual 3D model of the physical structure, the second virtual 3D model illustrating the physical structure without the damage;
identifying, based at least in part on a difference between the first virtual 3D model and the second virtual 3D model, a first portion of the first virtual 3D model depicting the damage to the physical structure;
identifying a second portion of the first virtual 3D model, exclusive of the first portion, depicting, at least in part, an undamaged component of the physical structure;
generating a third virtual 3D model of the physical structure, wherein the third virtual 3D model depicts the first portion with a first level of detail, and the second portion with a second level of detail less than the first level of detail; and
transmitting the third virtual 3D model to an electronic device.

### Claim 3 (depends on 2)

The computer-implemented method of claim 2, wherein the electronic device is a first electronic device, the method further comprising:
transmitting the third virtual 3D model to a second electronic device associated with an insurance claim reviewer;
receiving, from the first electronic device or the second electronic device, data associated with the first portion;
generating an augmented visualization of the third virtual 3D model, the augmented visualization including the data associated with the first portion;
storing the augmented visualization; and
causing the augmented visualization to be displayed on the first electronic device or the second electronic device.

### Claim 4 (depends on 3)

The computer-implemented method of claim 3, wherein the data comprises at least one of: an annotation describing an extent of the damage, a claim report associated with the damage, an amount of monetary loss associated with the damage, or an indication of approval by the insurance claim reviewer.

### Claim 5 (depends on 3)

The computer-implemented method of claim 3, further comprising:
enabling a synchronized view of the augmented visualization on the first electronic device and on the second electronic device.

### Claim 6 (depends on 3)

The computer-implemented method of claim 3, further comprising:
receiving, from the first electronic device or the second electronic device, information indicative of a manipulation of the third virtual 3D model; and
based at least in part on the information:
causing a first representation of the third virtual 3D model to be displayed by the first electronic device from a first perspective, and
causing a second representation of the third virtual 3D model to be displayed by the second electronic device from the first perspective.

### Claim 7 (depends on 6)

The computer-implemented method of claim 6, wherein the manipulation comprises at least one of:
a selection of a portion of the third virtual 3D model;
a rotation of the third virtual 3D model;
an implementation of a zoom factor associated with the third virtual 3D model; or
a change in a perspective from which the third virtual 3D model is displayed.

### Claim 8 (depends on 2)

The computer-implemented method of claim 2, wherein the second portion is depicted with the second level of detail based on performing a polygon simplification on data associated with the first virtual 3D model.

### Claim 9 (depends on 2)

The computer-implemented method of claim 2, wherein the second level of detail is selected such that a size of the third virtual 3D model is less than or equal to a data size limit associated with a network used to transmit the third virtual 3D model to the electronic device.

### Claim 10 (depends on 2)

The computer-implemented method of claim 2, further comprising:
identifying, based at least in part on the difference between the first virtual 3D model and the second virtual 3D model, a damaged component of the physical structure;
generating an insurance claim report related to the damaged component;
transmitting the insurance claim report to the electronic device; and
receiving, from the electronic device, an indication of approval of the insurance claim report.

### Claim 11 (depends on 2)

The computer-implemented method of claim 2, further comprising:
receiving, from the electronic device, a request for additional detail corresponding to the third virtual 3D model;
based at least in part on the request, generating an updated third virtual 3D model, the updated third virtual 3D model representing the second portion at the first level of detail; and
transmitting the updated third virtual 3D model to the electronic device.

### Claim 12

A system, comprising:
a processor;
a communication component operably connected to the processor and to a communication network; and
a non-transitory program memory operably connected to the processor and storing executable instructions that, when executed by the processor, cause the processor to perform operations comprising:
receiving a plurality of images illustrating damage to an insured physical structure;
generating a first virtual 3D model of the physical structure based at least in part on the plurality of images;
identifying a first portion of the first virtual 3D model depicting the damage to the physical structure;
identifying a second portion of the first virtual 3D model, excluding the first portion, depicting, at least in part, an undamaged portion of the physical structure;
generating a second virtual 3D model of the physical structure, wherein the second virtual 3D model depicts the first portion with a first level of detail, and the second portion with a second level of detail less than the first level of detail; and
transmitting, via the communication network, the second virtual 3D model to an electronic device.

### Claim 13 (depends on 12)

The system of claim 12, wherein the first virtual 3D model is generated at a first time, and determining the first portion comprises:
accessing a third virtual 3D model of the physical structure, the third virtual 3D model being generated at a second time prior to the first time; and
determining a difference between the first virtual 3D model and the third virtual 3D model.

### Claim 14 (depends on 13)

The system of claim 13, wherein the difference is determined by a statistical analysis of at least one of edges, vertices, or surfaces represented in both the first virtual 3D model and the third virtual 3D model.

### Claim 15 (depends on 12)

The system of claim 12, wherein the second level of detail is selected based at least in part on a data capacity of the communication network, and
the second portion is depicted with the second level of detail based on performing a polygon simplification on data associated with the first virtual 3D model.

### Claim 16 (depends on 12)

The system of claim 12, the operations further comprising:
transmitting, to the electronic device, instructions to render a prompt requesting information associated with the damage;
receiving, from the electronic device, an annotation in response to the prompt; and
generating an augmented visualization of the second virtual 3D model, the augmented visualization including the annotation.

### Claim 17 (depends on 16)

The system of claim 16, wherein the electronic device is a first electronic device, the operations further comprising:
generating, based at least in part on the annotation, an insurance claim report;
transmitting, to a second electronic device, the augmented visualization and the insurance claim report; and
receiving, from the second electronic device, an indication of approval of the insurance claim report.

### Claim 18

A tangible, non-transitory computer-readable medium storing instructions that, when executed by a processor, cause the processor to:
receive a plurality of 2D images illustrating damage to a physical structure;
generate a first virtual 3D model of the physical structure based at least in part on the plurality of 2D images;
determine a difference between the first virtual 3D model and a second virtual 3D model of the physical structure, the second virtual 3D model including a representation of the physical structure without the damage;
identify, based at least in part on a location of the difference within the first virtual 3D model, a first portion of the first virtual 3D model depicting the damage to the physical structure;
identify a second portion of the first virtual 3D model, excluding the first portion, depicting, at least in part, an undamaged component of the physical structure;
generate a third virtual 3D model of the physical structure, wherein the third virtual 3D model depicts the first portion with a first level of detail, and the second portion with a second level of detail less than the first level of detail; and
transmit the third virtual 3D model to an electronic device.

### Claim 19 (depends on 18)

The tangible, non-transitory computer-readable medium of claim 18, wherein the second level of detail is based least in part on a data capacity associated with the electronic device.

### Claim 20 (depends on 18)

The tangible, non-transitory computer-readable medium of claim 18, wherein the third virtual 3D model enables manipulation comprising at least one of:
a selection of a portion of the third virtual 3D model;
a rotation of the third virtual 3D model;
a change to a zoom factor associated with the third virtual 3D model; or
a change to a perspective from which the third virtual 3D model is displayed.

### Claim 21 (depends on 18)

The tangible, non-transitory computer-readable medium of claim 18, the instructions further causing the processor to:
determine, based at least in part on the difference between the first virtual 3D model and the second virtual 3D model, a damaged component of the physical structure;
generate an insurance claim report related to the damaged component;
transmit the insurance claim report to the electronic device; and
receive, from the electronic device, an indication of approval of the insurance claim report.

### Claim 22

A system, comprising:
a means for electronic communication via a communication network;
a means for storing executable instructions;
a means for displaying a 3D model; and
a means for executing the executable instructions, the means for executing being configured to:
receive a plurality of images illustrating a damage to an insured physical structure;
generate a first virtual 3D model of the physical structure based at least in part on the plurality of images;
determine a first portion of the first virtual 3D model depicting the damage to the physical structure;
identify a second portion of the first virtual 3D model, excluding the first portion, depicting, at least in part, an undamaged portion of the physical structure;
generate a second virtual 3D model of the physical structure, wherein the second virtual 3D model depicts the first portion with a first level of detail, and the second portion with a second level of detail less than the first level of detail; and
transmit, by the means for electronic communication, the second virtual 3D model to the means for displaying.

### Claim 23 (depends on 22)

The system of claim 22, wherein the first virtual 3D model is generated at a first time, and determining the first portion comprises:
accessing a third virtual 3D model of the physical structure, the third virtual 3D model being generated at a second time prior to the first time; and
determining a difference between the first virtual 3D model and the third virtual 3D model.

### Claim 24 (depends on 22)

The system of claim 22, the means for executing being further configured to:
receive data associated with the first portion, wherein the data comprises at least one of: an annotation describing an extent of the damage, a claim report associated with the damage, an amount of monetary loss associated with the damage, or an indication of approval by an insurance claim reviewer;
generate an augmented visualization of the second virtual 3D model, the augmented visualization including the data associated with the first portion; and
cause the augmented visualization to be displayed on the means for displaying.
