Back to results
US 11,600,063 B1Granted
Guided inspection system and method
AssigneeUnited Services Automobile Association (USAA)
InventorsCarlos J P Chavez, Quian Antony Jones
Life of this patent
Estimating the term…
Abstract
A system and method for a guided inspection of an apartment, home or other physical space is disclosed. The system and method use augmented reality to guide a user through a physical space. The system and method further use machine learning to automatically detect and classify damage to various physical structures in the physical space. In response to detected damage, the system may prompt a user to move closer to the detected damage for further inspection. The system can also detect obscured structures and prompt a user to make changes to the environment to increase the visibility of the obscured structures.
Claims20
A method of guiding a user through a property inspection of an apartment using a remote device, comprising the steps of:
- capturing image information with the remote device, the image information corresponding to at least one image of the apartment, wherein the at least one image includes an image of a physical structure at a first location inside the apartment;
- analyzing the image information to determine if there is damage to a portion of the physical structure in the apartment based on the image information captured with the remote device, wherein analyzing the image information comprises using a machine learning system to detect damage to the physical structure and the method further includes training the machine learning system using a set of images showing damage to physical structures;
- determining, by the machine learning system, that there is uncertainty in classifying the physical structure at the first location as damaged or undamaged based on the image information for the physical structure captured with the remote device at the first location;
- based on determining by the machine learning system that there is uncertainty in classifying the physical structure as damaged or undamaged, instructing the user of the remote device to move closer to the physical structure and to capture new image information of the physical structure from a location closer to the physical structure than the first location;
- upon classifying the physical structure at the first location as damaged or undamaged by the machine learning system, providing navigation information on a display of the remote device to guide the user to a second location inside the apartment;
- determining that a location of the remote device has changed from the first location to the second location;
- and
- instructing the user of the remote device to capture new images of the apartment at the second location.
5 more elements
A remote device for guiding a user through a property inspection comprising:
- a camera;
- a display;
- and
- at least one processor configured to implement instructions stored in memory of the remote device to cause the remote device to:
- display a map of an interior of a home on the display of the remote device, the map including a plurality of physical structures located within the interior of the home along with an associated location for each physical structure of the plurality of physical structures;
- display a path on the map on the display of the remote device from a current location of the remote device to a first location associated with a first physical structure of the plurality of physical structures;
- capture image information of the first physical structure inside the home at the first location;
- send the image information to a server, the image information including at least one image of the first physical structure inside the home;
- receive instructions from the server, the instructions including navigation information directing the user from the first location to a second location inside the home, the second location being associated with a second physical structure of the plurality of physical structures inside the home, the second physical structure being different from the first physical structure;
- prompt the user on the remote device to move to the second location in the home in response to the instructions, wherein prompting the user includes displaying a path on the map on the display of the remote device from the first location to the second location;
- monitor movement of the remote device to confirm that the user has moved to the second location;
- and
- upon confirming that the user has moved to the second location, prompt the user on the remote device to capture an image of the second physical structure at the second location.
10 more elements
A remote device for guiding a user through a property inspection of an apartment comprising:
- a camera;
- a display;
- and
- at least one processor configured to implement instructions stored in memory of the remote device to cause the remote device to:
- capture image information using the camera, the image information corresponding to at least one image of the apartment;
- detect an obscured physical structure inside the apartment using the image information, wherein detecting the obscured physical structure includes inputting the image information into a machine learning system that has been previously trained using a set of images showing obscured physical structures;
- provide instructions to the user on the remote device to modify the visibility of the obscured physical structure so that the physical structure is no longer obscured, wherein the instructions prompt the user to change the state of a window treatment to an open or closed position so that the physical structure is no longer obscured in order to capture an image of the physical structure;
- capture new images of the physical structure using the camera that are no longer obscured;
- and
- based on the new images of the physical structure that are no longer obscured, determine, by the machine learning system, whether the physical structure is damaged or undamaged.
7 more elements
Dependencies are inferred from the claim text.