# US 2025/0095165 A1 · System and method for home façade features detection in a geographic region

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0095165 A1
- Document ID: US20250095165A1
- Status: Published application
- Kind: A1
- Application number: 18/369,093
- Filed: 2023-09-15
- Published: 2025-03-20
- Earliest claimed: 2023-09-15
- Inventors: Sivakumaran Somasundaram; Ali Salman; Avnish Kumar; Ian Michael Scott; Todd Alan Tomalak
- Web page: https://patentgrep.com/patent/US20250095165A1

## CPC

- G06V 10/44: Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components
- G06F 16/29: Geographical information databases
- G06T 7/13: Edge detection
- G06T 7/246: using feature-based methods, e.g. the tracking of corners or segments
- G06T 7/62: of area, perimeter, diameter or volume
- G06V 10/25: Determination of region of interest [ROI] or a volume of interest [VOI]
- G06V 10/267: {by performing operations on regions, e.g. growing, shrinking or watersheds}
- G06V 10/273: {removing elements interfering with the pattern to be recognised}
- G06V 10/70: using pattern recognition or machine learning (optical pattern recognition or electronic computations therefor G06V10/88)
- G06V 10/74: Image or video pattern matching; Proximity measures in feature spaces
- G06V 20/176: {Urban or other man-made structures}
- G06T 2207/20081: Training; Learning
- G06T 2207/20084: Artificial neural networks [ANN]
- G06T 2207/20132: Image cropping
- G06T 2207/20164: Salient point detection; Corner detection
- G06T 2207/30184: Infrastructure
- G06T 2207/30242: Counting objects in image
- G06V 10/40: Extraction of image or video features
- G06V 10/764: using classification, e.g. of video objects
- G06V 10/82: using neural networks
- G06V 20/38: {Outdoor scenes}
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

A method including receiving a first set of one or more street level images of houses into a Machine Learned Model trained with a second set of street level images with one or more exterior features of the houses labeled, identifying the one or more exterior features in the first set of street level images by way of the Machine Learned Model, and quantifying and outputting the counts and/or two-dimensional areas for each of the identified exterior features in the first set of one or more street level images is described. Non-transitory, computer-readable storage media having instructions for executing the method steps by one or more processors as well as computer or computer systems capable of performing the method steps are also described.

## Claims

### Claim 1

A method, comprising:
receiving one or more raw images of houses, each image taken from a viewpoint from a street adjacent to each house in the raw images, thereby resulting in raw street level images of houses;
cropping each raw street level image of each house based on an overhead view or representation of the house to remove portions of adjacent houses in the raw street level images thereby producing cropped street level images of each house;
inputting the cropped street level images into a Machine Learned Model comprising a Convolutional Neural Network trained with a training set of street level images with one or more exterior features of the houses labeled;
identifying the one or more exterior features in the cropped street level images by way of the Machine Learned Model;
quantifying and outputting, in integers such as 0, 1, 2, or 3, counts of each of the identified exterior features in the cropped street level images;
converting pixels of the identified exterior features in the cropped street level images into area dimensions; and
quantifying and outputting, in area units such as square feet or square meters, a two-dimensional area for each of the identified exterior features in the cropped images.

### Claim at position 2

2-4. (canceled)

### Claim 5 (depends on 1)

The method of claim 1, wherein cropping the raw street level images comprises:
identifying corners of each house in the raw street level image by:
determining an angular extent of the house from a nearest point on the street from the overhead view or representation of the house; and
translating distance and angles from the determining step to pixel values in the raw street level image; and
calculating portions of the raw street level image in excess of pixel values representing the house; and
removing the portions of the raw street level in excess of pixel values representing the house.

### Claim 6 (depends on 1)

The method of claim 1, further comprising:
receiving a geographic area of interest;
storing the geographic area of interest;
retrieving addresses of houses within the geographic area of interest;
retrieving the one or more raw street level images of individual houses based on the retrieved addresses.

### Claim 7 (depends on 6)

The method of claim 6, wherein the geographic area of interest is received as input on a graphical user interface, the input comprising a boundary on a map.

### Claim 8 (depends on 6)

The method of claim 6, wherein the geographical area of interest is received as input on a graphical user interface, the input comprising one or more of street, block, neighborhood, town, city, county, state, metropolitan statistical area (MSA), core-based statistical area (CBSA), five-digit ZIP Code, nine-digit ZIP Code, geographic coordinates (latitude and longitude), and tax parcel number.

### Claim 9 (depends on 1)

The method of claim 1, wherein the outputting comprises text representing characteristics of each cropped street level image, the text having information comprising:
a unique alphanumeric identifier;
street address;
geographic location;
date of image acquisition; and
image URL.

### Claim 10 (depends on 1)

The method of claim 1, wherein the outputting comprises information representing characteristics of each cropped street level image, wherein the information further comprises counts of individual home exterior features identified in the image.

### Claim 11 (depends on 1)

The method of claim 1, wherein the outputting comprises information representing characteristics of each cropped street level image, wherein the information further comprises calculated areas of individual home exterior features of the image.

### Claim 12 (depends on 9)

The method of claim 9, wherein the text is formatted and standardized for input into a geographic information system application.

### Claim 13 (depends on 1)

The method of claim 1, wherein the counts and/or two-dimensional areas for each of the identified exterior features for the cropped street level images are outputted as a bar chart.

### Claim 14 (depends on 1)

The method of claim 1, wherein the counts and/or two-dimensional areas for each of the identified exterior features for the cropped street level images are outputted as a heat map.

### Claim 15 (depends on 1)

The method of claim 1, wherein the counts and/or two-dimensional areas for each of the identified exterior features for the cropped street level images are converted to a percentage of total counts or total area for all of the identified exterior features and outputted as a pie chart.

### Claim 16 (depends on 1)

The method of claim 1, wherein the identified exterior features are chosen from windows, doors, garage doors, roofs, horizontal façades, vertical façades, stucco façades, brick façades, shakes façades, and stone façades.

### Claim 17 (depends on 16)

The method of claim 16, wherein the identified exterior features are identified as requiring repair or replacement.

### Claim 18 (depends on 1)

The method of claim 1, wherein the identified exterior features are chosen from windows, doors, garage doors, roofs, horizontal façades, vertical façades, stucco façades, brick façades, shakes façades, and stone façades.

### Claim 19

A method of home exterior feature detection and analysis, wherein a geographic area of interest and home exterior features of interest are received on a graphical user interface as input, the method comprising:
storing the geographic area of interest;
retrieving addresses of all houses within the geographic area of interest;
retrieving and storing raw images of houses taken from a viewpoint from a street adjacent to each house for each of the retrieved addresses, thereby resulting in raw street level images of houses;
cropping the raw street level images based on an overhead view or representation of each house to remove portions of adjacent houses in the images thereby producing cropped images of each house;
storing the cropped images;
providing the stored cropped images to a Machine Learned Model trained with a training set of street level images of with one or more exterior features labeled;
identifying the home exterior features of interest in the cropped images by way of the Machine Learned Model;
quantifying and outputting, in integers such as 0, 1, 2, or 3, counts of each of the identified exterior features in the cropped street level images;
converting pixels of the identified exterior features in the cropped street level images into area dimensions; and
quantifying and outputting, in area units such as square feet or square meters, a two-dimensional area for each of the identified exterior features in the cropped street level images.

### Claim 20 (depends on 19)

The method of claim 19, wherein cropping the raw street level images comprises:
identifying corners of each house in the raw street level image by:
determining an angular extent of the house from a nearest point on the street from the overhead view or representation of the house; and
translating distance and angles from the determining step to pixel values in the raw street level image; and
calculating portions of the raw street level image in excess of pixel values representing the house; and
removing the portions of the raw street level image in excess of pixel values representing the house.
