# US 2018/0025542 A1 · Method and system for displaying and navigating an optimal multi-dimensional building model

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2018/0025542 A1
- Document ID: US20180025542A1
- Status: Published application
- Kind: A1
- Application number: 15/721,062
- Filed: 2017-09-29
- Published: 2018-01-25
- Earliest claimed: 2013-07-25
- Assignees: Hover Inc.
- Applicants: Hover Inc.
- Inventors: Manish Upendran; Adam J. Altman
- Web page: https://patentgrep.com/patent/US20180025542A1

## CPC

- G06T 19/00: Manipulating three-dimensional [3D] models or images for computer graphics
- G06T 15/04: Texture mapping
- G06T 15/20: Perspective computation
- G06T 17/05: Geographic models
- G06V 20/176: {Urban or other man-made structures}
- G06V 20/653: {by matching three-dimensional models, e.g. conformal mapping of Riemann surfaces}
- G06T 2200/08: involving all processing steps from image acquisition to 3D model generation
- G06T 2210/04: Architectural design, interior design
- G06T 2210/56: Particle system, point based geometry or rendering
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

A method and system is provided for automatic generation and navigation of optimal views of facades of multi-dimensional building models based on where and how the original images were captured. The system and method allows for navigation and visualization of facades of individual or multiple building models in a multi-dimensional building model visualization system.

## Claims

### Claim 1

A method of visualizing a multi-dimensional building model on a computer display, the method comprises:
retrieving a multi-dimensional building model from computer memory;
defining a look angle for the multi-dimensional building model, the defining a look angle linking a real camera to virtual camera positioning based on contextual information obtained during image capture of the multi-dimensional building model;
defining a field of view for the multi-dimensional building model by defining up, down, left and right angles which define an extent of the multi-dimensional building model to be viewed on the computer display;
calculating a first main axis and a second main axis for the retrieved multi-dimensional building model to define an orientation of the multi-dimensional building model;
calculating an optimal camera position for the retrieved multi-dimensional building model based on the defined look angle, the defined field of view and the orientation, the optimal camera position defining an optimal view of the retrieved multi-dimensional building model; and
displaying the optimal view on the computer display.

### Claim 2 (depends on 1)

The method of claim 1, wherein the contextual information about the image capture includes, but is not limited to:
GPS Latitude Ref;
GPS Longitude Ref;
GPS Altitude;
GPS Dilution of Precision;
GPS Img (image) Direction Ref (reference);
GPS Img (image) Direction;
metadata for gravity;
metadata for camera orientation; or
or an image capture sequence number.

### Claim 3 (depends on 2)

The method of claim 2, wherein the image capture sequence number describes and associates each image with a virtual location.

### Claim 4 (depends on 2)

The method of claim 2, wherein the image capture sequence includes image capture starting at a front door, with counter-clockwise capture to sequentially capture images of one or more of: front right corner, right side, back left corner, back side, back right corner, side, front left corner in an image capture sequence with a name associated with images in the image capture sequence.

### Claim 5 (depends on 2)

The method of claim 2, wherein, if any image of an image capture sequence is recaptured, the image capture sequence number is preserved.

### Claim 6 (depends on 1)

The method of claim 1, wherein the contextual information is included with each image via an EXIF (exchangeable image file) format tag or separately via a metadata file.

### Claim 7 (depends on 1)

The method of claim 1 further comprises plotting default look angles for multi-dimensional building models based on an initial position of the real camera.

### Claim 8 (depends on 1)

The method of claim 1 further comprises determining a first look angle based on a first image in an image capture sequence.

### Claim 9 (depends on 1)

The method of claim 1 further comprises determining the look angle based on the contextual information including any of:
an arbitrary height relative to a roof of a building;
a corner of a building;
architectural features plotted in sequence;
a specific altitude above the multi-dimensional building model;
labeled locations; or
arbitrary factors used to locate the image capture as it depends on local building constraints wherein the optimal view includes an unobstructed view.

### Claim 10 (depends on 1)

The method of claim 1, wherein the retrieved multi-dimensional building model includes pre-stored, previously calculated ones of centered, at least partially unobstructed, optimal views for each façade.

### Claim 11

A system for visualizing a multi-dimensional building model, the system comprising:
a view processor for processing an optimal view of a multi-dimensional building model, the processor configured to:
retrieve the multi-dimensional building model from computer memory;
define a look angle for the multi-dimensional building model, the defining a look angle including linking a real camera to virtual camera positioning based on contextual information obtained during image capture of the multi-dimensional building model;
define a field of view for the multi-dimensional building model by defining up, down, left and right angles which define an extent of the multi-dimensional building model to be viewed on a computer display;
calculate a first main axis and a second main axis for the retrieved multi-dimensional building model to define an orientation of the multi-dimensional building model;
calculate an optimal camera position for the retrieved multi-dimensional building model based on the defined look angle, the defined field of view and the orientation, the optimal camera position defining an optimal view of the retrieved multi-dimensional building model; and
communicate the optimal view to a remote electronic device to be displayed on the computer display of the remote electronic device.

### Claim 12 (depends on 11)

The system of claim 11, wherein the contextual information about the image capture includes, but is not limited to:
GPS Latitude Ref;
GPS Longitude Ref;
GPS Altitude;
GPS Dilution of Precision;
GPS Img (image) Direction Ref (reference);
GPS Img (image) Direction;
metadata for gravity;
metadata for camera orientation; or
or image capture sequence number.

### Claim 13 (depends on 12)

The system of claim 12, wherein the image capture sequence number describes and associates each image with a virtual location.

### Claim 14 (depends on 12)

The system of claim 12, wherein the image capture sequence includes image capture starting at a front door, with counter-clockwise capture to sequentially capture images of one or more of: front right corner, right side, back left corner, back side, back right corner, side, front left corner in an image capture sequence with a name associated with images in the image capture sequence.

### Claim 15 (depends on 14)

The system of claim 14, wherein, if any image of an image capture sequence is recaptured, the image capture sequence number is preserved.

### Claim 16 (depends on 11)

The system of claim 11, wherein the processor is further configured to plot default look angles for a multi-dimensional building model based on an initial real camera position.

### Claim 17 (depends on 11)

The system of claim 11, wherein the processor is further configured to determine a first look angle based on a first image in an image capture sequence.

### Claim 18 (depends on 11)

The system of claim 11, wherein the processor is further configured to determine the look angle based on metadata associated with the contextual information including any of:
an arbitrary height relative to a roof of a building;
a corner of a building;
architectural features plotted in sequence;
a specific altitude above the multi-dimensional building model;
labeled locations; or
arbitrary factors used to locate the image capture as it depends on local building constraints wherein the optimal view includes an unobstructed view.

### Claim 19

A method of visualizing a multi-dimensional building model on a mobile electronic device display, the method comprises:
selecting a multi-dimensional building model based on a location of the multi-dimensional building model;
wirelessly retrieving, from remote computer memory, a previously stored optimal view of the selected multi-dimensional building model, the optimal view based on at least linking a real camera to virtual camera positioning based on contextual information obtained during image capture of the multi-dimensional building model, and wherein for the selected multi-dimensional building model, the optimal view is based on a look angle, a field of view and an orientation of the selected multi-dimensional building model, wherein the optimal view includes a centered at least partially unobstructed view of the selected multi-dimensional building model; and
displaying the optimal view on the mobile electronic device display.

### Claim 20 (depends on 19)

The method of claim 19, wherein the contextual information about the image capture includes, but is not limited to:
GPS Latitude Ref;
GPS Longitude Ref;
GPS Altitude;
GPS Dilution of Precision;
GPS Img (image) Direction Ref (reference);
GPS Img (image) Direction;
metadata for gravity;
metadata for camera orientation; or
or image capture sequence number.
