# US 2018/0025536 A1 · Multi-modal method for interacting with 3d models

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2018/0025536 A1
- Document ID: US20180025536A1
- Status: Published application
- Kind: A1
- Application number: 15/722,269
- Filed: 2017-10-02
- Published: 2018-01-25
- Earliest claimed: 2012-06-22
- Assignees: Matterport, Inc.
- Applicants: Matterport, Inc.
- Inventors: Matthew Bell; Michael Beebe
- Web page: https://patentgrep.com/patent/US20180025536A1

## CPC

- G06T 17/00: Three-dimensional [3D] modelling for computer graphics
- G06T 19/003: {Navigation within 3D models or images}
- G06T 2210/04: Architectural design, interior design
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

The present disclosure concerns a methodology that allows a user to “orbit” around a model on a specific axis of rotation and view an orthographic floor plan of the model. A user may view and “walk through” the model while staying at a specific height above the ground with smooth transitions between orbiting, floor plan, and walking modes.

## Claims

### Claim 1

A system, comprising:
a processor; and
a memory communicatively coupled to the processor, the memory having stored therein computer-executable instructions, comprising:
an interface component configured to:
generate a graphical user interface that facilitates viewing and navigating a three-dimensional model from different perspectives of a virtual camera in different navigation modes, wherein the different navigation modes comprises a walking mode that provides one or more perspectives of the different perspectives from the virtual camera representative of walking in the three-dimensional model;
receive user input indicating a target position of the virtual camera in the walking mode;
in response to a determination that the target position of the virtual camera creates a conflict with a portion of the three-dimensional model:
select a new target position that resolves the conflict, wherein the new target position is selected from predetermined positions, and
generate at least one representation of the three-dimensional model in the graphical user interface from at least one of the different perspectives based on the new target position.

### Claim 2 (depends on 1)

The system of claim 1, wherein a predetermined position of the predetermined positions is based upon iterative placement of a bottom of a user volume at a local floor height at points of a series of successively larger areas surrounding the target position until a point is located that resolves the conflict, and set the point as the new target position.

### Claim 3 (depends on 1)

The system of claim 1, further comprising a transition component configured to transition, according to a transition function, from a first representation of the three-dimensional model at a first perspective associated with a current position of the virtual camera to a second representation of the three-dimensional model at a second perspective associated with the new target position.

### Claim 4 (depends on 3)

The system of claim 3, wherein the user input further comprises a target orientation, the first perspective is further associated with a current orientation of the virtual camera, and the second perspective is further associated with the target orientation of the virtual camera.

### Claim 5 (depends on 3)

The system of claim 3, wherein the transition function employs interpolation over a time interval to generate the smooth visual transition between the first representation of the three-dimensional model and the second representation of the three-dimensional model.

### Claim 6 (depends on 1)

The system of claim 1, wherein the different navigation modes further comprise at least one of:
a floor plan mode that provides perspectives of the three-dimensional model from the virtual camera positioned outside and above the three-dimensional model and with a view of the three-dimensional model that has a pitch direction of the view locked substantially orthogonally orientated relative to a horizontal surface of the three-dimensional model, and wherein the floor plan mode enables spatial motion of the virtual camera while maintaining the substantially orthogonal orientation of the view relative to the horizontal surface, or
an orbit mode that provides perspectives of the three-dimensional model from the virtual camera positioned outside of the three-dimensional model based upon a point of the three-dimensional model.

### Claim 7 (depends on 2)

The system of claim 2, wherein the areas are circles.

### Claim 8

A method, comprising:
generating, by a system comprising a processor, a graphical user interface viewing and navigating a three-dimensional model from different perspectives of a virtual camera in different navigation modes, wherein the different navigation modes comprises a walking mode that provides one or more perspectives of the different perspectives from the virtual camera representative of walking in the three-dimensional model;
receiving, by the system, user input indicating a target position of the virtual camera in the walking mode;
in response to a determination that the target position of the virtual camera creates a conflict with a portion of the three-dimensional model:
selecting, by the system, a new target position that resolves the conflict, wherein the new target position is selected from predetermined positions; and
generating, by the system, at least one representation of the three-dimensional model in the graphical user interface from at least one of the different perspectives based on the new target position.

### Claim 9 (depends on 8)

The method of claim 8, wherein a predetermined position of the predetermined positions is based upon iteratively placing a bottom of a user volume at a local floor height at points of a series of successively larger areas surrounding the target position until a point is located that resolves the conflict, and setting the point as the new target position.

### Claim 10 (depends on 8)

The method of claim 8, further comprising transitioning, by the system according to a transition function, from a first representation of the three-dimensional model at a first perspective associated with a current position of the virtual camera to a second representation of the three-dimensional model at a second perspective associated with the new target position.

### Claim 11 (depends on 10)

The method of claim 10, wherein the user input further comprises a target orientation, the first perspective is further associated with a current orientation of the virtual camera, and the second perspective is further associated with the target orientation of the virtual camera.

### Claim 12 (depends on 10)

The method of claim 10, wherein the transition function employs interpolation over a time interval to generate the smooth visual transition between the first representation of the three-dimensional model and the second representation of the three-dimensional model.

### Claim 13 (depends on 8)

The method of claim 8, wherein the different navigation modes further comprise at least one of:
a floor plan mode that provides perspectives of the three-dimensional model from the virtual camera positioned outside and above the three-dimensional model and with a view of the three-dimensional model that has a pitch direction of the view locked substantially orthogonally orientated relative to a horizontal surface of the three-dimensional model, and wherein the floor plan mode enables spatial motion of the virtual camera while maintaining the substantially orthogonal orientation of the view relative to the horizontal surface, or
an orbit mode that provides perspectives of the three-dimensional model from the virtual camera positioned outside of the three-dimensional model based upon a point of the three-dimensional model.

### Claim 14 (depends on 9)

The method of claim 9, wherein the areas are circles.

### Claim 15

A non-transitory computer-readable medium having instructions stored thereon that, in response to execution, cause a system including a processor to perform operations, comprising:
generating a graphical user interface viewing and navigating a three-dimensional model from different perspectives of a virtual camera in different navigation modes, wherein the different navigation modes comprises a walking mode that provides one or more perspectives of the different perspectives from the virtual camera representative of walking in the three-dimensional model;
receiving user input indicating a target position of the virtual camera in the walking mode;
in response to a determination based on surface properties of an area around the target position on the three-dimensional model:
selecting a new target position from predetermined positions; and
generating at least one representation of the three-dimensional model in the graphical user interface from at least one of the different perspectives based on the new target position.

### Claim 16 (depends on 15)

The non-transitory computer-readable medium of claim 15, a predetermined position of the predetermined positions is based upon iteratively placing a bottom of a user volume at a local floor height at points of a series of successively larger areas surrounding the target position until a point is located that resolves the conflict, and setting the point as the new target position.

### Claim 17 (depends on 15)

The non-transitory computer-readable medium of claim 15, further comprising transitioning, according to a transition function, from a first representation of the three-dimensional model at a first perspective associated with a current position of the virtual camera to a second representation of the three-dimensional model at a second perspective associated with the new target position.

### Claim 18 (depends on 17)

The non-transitory computer-readable medium of claim 17, wherein the user input further comprises a target orientation, the first perspective is further associated with a current orientation of the virtual camera, and the second perspective is further associated with the target orientation of the virtual camera.

### Claim 19 (depends on 17)

The non-transitory computer-readable medium of claim 17, wherein the transition function employs interpolation over a time interval to generate the smooth visual transition between the first representation of the three-dimensional model and the second representation of the three-dimensional model.

### Claim 20 (depends on 15)

The non-transitory computer-readable medium of claim 15, wherein the different navigation modes further comprise at least one of:
a floor plan mode that provides perspectives of the three-dimensional model from the virtual camera positioned outside and above the three-dimensional model and with a view of the three-dimensional model that has a pitch direction of the view locked substantially orthogonally orientated relative to a horizontal surface of the three-dimensional model, and wherein the floor plan mode enables spatial motion of the virtual camera while maintaining the substantially orthogonal orientation of the view relative to the horizontal surface, or
an orbit mode that provides perspectives of the three-dimensional model from the virtual camera positioned outside of the three-dimensional model based upon a point of the three-dimensional model.
