# US 10,032,306 B2 · Method for inter-scene transitions

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 10,032,306 B2
- Document ID: US10032306B2
- Status: Granted
- Kind: B2
- Application number: 14/969,669
- Filed: 2015-12-15
- Published: 2016-05-26
- Granted: 2018-07-24
- Earliest claimed: 2004-11-12
- Assignees: EveryScape, Inc.
- Applicants: EveryScape, Inc.
- Inventors: Byong Mok Oh
- Web page: https://patentgrep.com/patent/US10032306B2

## CPC

- G06T 13/80: Two-dimensional [2D] animation, e.g. using sprites
- G06T 3/04: Context-preserving transformations, e.g. by using an importance map (panospheric to cylindrical image transformations G06T3/12)
- G06T 3/20: Linear translation of whole images or parts thereof, e.g. panning
- G06T 3/60: Rotation of whole images or parts thereof
- G06T 15/20: Perspective computation
- G06T 15/205: {Image-based rendering}
- G06T 19/003: {Navigation within 3D models or images}
- G06T 2210/44: Morphing
- G06T 2215/12: Shadow map, environment map
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

A method and system for creating a transition between a first scene and a second scene on a computer system display, simulating motion. The method includes determining a transformation that maps the first scene into the second scene. Motion between the scenes is simulated by displaying transitional images that include a transitional scene based on a transitional object in the first scene and in the second scene. The rendering of the transitional object evolves according to specified transitional parameters as the transitional images are displayed. A viewer receives a sense of the connectedness of the scenes from the transitional images. Virtual tours of broad areas, such as cityscapes, can be created using inter-scene transitions among a complex network of pairs of scenes.

## Claims

### Claim 1

A method for creating in a computer system a transition between a first scene and a second scene simulating motion, the first scene observed from a first viewpoint including a first digital image having color data and the second scene observed from a second viewpoint including a second digital image having color data, the method comprising:
a. determining, for each digital image, a directional vector corresponding to a pan and tilt of a camera that captured the digital image and indicating an orientation of the scene corresponding to the digital image with respect to a coordinate system local to the digital image;
b. transforming, for each digital image, corresponding digital image data to rotate the digital image so that the directional vector of the transformed digital image is parallel to a particular axis of a global coordinate system;
c. further transforming digital image data of at least one of the transformed digital images by (i) rotating the at least one transformed digital image so that the directional vector is parallel with the directional vector of another transformed digital image and (ii) translating the at least one transformed digital image to align the directional vectors, thereby achieving alignment of corresponding features in each of the transformed digital images;
d. defining a common ground plane shared by the first transformed digital image and the second transformed digital image;
e. defining a footprint of structures within the first transformed digital image and the second transformed digital image on the ground plane;
f. extruding from the footprint geometries, wherein the footprint and the extruded geometries define a three-dimensional geometry representative of the structures;
g. determining a view position along a path and a corresponding orientation for a transitional image in relation to the three-dimensional geometry; and
h. projectively mapping color data from the first digital image and the second digital image based on the three-dimensional geometry and the view position to create a transitional image.

### Claim 2 (depends on 1)

The method according to claim 1, wherein the first digital image and the second digital image are representative of photographs.

### Claim 3 (depends on 1)

The method according to claim 1, wherein the first digital image and the second digital image are panoramic images.

### Claim 4 (depends on 3)

The method according to claim 3, wherein the first and second digital images represent a 360 degree view.

### Claim 5 (depends on 1)

The method for creating a transition between a first scene and a second scene simulating motion according to claim 1, the method further comprising:
displaying on the display the first digital image, one or more transitional images, and the second digital image sequentially.

### Claim 6 (depends on 1)

The method according to claim 1, wherein the geometries include at least one of a perspective rectangle and a perspective triangle.

### Claim 7 (depends on 1)

The method according to claim 1 wherein a plurality of transitional images are created from different positions along the path.

### Claim 8 (depends on 1)

The method according to claim 1 further comprising:
displaying on the display the first digital image with a first navigational icon embedded; and
when the first navigational icon is activated, displaying the transitional image, such that there is simulated motion from the first digital image to the second digital image.

### Claim 9 (depends on 8)

The method according to claim 8, wherein displaying a transitional image includes at least one of alpha-blending, morphing and motion-blurring the first digital image and the second digital image.

### Claim 10 (depends on 1)

The method according to claim 1, the method further comprising:
displaying the first scene;
receiving an indication of the view position; and
when the indication of the view position is received, displaying the transitional image that includes at least one transitional scene, such that there is simulated motion from the first scene to the second scene.

### Claim 11

A computer program product comprising a non-transitory computer-readable medium having computer code thereon for creating a transition between a first scene and a second scene simulating motion, the first scene observed from a first viewpoint including a first digital image having color data and the second scene observed from a second viewpoint including a second digital image having color data, the computer code comprising:
computer code for determining, for each digital image, a directional vector corresponding to a pan and tilt of a camera that captured the digital image and indicating an orientation of the scene corresponding to the digital image with respect to a coordinate system local to the digital image;
computer code for transforming, for each digital image, corresponding digital image data to rotate the digital image so that the directional vector of the transformed digital image is parallel to a particular axis of a global coordinate system;
computer code for further transforming digital image data of at least one of the transformed digital images by (i) rotating the at least one transformed digital image so that the directional vector is parallel with the directional vector of another transformed digital image and (ii) translating the at least one transformed digital image to align the directional vectors, thereby achieving alignment of corresponding features in each of the transformed digital images;
computer code for defining a common ground plane shared by the first transformed digital image and the second transformed digital image;
computer code for defining a footprint of structures within the first transformed digital image and the second transformed digital image on the ground plane;
computer code for extruding from the footprint geometries, wherein the footprint and the extruded geometries define a three-dimensional geometry representative of the structures;
computer code for determining a view position along a path and a corresponding orientation for a transitional image in relation to the three dimensional geometry; and
computer code for projectively mapping color data from the first digital image and the second digital image based on the three-dimensional geometry and the view position to create a transitional image.

### Claim 12 (depends on 11)

The computer program product according to claim 11, wherein the first digital image and the second digital image are representative of photographs.

### Claim 13 (depends on 11)

The computer program product according to claim 11, wherein the first digital image and the second digital image are panoramic images.

### Claim 14 (depends on 13)

The computer program product according to claim 13, wherein the first and second digital images represent a 360 degree view.

### Claim 15 (depends on 11)

The computer program product according to claim 11, the computer code further comprising:
computer code for displaying on the display the first digital image, one or more transitional images, and the second digital image sequentially.

### Claim 16 (depends on 11)

The computer program product according to claim 11, wherein the geometries include at least one of a perspective rectangle and perspective triangle.

### Claim 17 (depends on 11)

The computer program product according to claim 11, wherein a plurality of transitional images are created from different positions along the path.

### Claim 18 (depends on 11)

The computer program product according to claim 11, further comprising:
computer code for displaying on the display the first digital image with a first navigational icon embedded; and
computer code for displaying the transitional image, such that there is simulated motion from the first digital image to the second digital image when the first navigational icon is activated.

### Claim 19 (depends on 18)

The computer program product according to claim 18, wherein the computer code for displaying a transitional image includes at least one of alpha-blending, morphing and motion-blurring the first digital image and the second digital image.

### Claim 20 (depends on 11)

The computer program product according to claim 11, the computer code further comprising:
computer code for displaying the image of the first scene;
computer code for receiving an indication of the view position; and
computer code for displaying the transitional image that includes at least one transitional scene, such that there is simulated motion from the first scene to the second scene when the indication of the view position is received.
