# US 2013/0254666 A1 · Navigating Images Using Image Based Geometric Alignment And Object Based Controls

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2013/0254666 A1
- Document ID: US20130254666A1
- Status: Published application
- Kind: A1
- Application number: 13/898,697
- Filed: 2013-05-21
- Published: 2013-09-26
- Earliest claimed: 2006-07-25
- Assignees: University of Washington; Microsoft Corporation
- Applicants: University of Washington; Microsoft Corporation
- Inventors: Keith Noah Snavely; Steven Maxwell Seitz; Richard Szeliski
- Web page: https://patentgrep.com/patent/US20130254666A1

## CPC

- G06V 20/176: {Urban or other man-made structures}
- G06F 3/04842: Selection of displayed objects or displayed text elements (G06F3/0482 takes precedence)
- G06F 16/185: Hierarchical storage management [HSM] systems, e.g. file migration or policies thereof (details of archiving G06F16/11)
- G06F 16/22: Indexing; Data structures therefor; Storage structures
- G06F 16/54: Browsing; Visualisation therefor
- G06Q 40/04: Trading; Exchange, e.g. stocks, commodities, derivatives or currency exchange
- G06T 11/00: Two-dimensional [2D] image generation
- G06V 10/24: Aligning, centring, orientation detection or correction of the image
- G06V 20/38: {Outdoor scenes}
- G06V 20/39: {Urban scenes}
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

Over the past few years there has been a dramatic proliferation of digital cameras, and it has become increasingly easy to share large numbers of photographs with many other people. These trends have contributed to the availability of large databases of photographs. Effectively organizing, browsing, and visualizing such .scas. of images, as well as finding a particular image, can be difficult tasks. In this paper, we demonstrate that knowledge of where images were taken and where they were pointed makes it possible to visualize large sets of photographs in powerful, intuitive new ways. We present and evaluate a set of novel tools that use location and orientation information, derived semi-automatically using structure from motion, to enhance the experience of exploring such large collections of images.

## Claims

### Claim 1

A method comprising:
providing, by a server, instructions to display a first digital photograph at a main location within a display, said first digital photograph comprising first image content;
providing, by said server, at least one selectable alternate digital photograph displayed at a second location within said display, wherein said selectable alternate digital photograph comprises image content that is at least one of: overlapping to said first image content or proximal to said first image content; and
responsive to selection of said selectable alternate digital photograph, providing instructions to display transitional image content in said main location prior to displaying said selectable alternate digital photograph in said main location, wherein said second location within said display is a location that is overlaid on top of the first digital photograph such that said image content in said selectable alternate digital photograph overlaps corresponding first image content.

### Claim 2 (depends on 1)

The method of claim 1, further comprising:
providing a search tool for finding alternate digital photographs comprising image content with a close-up view of at least one portion of said first image content.

### Claim 3 (depends on 1)

The method of claim 1, further comprising:
providing, a search tool for finding alternate digital photographs comprising image content that is overlapping substantially all of said first image content without substantial additional image content.

### Claim 4 (depends on 1)

The method of claim 1, further comprising:
sequencing a plurality of alternate digital photographs according to a time when said plurality of alternate digital photographs were captured.

### Claim 5 (depends on 1)

The method of claim 1, further comprising:
providing a search tool for finding alternate digital photographs comprising image content that is overlapping substantially all of said first image content and further comprising substantial additional image content, thereby providing a zoomed-out view of said first image content.

### Claim 6 (depends on 1)

The method of claim 1, wherein said at least one selectable alternate digital photograph comprises at least two selectable alternate digital photographs, a first alternate digital photograph comprising image content proximal to a left side of said first image content, and a second alternate digital photograph comprising image content proximal to a right side of said first image content.

### Claim 7 (depends on 1)

The method of claim 1, further comprising:
providing a selectable slideshow tool that effectuates a sequential display of a plurality of digital photographs in said main location, said plurality of digital photographs varying in either a time when said plurality of digital photographs were captured or a viewpoint from which said plurality of digital photographs were captured.

### Claim 8 (depends on 7)

The method of claim 7, wherein said plurality of digital photographs are geometrically stabilized by projecting them onto a common plane in the main location within said display.

### Claim 9 (depends on 1)

The method of claim 1, further comprising:
providing a plurality of stored alternate images also comprising said first image content; and
providing a tool for searching among said plurality of stored alternate images for a best view of a selected portion of said first image content, wherein said best view is defined as at least one of: a view from a direction that is most closely perpendicular to a plane associated with said image content, a view in which a greatest number of points associated with the selected portion of said first image content are visible, or a view comprising a greatest amount of detail associated with said first image content.

### Claim 10 (depends on 1)

The method of claim 1,
providing a score of stored alternate images according to best view of said selected portion of said first image content.

### Claim 11 (depends on 1)

The method of claim 1, further comprising:
displaying a plurality of stored alternate images in a sequence corresponding to a score value associated with each displayed image.

### Claim 12

A method comprising:
providing, by a server, instructions to display a first digital photograph at a main location within a display, wherein said first digital photograph comprising first image content;
providing, by said server, at least one selectable alternate digital photograph displayed at a second location within said display, wherein said alternate digital photograph comprises image content that is at least one of: overlapping to said first image content or proximal to said first image content; and
responsive to selection of said selectable alternate digital photograph, providing instructions to display transitional image content in said main location prior to displaying said alternate digital photograph in said main location;
providing a selectable slideshow tool that effectuates a sequential display of a plurality of digital photographs in said main location, said plurality of digital photographs varying in either a time when said plurality of digital photographs were captured or a viewpoint from which said plurality of digital photographs were captured, wherein said plurality of digital photographs are geometrically stabilized by projecting them onto a common plane in the main location within said display.

### Claim 13 (depends on 12)

The method of claim 12, wherein said second location within said display is a location that is overlaid on top of the first digital photograph such that image content in said selectable alternate digital photograph overlaps corresponding first image content.

### Claim 14 (depends on 12)

The method of claim 12, further comprising:
providing a search tool for finding alternate digital photographs comprising image content with a close-up view of at least one portion of said first image content.

### Claim 15 (depends on 12)

The method of claim 12, further comprising:
providing, a search tool for finding alternate digital photographs comprising image content that is overlapping substantially all of said first image content without substantial additional image content.

### Claim 16

A method comprising:
providing, by a server, instructions to display a first digital photograph at a main location within a display, wherein said first digital photograph comprising first image content;
providing, by said server, at least one selectable alternate digital photograph displayed at a second location within said display, wherein said alternate digital photograph comprises image content that is at least one of: overlapping to said first image content or proximal to said first image content; and
responsive to selection of said selectable alternate digital photograph, providing instructions to display transitional image content in said main location prior to displaying said alternate digital photograph in said main location;
providing a plurality of stored alternate images also comprising said first image content; and
providing a tool for searching among said stored plurality of alternate images for a best view of a selected portion of said first image content, wherein said best view is defined as at least one of: a view from a direction that is most closely perpendicular to a plane associated with said image content, a view in which a greatest number of points associated with the selected portion of said first image content are visible, or a view comprising a greatest amount of detail associated with said first image content.

### Claim 17 (depends on 16)

The method of claim 16,
providing a score of stored alternate images according to said best view of said selected portion of said first image content.

### Claim 18 (depends on 16)

The method of claim 16, further comprising:
displaying the plurality of stored alternate images in a sequence corresponding to a score value associated with each displayed image.

### Claim 19 (depends on 16)

The method of claim 16, further comprising:
providing a search tool for finding alternate digital photographs comprising image content that is overlapping substantially all of said first image content and further comprising substantial additional image content, thereby providing a zoomed-out view of said first image content.

### Claim 20 (depends on 16)

The method of claim 16, wherein said at least one selectable alternate digital photograph comprises at least two selectable alternate digital photographs, a first alternate digital photograph comprising image content proximal to a left side of said first image content, and a second alternate digital photograph comprising image content proximal to a right side of said first image content.
