# US 2010/0164986 A1 · Dynamic Collage for Visualizing Large Photograph Collections

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2010/0164986 A1
- Document ID: US20100164986A1
- Status: Published application
- Kind: A1
- Application number: 12/344,611
- Filed: 2008-12-29
- Published: 2010-07-01
- Earliest claimed: 2008-12-29
- Assignees: Microsoft Corporation
- Inventors: Yichen Wei; Yasuyuki Matsushita
- Web page: https://patentgrep.com/patent/US20100164986A1

## CPC

- G06T 11/60: Creating or editing images; Combining images with text
- G06V 10/24: Aligning, centring, orientation detection or correction of the image
- G06V 10/16: {using multiple overlapping images; Image stitching}
- G09G 2340/10: Mixing of images, i.e. displayed pixel being the result of an operation, e.g. adding, on the corresponding input pixels
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00)

## Abstract

Described is a technology in which a collage of digital photographs is dynamically computed and rendered so as to vary the photographs that are visible in the collage over time. A dynamic collage mechanism coupled to a source of photographs computes a collage for visible output, and dynamically updates the collage on a scheduled basis by adding different photograph(s) in place of other photograph(s). Each arrangement of the photographs in each updated collage is computed from a previous collage. Also described is layout optimization in which the photographs in the updated collage are translated, rotated and/or layered so as to cover a maximum amount of the overall area of the collage.

## Claims

### Claim 1

In a computing environment, a method comprising, inputting a plurality of photographs, arranging the photographs into a collage, dynamically updating the collage by removing at least one photograph, adding at least one other photograph and rearranging the photographs into a collage, and outputting the rearranged collage.

### Claim 2 (depends on 1)

The method of claim 1 wherein dynamically updating the collage occurs according to scheduling parameters.

### Claim 3 (depends on 2)

The method of claim 2 wherein the scheduling parameters specify a photograph lifetime, a new photograph addition ordering parameter, or a new photograph layout parameter, or any combination of photograph lifetime, a new photograph addition ordering parameter, or a new photograph layout parameter comprises

### Claim 4 (depends on 1)

The method of claim 1 further comprising, selecting photographs for the collage based on saliency computations.

### Claim 5

The method of claim wherein selecting photographs for the collage based on saliency computations comprises performing face detection or using pixel importance data, or both performing face detection and using pixel importance data.

### Claim 6 (depends on 1)

The method of claim 1 further comprising, rendering the collage including fading effects, alpha blending, or both fading effects and alpha blending.

### Claim 7 (depends on 1)

The method of claim 1 wherein rearranging the photographs comprises computing a new arrangement based upon a previous arrangement, including performing an optimization that is based on area of the added photograph or photographs, area of the removed photograph or photographs, and an area of a collage canvas.

### Claim 8 (depends on 7)

The method of claim 7 wherein computing the new arrangement based upon an optimization includes varying translation parameters, varying rotation parameters, or varying layer parameters associated with the photographs, or any combination of varying translation parameters, varying rotation parameters, or varying layer parameters.

### Claim 9 (depends on 7)

The method of claim 7 wherein computing the new arrangement based upon an optimization includes varying translation parameters, including performing a coarse-grained translation of the photographs with respect to their positions in a collage canvas area, before performing a fine-grained translation of the photographs with respect to their positions in the collage canvas area.

### Claim 10 (depends on 7)

The method of claim 7 wherein computing the new arrangement based upon an optimization includes varying at least one translation parameter while at least one rotation parameter and at least one layer parameter are fixed, varying at least one rotation parameter while at least one translation parameter and at least one layer parameter are fixed, and varying at least one layer parameter while at least one translation parameter and at least one rotation parameter are fixed.

### Claim 11

In a computing environment, a system comprising, a dynamic collage mechanism coupled to a source of photographs, the dynamic collage mechanism computing a collage for visible output, dynamically updating the collage into updated collages by adding different photographs in place of other photographs over time, in which each arrangement of the photographs in each updated collage is computed from a previous collage.

### Claim 12 (depends on 11)

The system of claim 11 wherein the dynamic collage mechanism includes a saliency component that ranks or selects photographs to add to the updated collage based upon desired characteristics therein.

### Claim 13 (depends on 11)

The system of claim 11 wherein the dynamic collage mechanism includes a scheduling component that determines when one photograph is to be added to the updated collage and when another photograph is to be removed from the updated collage.

### Claim 14 (depends on 11)

The system of claim 11 wherein the source of the photographs comprises a local store, a stream of photographs, or image search results, or any combination of a local store, a stream of photographs, or image search results.

### Claim 15 (depends on 11)

The system of claim 11 wherein the dynamic collage mechanism includes an optimization component that computes the updated collage from the previous collage by computing areas of the photographs in the updated collage relative to an area of the collage, and translating, rotating and/or layering at least some images to cover a more optimal amount of the area of the collage.

### Claim 16

One or more computer-readable media having computer-executable instructions, which when executed perform steps, comprising:
(a) outputting a currently constructed collage for rendering;
(b) computing an updated collage by removing at least one photograph from data corresponding to the currently constructed collage and adding at least one other photograph to the data corresponding to the currently constructed collage; and
(c) setting the currently constructed collage to be the updated collage and returning to step (a).

### Claim 17 (depends on 16)

The one or more computer-readable media of claim 16 having further computer-executable instructions comprising selecting each photograph to add to the updated collage based upon saliency processing.

### Claim 18 (depends on 16)

The one or more computer-readable media of claim 16 wherein computing the updated collage comprises operating in response to a schedule.

### Claim 19 (depends on 16)

The one or more computer-readable media of claim 16 wherein computing the updated collage comprises determine areas of the photographs in the updated collage relative to an area of the collage, and translating, rotating and/or layering at least some images to cover a more optimal amount of the area of the collage.

### Claim 20 (depends on 16)

The one or more computer-readable media of claim 16 having further computer-executable instructions comprising rendering the currently constructed collage, including performing fading effects, alpha blending, or both fading effects and alpha blending with respect to a previous rendering.
