# US 2004/0070593 A1 · Mosaic-like user interface for video selection and display

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2004/0070593 A1
- Document ID: US20040070593A1
- Status: Published application
- Kind: A1
- Application number: 10/418,739
- Filed: 2003-04-18
- Published: 2004-04-15
- Earliest claimed: 2002-07-09
- Assignees: Kaleidescape, Inc.
- Inventors: Shawn R. Neely; Lawrence Kesteloot; Margaret Novotny; Marion Buchenau; Sheila A. Foley; Michael O'Neil
- Web page: https://patentgrep.com/patent/US20040070593A1

## CPC

- H04N 21/84: Generation or processing of descriptive data, e.g. content descriptors {(systems specially adapted for using meta-information in broadcast systems H04H60/73)}
- G06F 16/743: {a collection of video files or sequences}
- H04N 1/00442: {Simultaneous viewing of a plurality of images, e.g. using a mosaic display arrangement of thumbnails}
- H04N 1/00453: {arranged in a two dimensional array}
- H04N 1/00458: {Sequential viewing of a plurality of images, e.g. browsing or scrolling}
- H04N 1/00461: {marking or otherwise tagging one or more displayed image, e.g. for selective reproduction}
- H04N 7/163: {by receiver means only}
- H04N 21/4312: {involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations}
- H04N 21/4314: {for fitting data in a restricted space on the screen, e.g. EPG data in a rectangular grid}
- H04N 21/47: End-user applications
- H04N 21/482: End-user interface for programme selection
- H04N 21/4826: {using recommendation lists, e.g. of programmes or channels sorted out according to their score}
- H04N 21/42206: {characterized by hardware details}
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

A UI involving selection and display from a library of videos, including a “Mosaic” mode of operation, in which a primarily visual display is made of information about possible videos, with the effect that a user might select one such video in response to such visual display. The Mosaic includes an two-dimensional array of entries, each of which has visual information for that entry. The Mosaic collects relatively similar entries near to each other in the visual field seen by a user. The focus is centralized and emphasized, and has auxiliary information displayed for further understanding. The array is dynamically rearranged in response to change in focus and metadata about the entries. Relative weighting of that metadata is responsive to user choice. The array includes rows and columns each of which includes all possible entries, but offset by relatively prime values.

## Claims

### Claim 1

A method including steps of
generating a representation of a set of entries, said representation including a set of entries, each entry having a set of data fields, and a focus associated with at least one of said entries, a set of said entries being incorporated into said representation, each said entry being incorporated into said representation responsive to at least one data field associated with said entry, wherein said data field has a pictorial representation;
wherein said representation is generated in response to a measure of data-entry distance between each pair of said entries and in response to a measure of representation distance between each pair of said entries.

### Claim 2

A method including steps of
representing at least some of a set of entries each having a set of data fields associated therewith, wherein a result of said steps of representing includes (a) a relative placement of said some entries, and (b) for said some entries, a selection of at least one graphical element in response to at least some of said data fields;
wherein said relative placement is responsive to a measure of content distance between pairs of said some entries, said measure of content distance being responsive to a measure of similarity of a plurality of values in said data fields.

### Claim 3 (depends on 2)

A method as in claim 2, including steps of
dynamically generating said graphical element in response to at least one of (a) values for said some data fields, or (b) values retrieved from a logically remote source.

### Claim 4 (depends on 2)

A method as in claim 2, wherein
said graphical element includes at least one value from one of said data fields, said at least one value including at least one of (a) a picture representative to a user of its associated entry, or (b) a caption representative to a user of its associated entry.

### Claim 5 (depends on 2)

A method as in claim 2, wherein
said at least one graphical element is responsive to a movie poster associated with a media stream; and
said measure of content distance is responsive to a visual characteristic of said movie poster.

### Claim 6 (depends on 2)

A method as in claim 2, wherein
said at least one graphical element is responsive to a movie poster associated with a media stream; and
said measure of content distance is responsive to at least one of the following associated with said media stream: a title, a genre, at least one actor, at least one character, a series, a director, a producer, a studio, a year made or remade, a rating, or a set of awards.

### Claim 7 (depends on 2)

A method as in claim 2, wherein
said at least one graphical element is responsive to a movie poster associated with a media stream; and
said measure of content distance is responsive to at least one of the following characteristics of said movie poster:
whether said movie poster is abstract or shows a scene,
whether said movie poster shows a selected actor,
whether said movie poster is primarily pictorial or text, or
a set of values for brightness, hue, or saturation associated with said movie poster.

### Claim 8 (depends on 2)

A method as in claim 2, wherein
said at least one graphical element is responsive to values in a first set of said data fields;
said measure of content distance is responsive to values in a second set of said data fields; and
said first set and said second set are substantially disjoint.

### Claim 9 (depends on 2)

A method as in claim 2, wherein
said measure of content distance is responsive to values in a set of said data fields;
said values are weighted in response to an indicator of user preference.

### Claim 10 (depends on 2)

A method as in claim 2, wherein
said measure of content distance is responsive to values in a set of said data fields;
said values are weighted in response to at least one of the following indicators of user preference:
an explicitly selected relative weighting value,
an relative weighting value selected implicitly responsive to a set of user inputs or requests,
a set of demographic information about said user, or
a set of collaborative filtering information.

### Claim 11 (depends on 2)

A method as in claim 2, wherein
a measure of display distance is responsive to relative placement of said some entries; and
said measure of content distance is positively correlated with said measure of display distance.

### Claim 12 (depends on 2)

A method as in claim 2, wherein
said relative placement of said some entries is relatively nearer for pairs of entries when said measure of content distance is relatively smaller; and
said relative placement of said some entries is relatively farther for pairs of entries when said measure of content distance is relatively larger.

### Claim 13

A method including steps of
generating a representation of a set of entries, said representation including a set of entries, each entry having a set of data fields, and a focus associated with at least one of said entries, a set of said entries being incorporated into said representation, each said entry being incorporated into said representation at an intersection of least one said row and one said column;
wherein said representation is rearranged in response to associating said focus with a different one of said entries.

### Claim 14 (depends on 2)

A method as in claim 2, wherein
a result of said steps of representing includes at least one focused-upon entry.

### Claim 15 (depends on 14)

A method as in claim 14, including steps of
dynamically altering said representation in response to a selection of said at least one focused-upon entry, wherein a result of said steps of altering includes a new said relative placement in response to at least one of (a) said measure of content distance from said at least one focused-upon entry, or (b) a pseudorandom or random effect.

### Claim 16 (depends on 14)

A method as in claim 14, including steps of
dynamically altering said representation in response to a triggering event, said triggering event including at least one of (a) a request for said steps of dynamically altering, (b) a selection of a new focused-upon entry, (c) a set of incoming new data, (d) passage of a selected psychologically pleasing time duration, or (e) a pseudorandom or random effect.

### Claim 17 (depends on 14)

A method as in claim 14, wherein
a result of said steps of representing includes a screen region representing a set of auxiliary information relating to said focused-upon entry.

### Claim 18 (depends on 14)

A method as in claim 14, wherein
a result of said steps of representing includes a screen region representing a set of information beyond said auxiliary information relating to said focused-upon entry, in response to a user action.

### Claim 19

A method including steps of
generating a representation of a set of entries, said representation including a set of entries, each entry having a set of data fields, and a focus associated with at least one of said entries, a set of said entries being incorporated into said representation, each said entry being incorporated into said representation at an intersection of least one said row and one said column;
wherein when scrolling through said representation either horizontally or vertically, said representation includes each said entry in each said row and in each said column.

### Claim 20

A method including steps of
generating a representation of a set of information;
said information being presentable using more than one dimension;
said representation including a distribution of display elements within a representative space having more than one dimension;
said distribution including an ordering of substantially all said display elements in a first one said dimension;
said distribution including a substantially identical ordering in said first one said dimension, and having a first offset from said ordering, in response to a second offset in a second one said dimension;
said distribution having the property that substantially all said display elements can be found along said first one said dimension and having substantially any offset along said second one said dimension; and
said distribution having the property that substantially all said display elements can be found along said second one said dimension and having substantially any offset along said first one said dimension.

### Claim 21 (depends on 20)

A method as in claim 20, wherein said display elements are each responsive to at least one data field in a database.

### Claim 22 (depends on 20)

A method as in claim 20, wherein said display elements each include at least one pixel.

### Claim 23 (depends on 20)

A method as in claim 20, wherein said display elements overlap.

### Claim 24 (depends on 20)

A method as in claim 20, wherein said representation is responsive to a pseudorandom or random effect.

### Claim 25 (depends on 20)

A method as in claim 20, wherein said representation is responsive to a pseudorandom or random effect, said effect being distributed within said representative space.

### Claim 26 (depends on 20)

A method as in claim 20, wherein said representative space includes a set of rows and a set of columns.

### Claim 27 (depends on 20)

A method as in claim 20, wherein said representative space includes an X axis and a Y axis.

### Claim 28 (depends on 20)

A method as in claim 20, wherein said first offset is
relatively prime to a number of said display elements in said ordering; and
proportional to said second offset.

### Claim 29 (depends on 20)

A method as in claim 20, wherein said first offset is relatively prime to a number of said display elements in said ordering.

### Claim 30 (depends on 29)

A method as in claim 29, wherein said first offset is near a multiple of a root of said number.

### Claim 31 (depends on 29)

A method as in claim 29, wherein said first offset is near a multiple of a square-root of said number.

### Claim 32 (depends on 29)

A method as in claim 29, wherein said first offset is within ln (N) of 2 sqrt (N), where N is said number, ln (N) is a logarithm of N, and sqrt (N) is a square-root of N.

### Claim 33 (depends on 2)

A method as in claim 2, wherein
a result of said steps of representing includes grid of screen regions, each disposed at an intersection of a plurality of axes.

### Claim 34 (depends on 2)

A method as in claim 2, wherein
a result of said steps of representing includes a set of rows and a set of columns, defining a plurality of screen regions at a plurality of intersections of rows and columns; and
each said screen region includes at least one said graphical element associated with an entry assigned to that screen region.

### Claim 35 (depends on 34)

A method as in claim 34, wherein
each said entry has associated with it least one said graphical element in each said row; and
each said entry has associated with it least one said graphical element in each said column.

### Claim 36 (depends on 34)

A method as in claim 34, wherein
each said entry has associated with it least one said graphical element in a first said row; and
each row other than said first row is offset from said first row by a number of screen regions relatively prime to a total number of entries.

### Claim 37

A method including steps of
generating a representation of a set of entries, said representation including a set of entries, each entry having a set of data fields, and a focus associated with at least one of said entries, a set of said entries being incorporated into said representation, each said entry being incorporated into said representation at an intersection of least one said row and one said column;
wherein each entry has a brightness responsive to an associated content distance from said one entry associated with said focus.

### Claim 38 (depends on 14)

A method as in claim 14, wherein
a result of said steps of representing includes one or more said entries having relative emphasis.

### Claim 39 (depends on 38)

A method as in claim 38, wherein
a degree of emphasis for said entries having relative emphasis is responsive to said measure of content distance from said at least one focused-upon entry.

### Claim 40 (depends on 38)

A method as in claim 38, wherein
a selection of said entries having relative emphasis is responsive to said measure of content distance from said at least one focused-upon entry.

### Claim 41 (depends on 38)

A method as in claim 38, wherein
said relative emphasis includes at least a first type and a second type of emphasis;
said entries having relative emphasis responsive to said measure of content distance from said at least one focused-upon entry have said first type of emphasis; and
said focused-upon entry has said second type of emphasis.
