# US 2015/0177914 A1 · Information surfacing with visual cues indicative of relevance

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2015/0177914 A1
- Document ID: US20150177914A1
- Status: Published application
- Kind: A1
- Application number: 14/139,853
- Filed: 2013-12-23
- Published: 2015-06-25
- Earliest claimed: 2013-12-23
- Assignees: Microsoft Corporation
- Applicants: Microsoft Corporation
- Inventors: Donald Robert Coyner; David Jones; Rudy Poot; Christopher Eoin Miles; Ammon Haggerty
- Web page: https://patentgrep.com/patent/US20150177914A1

## CPC

- G06F 3/0481: based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
- G06F 3/04815: Interaction with a metaphor-based environment or interaction object displayed as three-dimensional [3D], e.g. changing the user viewpoint with respect to the environment or object
- G06F 3/0484: for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
- G06F 9/451: Execution arrangements for user interfaces
- G06T 3/20: Linear translation of whole images or parts thereof, e.g. panning
- G06T 3/60: Rotation of whole images or parts thereof
- G09G 3/36: using liquid crystals
- G06F 2203/04804: Transparency, e.g. transparent or translucent windows
- G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)}
- G06T 2210/24: Fluid dynamics
- G06T 2219/2012: Colour editing, changing, or manipulating; Use of colour codes
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00)

## Abstract

A user interface through which information is proactively provided utilizes visual cues indicative of the relevance of the information that is being proactively provided. Such visual cues include sizing, color, intensity, movement, and other like visual attributes. A single discrete visual element proactively presents information to the user. The user is provided with the opportunity to define discrete events, whereby information associated with such events is presented through other discrete elements. The physical orientation of such discrete elements indicates relationships between elements. Ranking functionality identifies more immediately relevant information and the rankings of related elements are increased based upon other, contextual information with which such information is associated, and on which the importance of such information is based. Information is surfaced to provide a vector through which the user responds or utilizes such surfaced information independently of specific application programs having discrete informational focus.

## Claims

### Claim 1

A method for notifying a user via a graphical user interface that is physically generated on a hardware display device by a computing device, the method comprising the steps of:
obtaining a first notification and a first relevance associated with the first notification;
generating, as part of the graphical user interface, a first discrete visual element comprising the first notification, the first discrete visual element having a first size, a first shape, a first color intensity and a first transparency, wherein at least one of: the first size, the first shape, the first color intensity and the first transparency are selected based on the first relevance;
subsequently obtaining a second relevance associated with the first notification, the second relevance representing a change from the first relevance; and
regenerating, as part of the graphical user interface, the first discrete visual element by modifying at least one of: the first size, the first shape, the first color intensity and the first transparency in accordance with the second relevance.

### Claim 2 (depends on 1)

The method of claim 1, wherein the generating the first discrete visual element comprises generating the first discrete visual element to visually appear as if it is floating in a container of opaque liquid at a depth corresponding to the first relevance and being observed by the user from above; and wherein further the regenerating the first discrete visual element comprises regenerating the first discrete visual element so as to visually appear as if it is rising within the container of opaque liquid towards the user if the second relevance is greater than the first relevance and regenerating the first discrete visual element to visually appear as if it is sinking further away from the user within the container of opaque liquid if the second relevance is less than the first relevance.

### Claim 3 (depends on 2)

The method of claim 2, wherein the generating the first discrete visual element to visually appear as if it is floating in the container of opaque liquid at the depth corresponding to the first relevance and being observed by the user from above comprises graphically reducing a clarity of the first discrete visual element to simulate presence of an amount of the opaque liquid between the first discrete visual element and the user, the amount being inversely proportional to the first relevance; and wherein further the regenerating the first discrete visual element comprises graphically increasing the clarity to simulate a decreasing amount of the opaque liquid between the first discrete visual element and the user if the second relevance is greater than the first relevance and graphically decreasing the clarity to simulate an increasing amount of the opaque liquid between the first discrete visual element and the user if the second relevance is less than the first relevance.

### Claim 4 (depends on 1)

The method of claim 1, wherein the first discrete visual element is a tile.

### Claim 5 (depends on 1)

The method of claim 1, further comprising the steps of:
obtaining a second notification, differing from the first notification, and a third relevance associated with the second notification;
generating, as part of the graphical user interface, a second discrete visual element, differing from the first discrete visual element and comprising the second notification, the second discrete visual element having a second size, a second shape, a second color intensity and a second transparency, wherein at least one of: the second size, the second shape, the second color intensity and the second transparency are selected based on the third relevance.

### Claim 6 (depends on 5)

The method of claim 5, wherein a visual proximity of the second discrete visual element to the first discrete visual element in the graphical user interface is indicative of a relationship between the second notification and the first notification.

### Claim 7 (depends on 6)

The method of claim 6, wherein the visual proximity of the second discrete visual element to the first discrete visual element is such that, if the second notification is explicitly related to the first notification, the first and second discrete visual elements share an edge, and if the second notification is implicitly related to the first notification, the first and second discrete visual elements are generated with a visual gap between them.

### Claim 8 (depends on 1)

The method of claim 1, wherein the first notification is based on a combination of information obtained from two or more separate and independent application programs.

### Claim 9 (depends on 1)

The method of claim 1, wherein the first discrete visual element further comprises user interface elements through which a user can directly perform one or more actions related to the first notification.

### Claim 10 (depends on 1)

The method of claim 1, further comprising the steps of: receiving user action directed to the first discrete visual element and, in response to the received user action, instantiating an application program associated with the first notification.

### Claim 11 (depends on 1)

The method of claim 1, wherein the second relevance is greater than a first relevance because a second notification was combined with the first notification into a single notification providing information that is based on information from both the first notification and the second notification.

### Claim 12

A graphical user interface, physically generated on a display device by a computing device, for notifying a user, the graphical user interface comprising:
a first discrete visual element comprising a first notification, the first discrete visual element visually appearing as if it is floating in a container of opaque liquid at a depth corresponding to a first relevance, associated with the first notification, and being observed by the user from above;
wherein the first discrete visual element moves within the user interface with at least one of: a translational motion and a rotational motion so as to further visually appearing as if it is floating in the opaque liquid; and
wherein further the first discrete visual element is graphically redrawn so as to: visually appear as if it is rising within the container of opaque liquid towards the user if the first relevance increases and visually appear as if it is sinking further away from the user within the container of opaque liquid if the first relevance decreases.

### Claim 13 (depends on 12)

The graphical user interface of claim 12, wherein the first discrete visual element comprises a graphically reduced clarity to simulate presence of an amount of the opaque liquid between the first discrete visual element and the user, the amount being inversely proportional to the first relevance; and wherein further the graphical redrawing of the first discrete visual element comprises graphically increasing the clarity to simulate a decreasing amount of the opaque liquid between the first discrete visual element and the user if the first relevance increases and graphically decreasing the clarity to simulate an increasing amount of the opaque liquid between the first discrete visual element and the user if the first relevance decreases.

### Claim 14 (depends on 12)

The graphical user interface of claim 12, wherein the first discrete visual element is a tile.

### Claim 15 (depends on 12)

The graphical user interface of claim 12, further comprising a second discrete visual element, differing from the first discrete visual element and comprising a second notification differing from the first notification, the second discrete visual element being generated to visually appear as if it is floating in the container of opaque liquid at a depth corresponding to a second relevance, associated with the second notification, and being observed by the user from above;
wherein the second discrete visual element moves within the user interface, independently of the movement of the first discrete visual element, with at least one of: the translational motion and the rotational motion so as to further visually appearing as if it is floating in the opaque liquid; and
wherein further the second discrete visual element is graphically redrawn, independently of the first discrete visual element, so as to: visually appear as if it is rising within the container of opaque liquid towards the user if the second relevance increases and visually appear as if it is sinking further away from the user within the container of opaque liquid if the second relevance decreases.

### Claim 16 (depends on 15)

The graphical user interface of claim 15, wherein a visual proximity of the second discrete visual element to the first discrete visual element is indicative of a relationship between the second notification and the first notification.

### Claim 17 (depends on 12)

The graphical user interface of claim 12, wherein the first discrete visual element further comprises user interface elements through which a user can directly perform one or more actions related to the first notification.

### Claim 18

One or more computer-readable media comprising computer-executable instructions for assigning a relevance to a notification, the computer-executable instructions directed to steps comprising:
obtaining a first notification and a first relevance associated with the first notification, the first notification being based on a first set of data originating from a first application program;
obtaining a second notification and a second relevance associated with the second notification, the second notification being based on a second set of data sourced from a second application program that is different and independent of the first application program;
determining whether the first set of data is associated with the second set of data;
generating a single combined notification incorporating both the first set of data and the second set of data if the first set of data is associated with the second set of data; and
generating a combined relevance of the combined notification, the combined relevance being greater than either the first relevance or the second relevance.

### Claim 19 (depends on 18)

The computer-readable media of claim 18, comprising further computer-executable instructions directed to steps comprising:
generating, on a hardware display device communicationally coupled to a computing device executing the computer-executable instructions, a graphical user interface comprising a discrete visual element comprising the single combined notification.

### Claim 20 (depends on 19)

The computer-readable media of claim 19, comprising further computer-executable instructions directed to steps comprising: invoking an operating system graphics library to graphically generate the discrete visual element so as to visually appear as if it is floating in a container of opaque liquid at a depth corresponding to the combined relevance and being observed from above by a user of the computing device.
