# US 2016/0260237 A1 · Extensions for modifying a graphical object to display data

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2016/0260237 A1
- Document ID: US20160260237A1
- Status: Published application
- Kind: A1
- Application number: 14/935,455
- Filed: 2015-11-09
- Published: 2016-09-08
- Earliest claimed: 2010-12-14
- Assignees: Microsoft Technology Licensing, LLC
- Applicants: Microsoft Technology Licensing, LLC
- Inventors: Vijay Mital; Darryl Ellis Rubin; Suraj T. Poozhiyil; Robert Anderson; Olivier Colle; John A. Payne; David G. Green; Jeremy William John Newton-Smith
- Web page: https://patentgrep.com/patent/US20160260237A1

## CPC

- G06T 11/60: Creating or editing images; Combining images with text
- G06F 3/0482: Interaction with lists of selectable items, e.g. menus
- G06F 3/04842: Selection of displayed objects or displayed text elements (G06F3/0482 takes precedence)
- G06F 3/04845: for image manipulation, e.g. dragging, rotation, expansion or change of colour
- G06T 11/26: Drawing of charts or graphs
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

A graphical manipulation tool to create and/or make modifications to a graphical object suitable for visually representing data. The graphical manipulation tool analyzes the graphical object to determine parameters of visual characteristics of the graphical object that can be used to visually represent data. A computing system, through the graphical manipulation tool, may generate metadata that defines a capacity for visual characteristics to represent data. In some cases, a preview is displayed on a user interface indicating to a user how the metadata, if incorporated with the graphical object, may result in the visual characteristics of the graphical object being used to visually represent data. If incorporating the metadata with the graphical object is desirable, the user may provide to include the additional metadata with the graphical object.

## Claims

### Claim 1

(canceled)

### Claim 2

A method of operating a computing device for processing graphical objects having at least one visual characteristic, the method comprising:
with at least one processor:
obtaining access to a data set;
analyzing, by a software tool, via the at least one processor, without user input to the analyzing by the software tool, the data set to determine one or more graphical objects that are suitable for visually representing the data set;
determining a plurality of dimensions of the data set to be displayed;
determining at least one of the graphical objects that have graphical object characteristics that are suitable for representing the determined dimensions of the data set;
determining one or more parameters of the at least one visual characteristic that can be varied to visually represent data with the at least one of the graphical objects; and
storing, in association with a representation of the at least one of the graphical objects, metadata that defines a capacity of the at least one visual characteristic to represent data.

### Claim 3 (depends on 2)

The method of claim 2, wherein:
the one or more parameters of the at least one visual characteristic comprises a parameter representing color; and
the metadata that defines the capacity of the at least one visual characteristic includes a number of colors representable by varying the parameter representing color.

### Claim 4 (depends on 2)

The method of claim 2, wherein:
the one or more parameters of the at least one visual characteristic comprises a parameter representing a size of an element; and
the metadata that defines the capacity of the at least one visual characteristic defines a range of sizes representable by varying the parameter representing the size of the element.

### Claim 5 (depends on 2)

The method of claim 2, wherein:
the one or more parameters of the at least one visual characteristic comprises a parameter representing a number of repetitions of an element in the graphical object; and
the metadata that defines the capacity of the at least one visual characteristic defines a maximum number of repetitions of the element representable in the graphical object.

### Claim 6 (depends on 5)

The method of claim 5, wherein the one or more parameters of the number of repetitions comprises a parameter representing a layout of an arrangement of the repetitions of the element.

### Claim 7 (depends on 2)

The method of claim 2, wherein:
the one or more parameters of the at least one visual characteristic comprises a parameter representing a number of sub-divisions of an element in the graphical object; and
the metadata that defines the capacity of the at least one visual characteristic defines a maximum number of sub-divisions of the element representable in the graphical object.

### Claim 8 (depends on 7)

The method of claim 7, wherein the one or more parameters of the number of sub-divisions comprises a parameter representing a layout of an arrangement of the sub-divisions of the element.

### Claim 9 (depends on 2)

The method of claim 2, wherein:
the one or more parameters of the at least one visual characteristic comprises a parameter representing an ability of an element for animation in the graphical object; and
the metadata that defines the capacity of the at least one visual characteristic includes at least one pattern of movement representable by varying the parameter representing the ability of an element for animation.

### Claim 10 (depends on 2)

The method of claim 2, wherein:
determining the at least one of the graphical objects that have graphical object characteristics that are suitable for representing the determined dimensions of the data set comprises statistical pattern matching.

### Claim 11 (depends on 2)

The method of claim 2, further comprising:
generating additional metadata representing an additional capacity of the at least one visual characteristic to represent data for incorporation with the at least one of the graphical objects.

### Claim 12 (depends on 11)

The method of claim 11, further comprising:
proposing the additional metadata representing an additional capacity of the at least one visual characteristic to represent data.

### Claim 13 (depends on 12)

The method of claim 12, wherein:
proposing the additional metadata representing an additional capacity of the at least one visual characteristic to represent data comprises displaying a preview presented on a user interface of the additional capacity of the at least one visual characteristic to represent data.

### Claim 14 (depends on 11)

The method of claim 11, wherein:
generating additional metadata representing an additional capacity of the at least one visual characteristic to represent data comprises receiving input through a user interface of the additional capacity of the at least one visual characteristic to represent data or automatically generating the additional metadata.

### Claim 15 (depends on 2)

The method of claim 2, wherein:
the at least one visual characteristic of the at least one of the graphical objects includes at least one of a color intensity, one or more segments, one or more layers, or one or more boundaries that map to a dimension of a data set.

### Claim 16

At least one hardware computer-readable computer storage medium comprising computer-executable instructions that, when executed by at least one processor, perform a method for processing graphical objects having visual characteristics for data visualization, the method comprising:
analyzing a data set to determine a graphical object that is suitable for visually representing the data set;
determining one or more parameters of a visual characteristic that can be varied to visually represent data with the graphical object, the determining including determining at least one of the one or more parameters without user input to the determining;
storing, in association with a representation of the graphical object, metadata that defines a capacity of the visual characteristic to represent data;
generating additional metadata representing an additional capacity of the visual characteristic to represent data for incorporation with the graphical object; and
receiving input to incorporate the additional metadata with the graphical object through a user interface.

### Claim 17 (depends on 16)

The computer-readable storage medium of claim 16, wherein:
the one or more parameters of the visual characteristic comprises a parameter representing color; and
the metadata that defines the capacity of the visual characteristic indicates a number of colors representable by varying the parameter representing color.

### Claim 18 (depends on 16)

The computer-readable storage medium of claim 16, wherein:
the one or more parameters of the visual characteristic comprises a parameter representing a size of an element; and
the metadata that defines the capacity of the visual characteristic defines a range of sizes representable by varying the parameter representing the size of the element.

### Claim 19 (depends on 16)

The computer-readable storage medium of claim 16, wherein:
the one or more parameters of the visual characteristic comprises a parameter representing a number of repetitions or sub-divisions of an element in the graphical object; and
the metadata that defines the capacity of the visual characteristic defines a maximum number of repetitions or sub-divisions of the element representable in the graphical object.

### Claim 20 (depends on 16)

The computer-readable storage medium of claim 16, wherein:
the one or more parameters of the visual characteristic comprises a parameter representing an animation ability of an element in the graphical object; and
the metadata that defines the capacity of the visual characteristic includes at least one pattern of movement representable by varying the parameter representing the animation ability of the element.

### Claim 21

At least one hardware computer-readable computer storage medium comprising computer-executable instructions that, when executed by at least one processor, perform a method for processing graphical objects having visual characteristics for data visualization, the method comprising:
analyzing, without user input, a data set to determine a graphical object that is suitable for visually representing the data set;
analyzing the graphical object to determine one or more parameters of the plurality of visual characteristics that can be varied to visually represent data with the graphical object, the analyzing to determine including analyzing the graphical object to determine at least one of the one or more parameters without user input to the analyzing to determine the at least one of the one or more parameters;
storing, in association with a representation of the graphical object, metadata defining a capacity of one or more of the plurality of visual characteristics to represent data;
generating additional metadata representing an additional capacity of the plurality of visual characteristics to represent data for incorporation with the graphical object;
displaying a preview of the additional metadata representing an additional capacity of the at least one visual characteristic to represent data on a user interface; and
receiving input to incorporate the additional metadata with the graphical object through the user interface.
