# US 2026/0227895 A1 · Generating controls for modifying visual content in computing systems based on generative models

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2026/0227895 A1
- Document ID: US20260227895A1
- Status: Published application
- Kind: A1
- Application number: 19/043,328
- Filed: 2025-01-31
- Published: 2026-08-06
- Earliest claimed: 2025-01-31
- Assignees: Figma, Inc.
- Applicants: Figma, Inc.
- Inventors: Rocky CHEN; Michael Edward BULLINGTON
- Web page: https://patentgrep.com/patent/US20260227895A1

## CPC

- G06F 3/04847: Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
- G09G 5/37: Details of the operation on graphic patterns (G09G5/38 takes precedence)
- G06F 3/0481: based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
- G06F 3/0482: Interaction with lists of selectable items, e.g. menus
- G06F 3/04842: Selection of displayed objects or displayed text elements (G06F3/0482 takes precedence)
- G06F 3/04845: for image manipulation, e.g. dragging, rotation, expansion or change of colour
- G06F 3/0485: Scrolling or panning
- G06F 3/14: Digital output to display device {; Cooperation and interconnection of the display device with other functional units}
- G06T 11/60: Creating or editing images; Combining images with text
- G09G 5/14: Display of multiple viewports
- G06F 40/40: Processing or translation of natural language (natural language analysis G06F40/20; semantic analysis G06F40/30)
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

Embodiments of the present disclosure provide techniques for refining visual assets using generative artificial intelligence models. An example method generally includes receiving an indication of a visual asset for modification and an input natural language prompt specifying a design objective to be applied to the indicated visual asset. Visual components in the indicated visual asset and properties of the identified visual components to be modified are identified based on the specified design objective. One or more control panels are populated with one or more controls for modifying the identified visual components to achieve the specified design objective. An input is received in at least one of the one or more control panels, and the indicated visual asset is modified based on the received input.

## Claims

### Claim 1

A processor-implemented method, comprising:
receiving an indication of a visual asset for modification and an input natural language prompt specifying a design objective to be applied to the indicated visual asset;
identifying visual components in the indicated visual asset and properties of the identified visual components to be modified based on the specified design objective;
populating one or more control panels with one or more controls for modifying the identified visual components to achieve the specified design objective;
receiving an input in at least one of the one or more control panels; and
modifying the indicated visual asset based on the received input.

### Claim 2 (depends on 1)

The method of claim 1, wherein the input comprises a slider input associated with a design property of the visual asset.

### Claim 3 (depends on 2)

The method of claim 2, wherein an adjustment to the slider input applies a global modification to the identified visual components.

### Claim 4 (depends on 2)

The method of claim 2, wherein the slider input is displayed in a first control panel, and wherein an adjustment to the slider input modifies one or more of the properties of the identified visual components displayed in a second control panel.

### Claim 5 (depends on 2)

The method of claim 2, wherein a range associated with the slider input comprises a minimum value associated with a first set of values for the identified properties of the identified visual components and a maximum value associated with a second set of values for the identified properties of the identified visual components, and wherein the first set of values and the second set of values are identified based on the specified design objective.

### Claim 6 (depends on 1)

The method of claim 1, wherein the input comprises an adjustment to a property of the identified properties associated with one visual component of the identified visual components.

### Claim 7 (depends on 1)

The method of claim 1, wherein a range of valid values for the identified properties of the identified visual components is associated with a defined amount of modification to apply to the visual asset.

### Claim 8 (depends on 1)

The method of claim 1, wherein a range of valid values for the identified properties of the identified visual components is defined relative to another visual component in a user interface.

### Claim 9

A processing system, comprising:
at least one memory having executable instructions stored thereon; and
one or more processors configured to execute the executable instructions to cause the processing system to:
receive an indication of a visual asset for modification and an input natural language prompt specifying a design objective to be applied to the indicated visual asset;
identify visual components in the indicated visual asset and properties of the identified visual components to be modified based on the specified design objective;
populate one or more control panels with one or more controls for modifying the identified visual components to achieve the specified design objective;
receive an input in at least one of the one or more control panels; and
modify the indicated visual asset based on the received input.

### Claim 10 (depends on 9)

The processing system of claim 9, wherein the input comprises a slider input associated with a design property of the visual asset.

### Claim 11 (depends on 10)

The processing system of claim 10, wherein an adjustment to the slider input applies a global modification to the identified visual components.

### Claim 12 (depends on 10)

The processing system of claim 10, wherein the slider input is displayed in a first control panel, and wherein an adjustment to the slider input modifies one or more of the properties of the identified visual components displayed in a second control panel.

### Claim 13 (depends on 10)

The processing system of claim 10, wherein a range associated with the slider input comprises a minimum value associated with a first set of values for the identified properties of the identified visual components and a maximum value associated with a second set of values for the identified properties of the identified visual components, and wherein the first set of values and the second set of values are identified based on the specified design objective.

### Claim 14 (depends on 9)

The processing system of claim 9, wherein the input comprises an adjustment to a property of the identified properties associated with one visual component of the identified visual components.

### Claim 15 (depends on 9)

The processing system of claim 9, wherein a range of valid values for the identified properties of the identified visual components is associated with a defined amount of modification to apply to the visual asset.

### Claim 16 (depends on 9)

The processing system of claim 9, wherein a range of valid values for the identified properties of the identified visual components is defined relative to another visual component in a user interface.

### Claim 17

A computer-readable medium having executable instructions stored thereon which, when executed by one or more processors, performs an operation comprising:
receiving an indication of a visual asset for modification and an input natural language prompt specifying a design objective to be applied to the indicated visual asset;
identifying visual components in the indicated visual asset and properties of the identified visual components to be modified based on the specified design objective;
populating one or more control panels with one or more controls for modifying the identified visual components to achieve the specified design objective;
receiving an input in at least one of the one or more control panels; and
modifying the indicated visual asset based on the received input.
