# US 2020/0394773 A1 · Utilizing context-aware sensors and multi-dimensional gesture inputs to efficiently generate enhanced digital images

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2020/0394773 A1
- Document ID: US20200394773A1
- Status: Published application
- Kind: A1
- Application number: 16/440,471
- Filed: 2019-06-13
- Published: 2020-12-17
- Earliest claimed: 2019-06-13
- Assignees: Adobe Inc.
- Applicants: Adobe Inc.
- Inventors: Gregg Wilensky; Mark Nichoson; Edward Wright
- Web page: https://patentgrep.com/patent/US20200394773A1

## CPC

- G06T 5/94: based on local image properties, e.g. for local contrast enhancement
- G06F 3/0484: for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
- G06F 3/04845: for image manipulation, e.g. dragging, rotation, expansion or change of colour
- G06F 3/04847: Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
- G06F 3/04883: for inputting data by handwriting, e.g. gesture or text
- G06T 5/50: using two or more images, e.g. averaging or subtraction
- G06T 5/92: based on global image properties
- G06T 11/10: Texturing; Colouring; Generation of textures or colours (retouching, inpainting or scratch removal G06T5/77)
- G06T 11/60: Creating or editing images; Combining images with text
- H04M 1/72403: with means for local support of applications that increase the functionality
- G06F 2203/04808: Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen
- G06T 2200/24: involving graphical user interfaces [GUIs]
- G06T 2207/10024: Color image
- G06T 2207/20101: Interactive definition of point of interest, landmark or seed
- G06T 2207/20104: Interactive definition of region of interest [ROI]
- G06T 2207/20172: Image enhancement details
- H04M 1/72454: according to context-related or environment-related conditions
- H04M 2250/22: including a touch pad, a touch sensor or a touch detector
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- H04M: TELEPHONIC COMMUNICATION (circuits for controlling other apparatus via a telephone cable and not involving telephone switching apparatus G08)

## Abstract

The present disclosure relates to systems, methods, and non-transitory computer readable media that utilize context-aware sensors and multi-dimensional gesture inputs across a digital image to generate enhanced digital images. In particular, the disclosed systems can provide a dynamic sensor over a digital image within a digital enhancement user interface (e.g., a user interface without visual elements for modifying parameter values). In response to selection of a sensor location, the disclosed systems can determine one or more digital image features at the sensor location. Based on these features, the disclosed systems can select and map parameters to movement directions. Moreover, the disclosed systems can identify a user input gesture comprising movements in one or more directions across the digital image. Based on the movements and the one or more features at the sensor location, the disclosed systems can modify parameter values and generate an enhanced digital image.

## Claims

### Claim 1

A non-transitory computer-readable medium storing instructions thereon that, when executed by at least one processor, cause a computing device to:
identify a user selection of a first location of a digital image within a digital image enhancement user interface;
identify one or more features of the digital image at the first location;
detect a user input gesture across the digital image comprising a first movement in a first direction and a second movement in a second direction;
determine a first modification of a first parameter of the digital image to perform based on the first movement in the first direction and the one or more features of the digital image at the first location, wherein the first parameter is selected based on the one or more features of the digital image at the first location;
determine a second modification of a second parameter of the digital image to perform based on the second movement in the second direction and the one or more features of the digital image at the first location, wherein the second parameter is selected based on the one or more features of the digital image at the first location; and
generate an enhanced digital image by making the first modification to the first parameter and the second modification to the second parameter.

### Claim 2 (depends on 1)

The non-transitory computer-readable medium as recited in claim 1, wherein the digital image enhancement user interface does not include a visual element for modifying parameter values of the first parameter or parameter values of the second parameter.

### Claim 3 (depends on 1)

The non-transitory computer-readable medium as recited in claim 1, further storing instructions thereon that, when executed by the at least one processor, cause the computing device to identify the one or more features of the digital image at the first location
providing a transparent sensor for display at the first location based on the user selection of the first location within the digital image enhancement user interface; and
identifying the one or more features by analyzing a region of the digital image encompassed by the transparent sensor.

### Claim 4 (depends on 1)

The non-transitory computer-readable medium as recited in claim 1, further storing instructions thereon that, when executed by the at least one processor, cause the computing device to:
detect the one or more features of the digital image at the first location by detecting a saturation of the digital image at the first location;
determine the first modification of the first parameter of the digital image at the first location based on the first movement in the first direction and the saturation of the digital image at the first location; and
determine the second modification of the second parameter of the digital image at the first location based on the second movement in the second direction and the saturation of the digital image at the first location.

### Claim 5 (depends on 1)

The non-transitory computer-readable medium as recited in claim 1, further storing instructions thereon that, when executed by the at least one processor, cause the computing device to:
detect the one or more features of the digital image at the first location by detecting a hue of the digital image at the first location;
determine the first modification of the first parameter of the digital image at the first location based on the first movement in the first direction and the hue of the digital image at the first location; and
determine the second modification of the second parameter of the digital image at the first location based on the second movement in the second direction and the hue of the digital image at the first location.

### Claim 6 (depends on 5)

The non-transitory computer-readable medium as recited in claim 5, wherein the first parameter and the second parameter comprise at least two of: hue, saturation, brightness, contrast, exposure, shadow, highlight, black point, white point, vibrance, clarity, color temperature, or color tint.

### Claim 7 (depends on 1)

The non-transitory computer-readable medium as recited in claim 1, further storing instructions thereon that, when executed by the at least one processor, cause the computing device to:
detect the one or more features of the digital image at the first location by detecting an object portrayed in the digital image at the first location;
determine the first modification of the first parameter of the digital image at the first location based on the first movement in the first direction and the object portrayed in the digital image at the first location; and
determine the second modification of the second parameter of the digital image at the first location based on the second movement in the second direction and the object portrayed in the digital image at the first location.

### Claim 8 (depends on 1)

The non-transitory computer-readable medium as recited in claim 1, further storing instructions thereon that, when executed by the at least one processor, cause the computing device to:
detect an additional user input gesture associated with the enhanced digital image; and
in response to the additional user input gesture, transition from displaying the enhanced digital image to displaying the digital image within the digital image enhancement user interface for a duration of the additional user input gesture.

### Claim 9 (depends on 1)

The non-transitory computer-readable medium as recited in claim 1, further storing instructions thereon that, when executed by the at least one processor, cause the computing device to:
determine the first parameter of the digital image and the second parameter of the digital image based on a first input mode; and
in response to detecting a mode selection user input, modify the first input mode to a second input mode corresponding to a third parameter and a fourth parameter.

### Claim 10 (depends on 9)

The non-transitory computer-readable medium as recited in claim 9, further storing instructions thereon that, when executed by the at least one processor, cause the computing device to:
identify a second user selection of a second location of the enhanced digital image within the digital image enhancement user interface;
detect a second user input gesture comprising a third movement in a third direction and a fourth movement in a fourth direction;
determine a third modification of the third parameter of the enhanced digital image based on the third movement in the third direction and the second input mode;
determine a fourth modification of the fourth parameter of the enhanced digital image based on the fourth movement in the fourth direction and the second input mode; and
generate an updated enhanced digital image by making the third modification of the third parameter and the fourth modification of the fourth parameter.

### Claim 11

A system comprising:
at least one processor; and
at least one non-transitory computer-readable medium storing instructions that, when executed by the at least one processor, cause the system to:
identify one or more features of a digital image at a first location based on a user selection of the first location within a digital image enhancement user interface;
select a parameter of the digital image to modify from a plurality of parameters based on the one or more features of the digital image identified at the first location;
detect a user input gesture comprising a movement to a second location of the digital image within the digital image enhancement user interface;
determine a modification of the parameter of the digital image based on the movement to the second location and the one or more features of the digital image at the first location; and
generate an enhanced digital image by making the modification of the parameter.

### Claim 12 (depends on 11)

The system as recited in claim 11, further comprising instructions that, when executed by the at least one processor, cause the system to identify the one or more features of the digital image at the first location by:
providing a transparent sensor for display at the first location based on the user selection of the first location within the digital image enhancement user interface; and
identifying the one or more features by analyzing a region of the digital image encompassed by the transparent sensor.

### Claim 13 (depends on 12)

The system as recited in claim 12, further storing instructions that, when executed by the at least one processor, cause the system to identify the one or more features of the digital image at the first location by identifying one or more of brightness at the first location, hue at the first location, or an object at the first location.

### Claim 14 (depends on 11)

The system as recited in claim 11, further storing instructions that, when executed by the at least one processor, cause the system to determine the modification of the parameter of the digital image based on the movement to the second location and the one or more features of the digital image at the first location by
identifying a parameter value of the parameter based on the second location within the user interface.

### Claim 15 (depends on 14)

The system as recited in claim 14, further storing instructions that, when executed by the at least one processor, cause the system to determine the parameter value of the parameter based on the second location based on at least one of:
a relative displacement between the second location and an initial location of the user input gesture; or
a mapping between an absolute position of the second location within the digital image enhancement user interface and the parameter value.

### Claim 16 (depends on 15)

The system as recited in claim 15, further storing instructions that, when executed by the at least one processor, cause the system to:
determine a vertical movement and a horizontal movement from the user input gesture comprising the movement to the second location;
determine the modification of the parameter of the digital image based on the vertical movement and the one or more features of the digital image at the first location;
determine an additional modification of an additional parameter of the digital image based on the horizontal movement and the one or more features of the digital image at the first location; and
generate the enhanced digital image by making the modification of the parameter and the additional modification of the additional parameter.

### Claim 17

A computer-implemented method of efficiently generating modified digital images comprising:
identifying, within a digital image enhancement user interface, one or more features of a digital image at a first location based on a user selection of the first location;
receiving a user input gesture comprising a two-direction movement across the digital image within the digital image enhancement user interface;
a step for generating an enhanced digital image utilizing the two-direction movement and the one or more features; and
providing the enhanced digital image for display.

### Claim 18 (depends on 17)

The computer-implemented method as recited in claim 17, wherein the digital image enhancement user interface contains no visual slider elements.

### Claim 19 (depends on 17)

The computer-implemented method as recited in claim 17, wherein the one or more features comprise at least one of: a hue at the first location or an object at the first location.

### Claim 20 (depends on 17)

The computer-implemented method as recited in claim 17, wherein:
the user input gesture comprising the two-direction movement across the digital image comprises a first movement in a first direction corresponding to a first modification and a second movement in a second direction corresponding to a second modification; and
the enhanced digital image reflects the first modification and the second modification.
