# US 2021/0241499 A1 · Smart painting tools

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0241499 A1
- Document ID: US20210241499A1
- Status: Published application
- Kind: A1
- Application number: 16/781,623
- Filed: 2020-02-04
- Published: 2021-08-05
- Earliest claimed: 2020-02-04
- Assignees: Adobe Inc.
- Applicants: Adobe Inc..
- Inventors: Rishu Aggarwal; Ajay Bedi
- Web page: https://patentgrep.com/patent/US20210241499A1

## CPC

- G06T 11/10: Texturing; Colouring; Generation of textures or colours (retouching, inpainting or scratch removal G06T5/77)
- G06T 7/13: Edge detection
- G06T 7/136: involving thresholding
- G06T 2200/24: involving graphical user interfaces [GUIs]
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

A method of automatically computing tool properties of a virtual paint brush includes obtaining an edge map from a digital image, wherein boundaries of objects in the image are detected, computing contours for the edge map, receiving a brush stroke of the virtual paint brush from a user at a point on a contour, and finding an object boundary that corresponds to the contour that received the brush stroke, computing a tangential slope of the object boundary at the point of the brush stroke, adjusting tool properties of the virtual paint brush based on a change in the tangential slope of the object boundary, and visually displaying the adjusted tool properties dynamically while the user is moving brush strokes around the object boundaries.

## Claims

### Claim 1

A method of automatically computing tool properties of a virtual paint brush, the method comprising:
obtaining an edge map from a digital image, wherein boundaries of objects in the image are detected;
computing contours for the edge map;
receiving a brush stroke of the virtual paint brush from a user at a point on a contour, and finding an object boundary that corresponds to the contour that received the brush stroke;
computing a tangential slope of the object boundary at the point of the brush stroke;
adjusting tool properties of the virtual paint brush based on a change in the tangential slope of the object boundary; and
visually displaying the adjusted tool properties dynamically while the user is moving brush strokes around the object boundaries.

### Claim 2 (depends on 1)

The method of claim 1, wherein the edge map is obtained from the digital image by using a Canny edge detector, and by performing adaptive hysteresis localization and thresholding on the digital image.

### Claim 3 (depends on 1)

The method of claim 1, wherein the contours include nested contours.

### Claim 4 (depends on 1)

The method of claim 1, wherein finding the object boundary of the contour that received the brush stroke comprises scanning a surrounding region and marking a point nearest to the contour that received the brush stroke as a base region.

### Claim 5 (depends on 1)

The method of claim 1, further comprising receiving additional brush strokes of the virtual paint brush, and computing the tangential slope at those points that received the additional brush strokes.

### Claim 6 (depends on 1)

The method of claim 1, further comprising tracking a user's stroke pattern from a previous painting direction of the user and automatically mapping the user's stroke pattern with a closest matching contour when multiple contours are nested within an object.

### Claim 7 (depends on 1)

The method of claim 1, further comprising recomputing the tangential slope of the object boundary at the point of the brush stroke, when a user manually resets a tip rotation angle of the virtual paint brush.

### Claim 8 (depends on 1)

The method of claim 1, wherein adjusting tool properties of the virtual paint brush includes adjusting a brush tip size and adjusting a brush tip rotation angle.

### Claim 9 (depends on 8)

The method of claim 8, wherein adjusting the brush tip size comprises:
finding a maximum enclosing rectangle at a point when the user has performed a mouse down event, wherein the maximum enclosing rectangle is that which can fit object boundaries that surround the point, wherein dimensions of the maximum enclosing rectangle are in a same aspect ratio as a preset pattern chosen by the user; and
setting a pattern mask inside the maximum enclosing rectangle, wherein a size of the maximum enclosing rectangle is adjusted by a predetermined number of pixels when the pattern mask extends beyond an object boundary.

### Claim 10 (depends on 8)

The method of claim 8, wherein adjusting the brush tip rotation angle comprises computing a difference of a current tangential slope with respect to a previous tangential slope, and rotating a brush tip by an amount that corresponds to the difference as the difference is computed.

### Claim 11

A system for automatically computing tool properties of a virtual paint brush, comprising:
a platform that includes hardware and software resources that connects over a network to at least one computing device remote from the platform,
wherein the platform is configured to:
receive a brush stroke of the virtual paint brush at a point on a digital image from the network;
find an object boundary in the digital image that corresponds to the point of the brush stroke by marking the point that received the brush stroke as a base region and scanning a region that surrounds the base region;
compute a tangential slope of the object boundary at the point of the brush stroke;
adjust tool properties of the virtual paint brush based on a change of the tangential slope of the object boundary;
transmit data representing the digital image and the adjusted tool properties of the virtual paint brush over the network to the at least one computing device; and
repeat said steps of computing a tangential slope and adjusting tool properties when a new brush stroke of the virtual paint brush is received from the network.

### Claim 12 (depends on 11)

The system of claim 11, wherein the platform is further configured to obtain an edge map from the digital image, wherein boundaries of objects in the image are detected, and to compute contours for the edge map, wherein the contours connect points in the edge map with a same intensity value, and wherein the brush stroke of the virtual paint brush is received at a point on a contour.

### Claim 13 (depends on 12)

The system of claim 12, wherein when a brush stroke is received between contours, the platform is further configured to select a contour nearest to the brush stroke as the contour that received the brush stroke.

### Claim 14 (depends on 11)

The system of claim 11, wherein the platform is further configured to visually display on an output interface of one of the at least one computing device the adjusted tool properties dynamically while a user of the one of the at least one computing device is moving brush strokes around the object boundary.

### Claim 15 (depends on 11)

The system of claim 11, wherein tool properties of the virtual paint brush that are being adjusted include a brush tip size and a brush tip rotation angle.

### Claim 16 (depends on 15)

The system of claim 15, wherein adjusting the brush tip size comprises:
finding a maximum enclosing rectangle at a point when a user has performed a mouse down event, wherein the maximum enclosing rectangle is that which can fit object boundaries that surround the point, wherein dimensions of the maximum enclosing rectangle are in a same aspect ratio as a preset pattern chosen by the user; and
setting a pattern mask inside the maximum enclosing rectangle, wherein a size of the maximum enclosing rectangle is adjusted by a predetermined number of pixels when the pattern mask extends beyond an object boundary.

### Claim 17 (depends on 15)

The system of claim 15, wherein adjusting the brush tip rotation angle comprises computing a difference of a current tangential slope with respect to a previous tangential slope, and rotating a brush tip by an amount that corresponds to the difference as the difference is computed.

### Claim 18

A method of automatically computing tool properties of a virtual paint brush, the method comprising:
receiving a brush stroke of the virtual paint brush from a user at a point, and finding an object boundary that corresponds to the point of the brush stroke;
computing a tangential slope of the object boundary at the point of the brush stroke; and
computing tool properties of the virtual paint brush based on changes in the object boundaries, wherein tool properties of the virtual paint brush include a brush tip size and a brush tip rotation angle,
wherein automatically computing the brush tip size comprises finding a maximum enclosing rectangle at a point when the user has performed a mouse down event, wherein the maximum enclosing rectangle is that which can fit object boundaries that surround the point, wherein dimensions of the maximum enclosing rectangle are in a same aspect ratio as a preset pattern chosen by the user, wherein a size of the maximum enclosing rectangle is adjusted by a predetermined number of pixels when the pattern mask extends beyond an object boundary, and
wherein automatically computing the brush tip rotation angle comprises computing a difference of a current tangential slope with respect to a previous tangential slope, and rotating a brush tip as the difference is computed by an amount that corresponds to the difference.

### Claim 19 (depends on 18)

The method of claim 18, further comprising:
is obtaining an edge map from a digital image, wherein the object boundaries of objects in the image are detected; and
computing contours for the edge map,
wherein the brush stroke of the user is received at a point on a contour.

### Claim 20 (depends on 18)

The method of claim 18, further comprising visually displaying the adjusted tool properties dynamically while the user is moving brush strokes around the object boundaries.
