# US 2025/0095158 A1 · Methods and Systems for Automatically Generating Backdrop Imagery for a Graphical User Interface

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0095158 A1
- Document ID: US20250095158A1
- Status: Published application
- Kind: A1
- Application number: 18/965,230
- Filed: 2024-12-02
- Published: 2025-03-20
- Earliest claimed: 2021-08-31
- Assignees: Gracenote, Inc.
- Applicants: Gracenote, Inc.
- Inventors: Aneesh Vartakavi; Jeffrey Scott
- Web page: https://patentgrep.com/patent/US20250095158A1

## CPC

- G06F 3/0481: based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
- G06T 7/13: Edge detection
- G06T 3/403: Edge-driven scaling; Edge-based scaling
- G06T 7/11: Region-based segmentation
- G06T 7/149: involving deformable models, e.g. active contour models
- G06V 10/25: Determination of region of interest [ROI] or a volume of interest [VOI]
- G06V 10/44: Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components
- G06V 10/945: {User interactive design; Environments; Toolboxes}
- G06V 40/161: {Detection; Localisation; Normalisation}
- G06T 2207/20132: Image cropping
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

In one aspect, an example method for generating a candidate image for use as backdrop imagery for a graphical user interface is disclosed. The method includes receiving a raw image and determining an edge image from the raw image using edge detection. The method also includes identifying a candidate region of interest (ROI) in the raw image based on the candidate ROI enclosing a portion of the edge image having edge densities exceeding a threshold edge density. The method also includes manipulating the raw image relative to a backdrop imagery canvas for a graphical user interface based on a location of the candidate ROI within the raw image. The method also includes generating, based on the manipulating, a set of candidate backdrop images in which at least a portion of the candidate ROI occupies a preselected area of the backdrop imagery canvas, and storing the set of candidate backdrop images.

## Claims

### Claim 1

A tangible, non-transitory computer-readable medium having stored thereon program instructions that, upon execution by the one or more processors, cause a computing system to perform a set of operations comprising:
training, by the computing system, a machine learning region of interest (ROI) program to identify a candidate ROI in a raw image, wherein the machine learning ROI program is configured to predict ROI characteristics for the raw image based on expected ROI characteristics represented in a set of training images;
identifying, by the computing system, using the machine learning ROI program, the candidate ROI in the raw image;
manipulating, by the computing system, the raw image relative to a backdrop imagery canvas based on a location of the candidate ROI within the raw image; and
generating, by the computing system, a set of candidate backdrop images in which at least a portion of the candidate ROI occupies a preselected area of the backdrop imagery canvas.

### Claim 2 (depends on 1)

The tangible, non-transitory computer-readable medium of claim 1, wherein the ROI characteristics for the raw image comprise cropping characteristics, wherein cropping characteristics are at least one of cropping boundaries, or image size.

### Claim 3 (depends on 1)

The tangible, non-transitory computer-readable medium of claim 1, wherein manipulating the raw image relative to the backdrop imagery canvas based on the location of the candidate ROI within the raw image further comprises manipulating the raw image relative to the backdrop imagery canvas based on a vertical midline of the backdrop imagery canvas.

### Claim 4 (depends on 3)

The tangible, non-transitory computer-readable medium of claim 3, wherein manipulating the raw image relative to the backdrop imagery canvas based on the location of the candidate ROI within the raw image further comprises scaling the raw image.

### Claim 5 (depends on 3)

The tangible, non-transitory computer-readable medium of claim 3, wherein manipulating the raw image relative to the backdrop imagery canvas based on the location of the candidate ROI within the raw image further comprises cropping the raw image.

### Claim 6 (depends on 1)

The tangible, non-transitory computer-readable medium of claim 1, wherein manipulating the raw image relative to the backdrop imagery canvas based on the location of the candidate ROI within the raw image comprises performing a manipulation action to cause the at least a portion of the candidate ROI to occupy the preselected area of the backdrop imagery canvas, and wherein the manipulation action is at least one of shifting the raw image, cropping the raw image, or scaling the raw image.

### Claim 7 (depends on 1)

The tangible, non-transitory computer-readable medium of claim 1, wherein the set of operations further comprises identifying, by the computing system, a location of at least one face in the raw image.

### Claim 8 (depends on 7)

The tangible, non-transitory computer-readable medium of claim 7, wherein identifying the location of at least one face in the raw image comprises identifying, by the computing system, using the machine learning ROI program, the location of at least one face in the raw image.

### Claim 9 (depends on 1)

The tangible, non-transitory computer-readable medium of claim 1, wherein the set of operations further comprises storing, by the computing system, in the tangible, non-transitory computer-readable medium, the set of candidate backdrop images.

### Claim 10

A computing device comprising:
one or more processors; and
a tangible, non-transitory computer-readable medium having stored thereon program instructions that, upon execution by the one or more processors, cause the computing device to perform a set of operations comprising:
training a machine learning region of interest (ROI) program to identify a candidate ROI in a raw image, wherein the machine learning ROI program is configured to predict ROI characteristics for the raw image based on expected ROI characteristics represented in a set of training images;
identifying, using the machine learning ROI program, the candidate ROI in the raw image;
manipulating the raw image relative to a backdrop imagery canvas based on a location of the candidate ROI within the raw image; and
generating a set of candidate backdrop images in which at least a portion of the candidate ROI occupies a preselected area of the backdrop imagery canvas.

### Claim 11 (depends on 10)

The computing device of claim 10, wherein the ROI characteristics for the raw image comprise cropping characteristics, wherein cropping characteristics are at least one of cropping boundaries, or image size.

### Claim 12 (depends on 10)

The computing device of claim 10, wherein manipulating the raw image relative to the backdrop imagery canvas based on the location of the candidate ROI within the raw image further comprises manipulating the raw image relative to the backdrop imagery canvas based on a vertical midline of the backdrop imagery canvas.

### Claim 13 (depends on 12)

The computing device of claim 12, wherein manipulating the raw image relative to the backdrop imagery canvas based on the location of the candidate ROI within the raw image further comprises scaling the raw image.

### Claim 14 (depends on 12)

The computing device of claim 12, wherein manipulating the raw image relative to the backdrop imagery canvas based on the location of the candidate ROI within the raw image further comprises cropping the raw image.

### Claim 15 (depends on 10)

The computing device of claim 10, wherein manipulating the raw image relative to the backdrop imagery canvas based on the location of the candidate ROI within the raw image comprises performing a manipulation action to cause the at least a portion of the candidate ROI to occupy the preselected area of the backdrop imagery canvas, and wherein the manipulation action is at least one of shifting the raw image, cropping the raw image, or scaling the raw image.

### Claim 16 (depends on 10)

The computing device of claim 10, wherein the set of operations further comprises identifying a location of at least one face in the raw image.

### Claim 17 (depends on 16)

The computing device of claim 16, wherein identifying the location of at least one face in the raw image comprises identifying, using the machine learning ROI program, the location of at least one face in the raw image.

### Claim 18 (depends on 10)

The computing device of claim 10, wherein the set of operations further comprises storing the set of candidate backdrop images.

### Claim 19

A computer-implemented method comprising:
training a machine learning region of interest (ROI) program to identify a candidate ROI in a raw image, wherein the machine learning ROI program is configured to predict ROI characteristics for the raw image based on expected ROI characteristics represented in a set of training images;
identifying, using the machine learning ROI program, the candidate ROI in the raw image;
manipulating the raw image relative to a backdrop imagery canvas based on a location of the candidate ROI within the raw image; and
generating a set of candidate backdrop images in which at least a portion of the candidate ROI occupies a preselected area of the backdrop imagery canvas.

### Claim 20 (depends on 19)

The computer-implemented method of claim 19, wherein the ROI characteristics for the raw image comprise cropping characteristics, wherein cropping characteristics are at least one of cropping boundaries, or image size.
