# US 2026/0099993 A1 · Generating shadows from a segmentation mask

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2026/0099993 A1
- Document ID: US20260099993A1
- Status: Published application
- Kind: A1
- Application number: 18/906,416
- Filed: 2024-10-04
- Published: 2026-04-09
- Earliest claimed: 2024-10-04
- Assignees: Capital One Services, LLC
- Applicants: Capital One Services, LLC
- Inventors: Deepak RAMAMOHAN; Rama Teja GAMPA
- Web page: https://patentgrep.com/patent/US20260099993A1

## CPC

- G06T 15/60: Shadow generation
- G06T 7/11: Region-based segmentation
- G06T 7/12: Edge-based segmentation
- G06T 7/194: involving foreground-background segmentation
- G06T 15/04: Texture mapping
- G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)}
- G06T 19/20: Editing of three-dimensional [3D] images, e.g. changing shapes or colours, aligning objects or positioning parts
- G06T 2207/20021: Dividing image into blocks, subimages or windows
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

Disclosed herein are system, method, and computer program product embodiments for generating realistic shadows for an image object, such as a vehicle, for computer browsing. The method includes generating a segmentation of an image object; generating a contour from the segmentation mask, wherein the contour comprises an array of the pixels along a boundary of the segmentation mask; calculating a plurality of regions of the contour, wherein each of the plurality of regions comprise a set of continuous points; identifying within the plurality of the regions of the contour, a plurality of key points that correspond to ground contact points of the image object; applying, based on the plurality of key points, a perspective warping to a first shadow template to generate the shadow for the image object, and rendering, on a selected background, the image segmentation as an overlay on the shadow.

## Claims

### Claim 1

A computer-implemented method to generate a shadow for an image object, the computer-implemented method comprising:
generating, from received imagery, a segmentation of the image object, wherein the segmentation is generated based on a segmentation mask comprising an array of contiguous pixels of the image object;
generating a contour from the segmentation mask, wherein the contour comprises an array of the pixels along a boundary of the segmentation mask;
calculating a plurality of regions of the contour, wherein each of the plurality of regions comprise a set of continuous points;
identifying within the plurality of the regions of the contour, a plurality of key points that correspond to ground contact points of the image object;
applying, based on the plurality of key points, a perspective warping to a first shadow template to generate the shadow for the image object; and
rendering, on a selected background, the image segmentation as an overlay on the shadow.

### Claim 2 (depends on 1)

The computer-implemented method of claim 1, further comprising removing a background of the received imagery.

### Claim 3 (depends on 1)

The computer-implemented method of claim 1, wherein the contour comprises at least a partially closed curve.

### Claim 4 (depends on 1)

The computer-implemented method of claim 1, further comprising applying a one-dimensional Gaussian smoothing to the contour.

### Claim 5 (depends on 4)

The computer-implemented method of claim 4, further comprising calculating a plurality of first derivatives along the contour.

### Claim 6 (depends on 5)

The computer-implemented method of claim 5, wherein the identifying the plurality of key points comprises calculating the plurality of first derivatives along the contour in a selected direction to identify instantaneous rates of change of the contour, and wherein each of the plurality of key points correspond to a pixel that corresponds to a lowest absolute value of a first y-derivative, where y is a coordinate in an x-y coordinate system of the received imagery.

### Claim 7 (depends on 6)

The computer-implemented method of claim 6, applying smoothing to the calculated plurality of first derivatives.

### Claim 8 (depends on 7)

The computer-implemented method of claim 7, wherein the identifying a plurality of regions further comprises applying filters on the first derivatives.

### Claim 9 (depends on 7)

The computer-implemented method of claim 7, wherein the identifying the plurality of key points further comprises calculating a plurality of second derivatives along the contour in the selected direction.

### Claim 10 (depends on 1)

The computer-implemented method of claim 1, wherein the image object is a vehicle and the plurality of key points correspond to a plurality of ground contact points of tires of the vehicle.

### Claim 11 (depends on 1)

The computer-implemented method of claim 1, further comprises estimating additional ones of the plurality of key points to assist in the perspective warping of the first shadow template.

### Claim 12

A system, comprising:
a memory; and
one or more processors configured to:
generate, from received imagery, a segmentation of an image object, wherein the segmentation is based on a segmentation mask comprising an array of contiguous pixels of the image object;
generate a contour from the segmentation mask, wherein the contour comprises an array of the pixels along a boundary of the segmentation mask;
calculate a plurality of regions of the contour, wherein each of the plurality of regions comprise a set of continuous points;
identify within the plurality of the regions of the contour, a plurality of key points that correspond to ground contact points of the image object;
apply, based on the plurality of key points, a perspective warping to a first shadow template to generate a second shadow for the image object; and
render, on a selected background, the image segmentation as an overlay on the second shadow.

### Claim 13 (depends on 12)

The system of claim 12, further configured to apply a one-dimensional Gaussian smoothing to the contour.

### Claim 14 (depends on 12)

The system of claim 12, further configured to calculate a plurality of first derivatives and second derivatives along the contour to identify the plurality of key points, wherein each of the plurality of key points correspond to a pixel that corresponds to a lowest absolute value of a first y-derivative, where y is a coordinate in an x-y coordinate system of the received imagery.

### Claim 15 (depends on 12)

The system of claim 12, wherein the image object is a vehicle and the plurality of key points correspond to a plurality of ground contact points of tires of the vehicle.

### Claim 16 (depends on 12)

The system of claim 12, further configured to estimate additional ones of the plurality of key points to assist in the perspective warping of the first shadow template.

### Claim 17

A non-transitory computer-readable device having instructions stored thereon that, when executed by at least one computing device, causes the at least one computing device to perform operations comprising:
generating, from received imagery, a segmentation of an image object, wherein the segmentation mask comprises an array of contiguous pixels of the image object;
generating a contour from the segmentation mask, wherein the contour comprises an array of the pixels along a boundary of the segmentation mask
calculating a plurality of regions of the contour, wherein each of the plurality of regions comprises a set of continuous points;
identifying within the plurality of the regions of the contour, a plurality of key points that correspond to ground contact points of the image object;
applying, based on the plurality of key points, a perspective warping to a first shadow template to generate second shadow for the image object; and
rendering, on a selected background, the image segmentation as an overlay on the second shadow.

### Claim 18 (depends on 17)

The non-transitory computer-readable device of claim 17, comprising further operations to calculate a plurality of first derivatives and second derivatives along the contour to identify the plurality of key points, wherein each of the plurality of key points correspond to a pixel that corresponds to a lowest absolute value of a first y-derivative, where y is a coordinate in an x-y coordinate system of the received imagery.

### Claim 19 (depends on 17)

The non-transitory computer-readable device of claim 17, wherein the image object is a vehicle and the plurality of key points correspond to a plurality of ground contact points of tires of the vehicle.

### Claim 20 (depends on 17)

The non-transitory computer-readable device of claim 17, comprising further operations to estimate additional ones of the plurality of key points to assist in the perspective warping of the first shadow template.
