# US 2024/0005533 A1 · Computer Vision Systems and Methods for Unsupervised Learning for Progressively Aligning Noisy Contours

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2024/0005533 A1
- Document ID: US20240005533A1
- Status: Published application
- Kind: A1
- Application number: 18/124,548
- Filed: 2023-03-21
- Published: 2024-01-04
- Earliest claimed: 2019-11-25
- Assignees: Insurance Services Office, Inc.
- Applicants: Insurance Services Office, Inc.
- Inventors: Venkata Subbarao Veeravasarapu; Abhishek Goel; Deepak Mittal; Maneesh Kumar Singh
- Web page: https://patentgrep.com/patent/US20240005533A1

## CPC

- G06T 7/337: {involving reference images or patches}
- G06N 3/045: Combinations of networks
- G06N 3/0464: Convolutional networks [CNN, ConvNet]
- G06N 3/084: Backpropagation, e.g. using gradient descent
- G06N 3/088: Non-supervised learning, e.g. competitive learning
- G06N 3/0895: Weakly supervised learning, e.g. semi-supervised or self-supervised learning
- G06T 3/18: Image warping, e.g. rearranging pixels individually
- G06T 7/30: Determination of transform parameters for the alignment of images, i.e. image registration
- G06N 3/048: Activation functions
- G06T 2207/20016: Hierarchical, coarse-to-fine, multiscale or multiresolution image processing; Pyramid transform
- G06T 2207/20081: Training; Learning
- G06T 2207/20084: Artificial neural networks [ANN]
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS

## Abstract

Computer vision systems and methods for noisy contour alignment are provided. The system generates a loss function and trains a convolutional neural network with the loss function and a plurality of images of a dataset to learn to align contours with progressively increasing complex forward and backward transforms over increasing scales. The system can align an attribute of an image of the dataset by the trained neural network.

## Claims

### Claim 1

A computer vision system for performing noisy contour alignment comprising:
a memory; and
a processor in communication with the memory, the processor:
generating a loss function;
training a neural network to learn to align contours using the loss function and a plurality of images; and
aligning an attribute of an image using the trained neural network.

### Claim 2 (depends on 1)

The system of claim 1, wherein the processor determines an upper bound of the loss function.

### Claim 3 (depends on 1)

The system of claim 1, wherein the loss function is a local shape-dependent Chamfer upper bound loss function that measures proximity and local shape similarity while being robust towards noise and partial occlusions.

### Claim 4 (depends on 1)

The system of claim 1, wherein the processor trains the neural network by:
extracting features of a source and target image pair of the dataset at different scales,
utilizing warp predictors to determine forward transforms to align source to target features at each scale, and
applying the loss function to determine backward transforms to align target to source features at each scale.

### Claim 5 (depends on 1)

The system of claim 1, wherein the neural network is a convolutional neural network.

### Claim 6 (depends on 1)

The system of claim 1, wherein the dataset is a Modified National Institute of Standards and Technology (MNIST) digit image dataset or a geo-parcel to aerial image alignment dataset.

### Claim 7 (depends on 1)

The system of claim 1, where the processor aligns a noisy digit contour present in the image or a parcel present in the image.

### Claim 8

A method for performing noisy contour alignment by a computer vision system, comprising the steps of:
generating a loss function;
training a neural network to learn to align contours using the loss function and a plurality of images; and
aligning an attribute of an image using the trained neural network.

### Claim 9 (depends on 8)

The method of claim 8, further comprising the step of determining an upper bound of the loss function.

### Claim 10 (depends on 8)

The method of claim 8, wherein the loss function is a local shape-dependent Chamfer upper bound loss function that measures proximity and local shape similarity while being robust towards noise and partial occlusions.

### Claim 11 (depends on 8)

The method of claim 8, further comprising the steps of training the neural network by:
extracting features of a source and target image pair of the dataset at different scales,
utilizing warp predictors to determine forward transforms to align source to target features at each scale, and
applying the loss function to determine backward transforms to align target to source features at each scale.

### Claim 12 (depends on 8)

The method of claim 8, wherein the neural network is a convolutional neural network.

### Claim 13 (depends on 8)

The method of claim 8, wherein the dataset is a Modified National Institute of Standards and Technology (MNIST) digit image dataset or a geo-parcel to aerial image alignment dataset.

### Claim 14 (depends on 8)

The method of claim 8, further comprising the step of aligning the attribute of the image of the dataset by the trained neural network by aligning a noisy digit contour present in the image or a parcel present in the image.

### Claim 15

A non-transitory computer readable medium having instructions stored thereon for performing noisy contour alignment by a computer vision system which, when executed by a processor, causes the processor to carry out the steps of:
generating a loss function;
training a neural network to learn to align contours using the loss function and a plurality of images; and
aligning an attribute of an image using the trained neural network.

### Claim 16 (depends on 15)

The non-transitory computer readable medium of claim 15, the processor further carrying out the step of determining an upper bound of the loss function.

### Claim 17 (depends on 15)

The non-transitory computer readable medium of claim 15, wherein the loss function is a local shape-dependent Chamfer upper bound loss function that measures proximity and local shape similarity while being robust towards noise and partial occlusions.

### Claim 18 (depends on 15)

The non-transitory computer readable medium of claim 15, the processor further carrying out the step of training the neural network by:
extracting features of a source and target image pair of the dataset at different scales,
utilizing warp predictors to determine forward transforms to align source to target features at each scale, and
applying the loss function to determine backward transforms to align target to source features at each scale.

### Claim 19 (depends on 15)

The non-transitory computer readable medium of claim 15, wherein the neural network is a convolutional neural network.

### Claim 20 (depends on 15)

The non-transitory computer readable medium of claim 15, the processor further carrying out the step of aligning the attribute of the image of the dataset by the trained neural network by aligning a noisy digit contour present in the image or a parcel present in the image.
