US 11,699,277 B2 · Classification with segmentation neural network for image-based content capture

Abstract

A segmentation neural network is extended to provide classification at the segment level. An input image of a document is received and processed, utilizing a segmentation neural network, to detect pixels having a signature feature type. A signature heatmap of the input image can be generated based on the pixels in the input image having the signature feature type. The segmentation neural network is extended from here to further process the signature heatmap by morphing it to include noise surrounding an object of interest. This creates a signature region that can have no defined shape or size. The morphed heatmap acts as a mask so that each signature region or object in the input image can be detected as a segment. Based on this segment-level detection, the input image is classified. The classification result can be provided as feedback to a machine learning framework to refine training.

Claims20

Dependent claims

An image processing method, comprising:

receiving, by a computer, an input image;
detecting, by the computer utilizing a segmentation neural network, pixels in the input image having a particular feature type;
generating, by the computer based on the pixels in the input image having the particular feature type, a heatmap of the input image;
generating, by the computer from the heatmap, a morphed heatmap with contextual information on the pixels in the input image having the particular feature type;
detecting, by the computer, an object or region in the input image by masking the input image using the morphed heatmap;
and
classifying, by the computer based at least on the object or region, the input image.

4 more elements

Dependencies are inferred from the claim text.

Classification with segmentation neural network for image-based content capture

Life of this patent

Classification with segmentation neural network for image-based content capture

Life of this patent

Abstract

Claims20