Architecture for improved machine learning operation
AssigneeRaytheon Company
InventorSteven A. Israel
Life of this patent
Estimating the term…
Loading patent…
AssigneeRaytheon Company
InventorSteven A. Israel
Estimating the term…
Discussed herein are architectures and techniques for improving execution or training of machine learning techniques. A method can include receiving a request for image data, the request indicating an analysis task to be performed using the requested image data, determining a minimum image quality score for performing the analysis task, issuing a request for image data associated with an image quality at last equal to, or greater than, the determined minimum image quality score, receiving, in response to the request, image data with an image quality score greater than, or equal to, the determined minimum image quality score, and providing the received image data to (a) a machine learning (ML) model executor to perform the image analysis task or (b) an ML model trainer that trains the ML model to perform the image analysis task.
A system for image processing, the system comprising:
A method for image processing, the method comprising:
A non-transitory machine-readable medium including instructions that, when executed by a machine, cause the machine to perform operations for image processing, the operations comprising:
Dependencies are inferred from the claim text.
Drawings are temporarily unavailable. Open the PDF at USPTO
From the US filing history. Foreign family members aren’t listed.
Image analysis: inspection of images, e.g. flaw detection
Selection of the most significant subset of features: by ranking or filtering the set of features, e.g. using a measure of variance or of feature…
Design or setup of recognition systems or techniques; Extraction of features in feature space; Blind source separation: generating training…
Detection or correction of errors, e.g. by rescanning the pattern or by human intervention; Evaluation of the quality of the acquired patterns:…
About 12 years 11 months of term left · ends 1 Oct 2039 (estimated)
The National Imagery Interpretation Rating Scale (NIIRS) is graded from 0 to 9, where 0 is the coarsest resolution and 9 is the finest resolution. The NIIRS was developed using human perception of image quality to perform imagery analysis tasks. The image quality is determined based on one or more attributes of the image. The imagery attributes are the physical characteristics of the image such as the resolution, the relative edge response, and signal-to-noise. The analysis tasks can include, for example, determining whether a door is open or closed, identifying a type of automobile, distinguishing individual steps, or identifying grill detail or a license plate number on a license plate of a vehicle.
FIG. 1 illustrates, by way of example, a diagram of an embodiment of a system for improving a machine learning (ML) technique.
FIG. 2 illustrates, by way of example, a diagram of an embodiment of a method for improving an ML technique.
FIG. 3 illustrates, by way of example, a block diagram of an embodiment of a machine (e.g., a computer system) to implement one or more embodiments.
Some embodiments relate to automatically identifying an image quality. The image quality that is automatically identified can be used to remove images of insufficient quality for a specified purpose. For example, training a ML target model with images below the quality for the specific recognition task will generate poorly performing models regardless of training set volume. Likewise, inferencing images of insufficient quality to perform a given task will likely lead to spurious results generated by the trained target model.
Given some quantitative image quality metrics (e.g., resolution, signal to noise ratio (SNR), or the like) a NIIRS value can be predicted using the a general image quality equation (GIQE). The analysis tasks possible using the image can be determined using a National Imagery Interpretability Rating Scale (NIIRS). NIIRS is a subjective scale used for rating the quality of imagery acquired from various types of imaging systems. The NIIRS was developed using a large number of trained imagery analysts. Individual NIIRS have been developed for visible band images, radar images, infrared images, and multispectral images. With NIIRS, analysis tasks are associated with a minimum image quality required to perform the analysis task.
Automatically determining the quality of an image can include using object recognition technology, sometimes a convolutional neural network (CNN). Since the NIIRS is a subjective scale that defines quality of imagery based on objects that are distinguishable in the image, an object recognition technique (or multiple object recognition techniques) can be used to determine the quality. The following table summarizes the rating using a NIIRS rating scale on visible imagery. Sometimes, sufficient information to determine the GIQE rating for a image is provided with the image, such as part of a header (sometimes called metadata) of the image.