US 10,664,716 B2 · Portable substance analysis based on computer vision, spectroscopy, and artificial intelligence

Abstract

A portable complete analysis solution that integrates computer vision, spectrometry, and artificial intelligence for providing self-adaptive, real time information and recommendations for objects of interest. The solution has three major key components: (1) a camera enabled mobile device to capture an image of the object, followed by fast computer vision analysis for features and key elements extraction; (2) a portable wireless spectrometer to obtain spectral information of the object at areas of interest, followed by transmission of the data (data from all built in sensors) to the mobile device and the cloud; and (3) a sophisticated cloud based artificial intelligence model to encode the features from images and chemical information from spectral analysis to decode the object of interest. The complete solution provides fast, accurate, and real time analyses that allows users to obtain clear information about objects of interest as well as personalized recommendations based on the information.

Claims21

Dependent claims

A method for analyzing an object for one or multiple characteristic properties using a camera enabled device, a multi-wavelength spectrometer, and artificial intelligence comprising the steps of:

(a) obtaining an image of the object using a camera enabled device;
(b) using computer vision to extract one or more features of the object;
(c) using computer vision to identify one or more regions of interest within one or more of the features of the object;
(d) scanning the one or more regions of interest of the object using a multi-wavelength spectrometer over a plurality of wavelengths;
(e) measuring a spectrophotometric value for each of the wavelengths of step (d) to generate a spectrum of each region of interest of the object;
and
(f) using artificial intelligence to integrate the spectrum generated in step (e) with the features extracted in step (b) with the regions of interest identified in step (c) to generate an analysis of the one or multiple characteristic properties of the object,
wherein the computer vision to extract one or more features of the object comprises:
downsampling the image of the object by performing a convolution with a filter bank using an encoder network;
reducing image resolution;
and
inducing a set of feature maps of the image with the global and local features.

9 more elements

Dependencies are inferred from the claim text.

Portable substance analysis based on computer vision, spectroscopy, and artificial intelligence

Life of this patent

Portable substance analysis based on computer vision, spectroscopy, and artificial intelligence

Life of this patent

Abstract

Claims21