# US 10,117,617 B2 · Automated systems and methods for skin assessment and early detection of a latent pathogenic bio-signal anomaly > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 10,117,617 B2 - Document ID: US10117617B2 - Status: Granted - Kind: B2 - Application number: 14/876,818 - Filed: 2015-10-07 - Published: 2016-04-14 - Granted: 2018-11-06 - Earliest claimed: 2014-10-08 - Assignees: Revealix, Inc. - Applicants: Revealix, Inc. - Inventors: Adrianna Cantu; Gary Johnson - Web page: https://patentgrep.com/patent/US10117617B2 ## CPC - A61B 5/445: {Evaluating skin irritation or skin trauma, e.g. rash, eczema, wound, bed sore} - A61B 5/0064: {Body surface scanning} - A61B 5/015: {By temperature mapping of body part} - A61B 5/72: {Signal processing specially adapted for physiological signals or for diagnostic purposes} - A61B 5/0002: {Remote monitoring of patients using telemetry, e.g. transmission of vital signals via a communication network (endoradiosondes A61B5/07)} - A61B 5/0531: Measuring skin impedance - A61B 5/1075: {for measuring dimensions by non-invasive methods, e.g. for determining thickness of tissue layer (A61B8/0858 takes precedence)} - A61B 5/145: Measuring characteristics of blood in vivo, e.g. gas concentration or pH-value {; Measuring characteristics of body fluids or tissues, e.g. interstitial fluid or cerebral tissue} (non-radiation detecting or locating of foreign bodies in blood A61B5/06) - A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D) ## Abstract The present invention relates to systems and methods for early detection, assessment, monitoring and prevention of pathophysiological conditions originating and/or emanating from skin or localized tissues, including but not limited to acute or chronic episodes of soft tissue pathology, wound, injury, dermatological or rheumatoid condition where bio-signal patterns, biomarkers or other identifiable elements or references would deviate from baseline. Specifically, the present invention relates to methods and systems specially designed and adapted for early detection of a latent pathogenic bio-signal anomaly using multiple aggregated sensors before the anomaly would otherwise be detectable. ## Claims ### Claim 1 A scanner for detecting a latent pathogenic skin condition in a patient comprising: an infrared sensor configured to generate a first data set; an optical sensor configured to generate a second data set; an input module configured to receive one or more key factor input for the patient; a metrics module electrically connected to the infrared sensor, the optical sensor, and the input module, comprising a combinational and adaptive processor and memory, programmed to: receive the one or more key factor input for the patient from the input module, acquire and store the first data set and the second data set, determine a combination weighted function based on the first and the second data sets, and compare the combination weighted function to a baseline of key indicators to determine that the latent pathogenic skin condition is present; and perform simultaneous localization and mapping of a portion of the patient's body with the infrared sensor and the optical sensor while the combinational and adaptive processor acquires the first data set and the second data set; and an accelerometer and a feature matching engine configured to receive simultaneously-captured visual images from the optical sensor and thermal images from the infrared sensor, perform feature detection on the visual images and thermal images, perform a homography calculation on the visual images and thermal images using timestamps from the accelerometer to align the detected features in the visual and thermal images, perform homography transformations on one or both of the visual images and thermal images, and perform image fusion on the resulting transformed image. ### Claim 2 (depends on 1) The scanner of claim 1 wherein the combinational and adaptive processor is programmed to generate temperature profiles for the portion of the patient's body from the first data set and the second data set while the combinational and adaptive processor acquires the first data set and the second data set. ### Claim 3 (depends on 1) The scanner of claim 1 wherein the combinational and adaptive processor is programmed to perform sizing and location analysis for the portion of the patient's body from the first data set and the second data set while the combinational and adaptive processor acquires the first data set and the second data set. ### Claim 4 (depends on 1) The scanner of claim 1 wherein the combinational and adaptive processor is programmed to perform the functions selected from the group consisting of skin matching, skin texture analysis, intelligent skin location identification, reflection analysis, color analysis, environmental temperature detection, and range determination from the first data set and the second data set while the combinational and adaptive processor acquires the first data set and the second data set. ### Claim 5 (depends on 1) The scanner of claim 1 further comprising: the feature matching engine is configured to use incremental alignment of successive visual images from the optical sensor to augment a thermal image from the infrared sensor to provide a super resolution thermal image adequate for anatomical referencing. ### Claim 6 (depends on 1) The scanner of claim 1 further comprising: a visible-light projector configured to project user interface elements onto the skin of the patient; and the infrared sensor is configured to detect user interactions with the projected user interface elements. ### Claim 7 A monitoring system for detecting a latent pathogenic skin condition in a patient comprising: an infrared sensor configured to generate a first data set and an optical sensor configured to generate a second data set; an input module configured to receive one or more key factor input for the patient; a metrics module electrically connected to the infrared sensor and the optical sensor and the input module, comprising a combinational and adaptive processor and memory, programmed to: receive the one or more key factor input for the patient from the input module, acquire and store the first data set and the second data set, determine a combination weighted function based on the first and the second data sets, and compare the combination weighted function to a baseline of key indicators to determine that the latent pathogenic skin condition is present; and perform simultaneous localization and mapping of a portion of the patient's body with the infrared sensor and the optical sensor while the combinational and adaptive processor acquires the first data set and the second data set; a feature matching engine configured to use an incremental alignment of successive visual images from the optical sensor to augment a thermal image from the infrared sensor to provide a super resolution thermal image adequate for anatomical referencing; and an accelerometer and the feature matching engine configured to receive simultaneously-captured visual images from the optical sensor and thermal images from the infrared sensor, perform feature detection on the visual images and thermal images, perform a homography calculation on the visual images and thermal images using timestamps from the accelerometer to align the detected features in the visual and thermal images, perform homography transformations on one or both of the visual images and thermal images, and perform image fusion on the resulting transformed image. ### Claim 8 (depends on 7) The system of claim 7 further comprising: a visible-light projector configured to project user interface elements onto the skin of the patient; and the infrared sensor is configured to detect user interactions with the projected user interface elements. ### Claim 9 (depends on 7) The system of claim 7 further comprising: multiple real-time sensors selected from the group consisting of mono visible cameras, stereo visible cameras, mono infrared cameras, stereo infrared cameras, infrared pile sensors, spot measuring sensors, ambient temperature sensors, ambient light sensors, gas sensors, ultrasound sensors, near-infrared light sensors, gyroscopes, accelerometers, GPS sensors, Wi-Fi sensors, other location aware sensors, depth sensing sensors, bar ID scanners, patient ID scanners, terahertz sub-dermal scanners, ultrasound scanners, impedance spectroscopy sensors, and moisture sensors. ### Claim 10 (depends on 7) The system of claim 7 wherein the key indicator is selected from the group consisting of bio-signals, temperature profile, temperature differences, temperature comparisons, color indicators, color gradient indications, reflectivity indexes, texture indexes, area, areas interest, volume, contour heights, key performance markers, and key indicating factors. ### Claim 11 (depends on 7) The system of claim 7 wherein the one or more key factors are selected from the group consisting of data from the patient's Electronic Health Record (“EHR”), the patient's profile, key ratios for the combinational and adaptive processor, trigger points for the combinational and adaptive processor, priming functions for the combinational and adaptive processor, and override parameters. ### Claim 12 (depends on 7) The system of claim 7 wherein the baseline of key indicators is a population key indicator baseline. ### Claim 13 (depends on 7) The system of claim 7 wherein the baseline of key indicators is an individual key indicator baseline. ### Claim 14 A method for detecting a latent pathogenic skin condition in a patient comprising: using an infrared sensor to generate a first data set; using an optical sensor to generate a second data set; using an input module to receive one or more key factor input for the patient; using a metrics module electrically connected to the infrared sensor, the optical sensor, and the input module, comprising a combinational and adaptive processor and memory, to receive with the metrics module the one or more key factor input for the patient from the input module, acquire and store with the metrics module the first data set and the second data set, determine with the metrics module a combination weighted function based on the first and the second data sets, and compare with the metrics module the combination weighted function to a baseline of key indicators to determine if that the latent pathogenic skin condition is present; and perform with the metrics module simultaneous localization and mapping of a portion of the patient's body with the infrared sensor and the optical sensor while the combinational and adaptive processor acquires the first data set and the second data set; projecting with a visible-light projector user interface elements onto the skin of the patient; and determining with the infrared sensor interactions with the projected user interface elements. ### Claim 15 (depends on 14) The method of claim 14 further comprising: using an accelerometer and a feature matching engine to receive simultaneously-captured visual images from the optical sensor and thermal images from the infrared sensor, perform feature detection on the visual images and thermal images, perform a homography calculation on the visual images and thermal images using timestamps from the accelerometer to align the detected features in the visual and thermal images, perform homography transformations on one or both of the visual images and thermal images, and perform image fusion on the resulting transformed image. ### Claim 16 (depends on 15) The method of claim 15 further comprising: using the feature matching engine to use an incremental alignment of successive visual images from the optical sensor to augment a thermal image from the infrared sensor to provide a super resolution thermal image adequate for anatomical referencing.