System and method for medical condition detection and triage using mobile devices
OwnerJoseph Alan Epsteininventor
Life of this patent
Estimating the term…
Abstract
A method and system for detecting possible disease and condition indications on a patient, using combinations of two dimensional, infrared, and three-dimensional (such as dot) cameras. In one embodiment, the cameras are located in a smartphone that the patient uses to aim at parts of the body, wherein features or motion potentially corresponding to indications of disease or conditions are extracted and analyzed. A further embodiment conducts triage for conditions detected or otherwise. Further embodiments use augmented reality overlays to assist the patient through the various procedures, guide in the data collection, and identify to the patient necessary and useful information.
Claims21
A method performed on a hand-held mobile device having a three-dimensional, depth, camera and an infrared camera, the method comprising:
- outputting, on the hand-held mobile device, augmented reality overlays that guide a patient in positioning and operating the hand-held mobile device to capture images of the patient's body using the three-dimensional depth camera, wherein the images capture the patient's body with varying visual depths;
- capturing depth images from the three-dimensional depth camera and thermal images from the infrared camera of a chest region of the patient;
- extracting, on the hand-held mobile device, body movement of the patient's chest region from the captured depth and thermal images;
- analyzing, on the hand-held mobile device, the extracted body movement using a patient-specific motion model stored and iteratively updated on the hand-held mobile device to detect at least one medical condition of the patient's heart or lungs;
- and
- producing, on the hand-held mobile device, an indication of at least one of a potential medical condition and a potential lack of a medical condition.
A hand-held mobile device, comprising:
- a three-dimensional camera that generates images with varying visual depths;
- an infrared camera configured to capture thermal images;
- an output device configured to output augmented reality overlays that guide a patient, in real-time, to position and operate the hand-held mobile device for capturing images of a chest region of the patient's body using the three-dimensional camera, wherein the images capture the patient's body with varying visual depths and with the capture of thermal images by the infrared camera;
- a first machine learning algorithm performed on the hand-held device and configured as a feature/motion extractor that extracts patient movement from the chest region from a fusion of the varying visual depth images and the thermal images;
- a second machine learning algorithm performed on the hand-held device and configured as a feature/motion analyzer that analyzes the extracted patient movement using a patient-specific motion model stored and iteratively updated on the hand-held mobile device to detect medical conditions of the patient's heart or lungs;
- and
- a medical condition indicator that generates an indication of at least one of a potential medical condition and a potential lack of a medical condition, wherein the feature/motion extractor, the feature/motion analyzer, and the medical condition indicator are implemented by the hand-held mobile device.
Dependencies are inferred from the claim text.