Methods and systems for surface informatics based detection with machine-to-machine networks and smartphones

A computer-implemented method of employing surface informatics based detection using a first computer-enabled imaging device and a data processing and display system:

• at the first computer-enabled imaging device having a first two-dimensional pixilated detector, at least one first accelerometer, at least one first gyroscope, one or more first processors, and memory for storing one or more programs for execution by the one or more first processors, the one or more programs including programs for real-time feature detection, real-time generation of feature-based coordinate point cloud systems, and active mapping and tracking of coordinate points of a point cloud system to image features:
• obtaining a respective time-stamped image with coordinate-mapped feature points for features of a first subject in a plurality of subjects using the first two-dimensional pixilated detector at a first frequency, thereby obtaining a first workflow comprising a first plurality of time-stamped images, each time-stamped image of the first workflow having a respective time point of a first plurality of time points at which the respective time-stamped image was obtained;
• acquiring a respective time-stamped accelerometer interval reading and a respective time-stamped interval gyroscope reading using the respective at least one first accelerometer and the at least one first gyroscope at a second frequency independent of the first frequency, thereby acquiring a first plurality of time-stamped accelerometer interval readings and a first plurality of time-stamped interval gyroscope readings,
• each of the time-stamped accelerometer interval readings and each of the time-stamped interval gyroscope readings having a respective time point of a second plurality of time points at which the respective reading was acquired, thereby obtaining a first real-time translational and rotational trajectory of the first computer-enabled imaging device which indicates a relative position of the first computer-enabled imaging device with respect to the first subject through the first plurality of time-stamped images;
• and
• acquiring time-stamped coordinates of the feature points in the first workflow at each of the first plurality of time points, thereby obtaining real time translational movement of the coordinates of the feature points;
• and
• communicating, through a network to the data processing and display system for image processing and analysis, a first dataset comprising:
• the first workflow, the time-stamped coordinates of the feature points in the first workflow, the first real-time translational and rotational trajectory of the first computer-enabled imaging device, and the translational movement of the coordinates of the feature points in the first workflow,
• wherein the data processing and display system comprises one or more processors and memory for storing instructions for execution by the one or more processors, including instructions for storing the first dataset in a subject data store associated with the first subject in a first memory location in the computer memory.