Contactless image-based blood oxygen estimation

An apparatus, comprising:

• at least one processor;
• and
• at least one memory comprising computer program code,
• the at least one memory and the computer program code are configured, with the at least one processor, to cause the apparatus at least to receive an image or video of a part of a subject captured by a camera of a computing device;
• extract a region of interest of the part of the subject from the image or video;
• perform feature extraction of the region of interest;
• estimate a blood oxygen saturation level of the subject based on a spatial and temporal data analysis of more than two color channels, wherein feature extraction and estimation of the blood oxygen saturation level comprises implementing a combination of spatial averaging, color channel mixing, and temporal trend analysis;
• extract a remote photoplethysmogram signal from the spatial averaging;
• determine a heart rate of the subject from the photoplethysmogram signal;
• calculate, based on the heart rate, DC and AC components of red, green, and blue color channels of the camera based on the spatial averaging;
• and
• generate a regression model from pairwise ratios of the spatial averaging.

A computer program, embodied on a non-transitory computer readable medium, the computer program comprising computer executable code, which, when executed by a processor, causes the processor to:

• receive an image or video of a part of a subject captured by a camera of a computing device;
• extract a region of interest of the part of the subject from the image or video;
• perform feature extraction of the region of interest;
• estimate a blood oxygen saturation level of the subject based on a spatial and temporal data analysis of more than two color channels, wherein feature extraction and estimation of the blood oxygen saturation level comprises implementing a combination of spatial averaging, color channel mixing, and temporal trend analysis;
• extract a remote photoplethysmogram signal from the spatial averaging;
• determine a heart rate of the subject from the photoplethysmogram signal;
• calculate, based on the heart rate, DC and AC components of red, green, and blue color channels of the camera based on the spatial averaging;
• and
• generate a regression model from pairwise ratios of the spatial averaging.