Smart surveillance device

A device comprising:

• one or more thermal cameras configured to generate thermal data of one or more users in a location monitored by the device;
• one or more ultrasonic sensors configured to analyze sound reflections to detect movement of the one or more users in the location;
• one or more infrared sensors configured to monitor physiological data of the one or more users;
• one or more microwave sensors configured to generate motion data and the physiological data of the one or more users;
• and
• a control unit configured to:
• generate combined data comprising the thermal data, the detected movement, the physiological data, and the motion data;
• and
• generate one or more messages characterizing the combined data.

A non-transitory computer-readable medium storing software comprising instructions executable by one or more computers which, upon such execution, cause the one or more computers to perform operations comprising:

• obtaining, from a device, sensor data that comprises physiological data of one or more users monitored by the device;
• generating feature data from the obtained sensor data, the feature data comprising information corresponding to the physiological data and configured to be processed by one or more trained machine learning models;
• providing the generated feature data as input to the one or more trained machine learning models, wherein the one or more trained machine learning models are configured to process the information corresponding to the physiological data to generate one or more health or behavior metrics;
• obtaining, from the one or more trained machine learning models, output comprising information corresponding to the one or more health or behavioral metrics for the one or more users monitored by the device;
• determining whether the information corresponding to the one or more health or behavioral metrics for the one or more users satisfies a respective threshold value for each of the one or more users;
• in response to determining that at least a portion of the information does not satisfy the respective threshold value for at least one user of the one or more users, performing one or more actions for the at least one user, wherein the one or more actions are configured to address the one or more health or behavioral metrics for the at least one user;
• and
• generating an alert related to at least the portion of the information that does not satisfy the respective threshold for at least the one user of the one or more users.