Activity detection on devices with multi-modal sensing

A method comprising:

• receiving, by a wearable computing device comprising a memory storing instructions, the instructions comprising an activity detection system and an activity response engine, the activity detection system comprising a detection model and the activity response system comprising one or more response models, and one or more first sensors, first sensor data from the one or more first sensors, the one or more first sensors data comprising body-oriented data from a body of a user wearing the wearable computing device;
• determining, by the activity detection system and based on at least the first sensor data, whether the user is performing an activity, the activity one of a plurality of activities available to the detection model;
• and
• respondent to the determination that the user is performing the activity, determining, by the activity response engine and based on the activity, one or more actions, the one or more actions selected from among a plurality of actions available to the one or more response models.

One or more non-transitory computer-readable storage media encoded with instructions that when executed by a wearable computing device comprising one or more processors causes the wearable computing device to perform operations comprising:

• receiving first sensor data from one or more first sensors, the one or more first sensors comprising body-oriented data from a body of a user wearing the wearable computing device;
• determining, by an activity detection system comprising a detection model and based on at least the first sensor data, whether the user is performing an activity, the activity one of a plurality of activities available to the detection model;
• and
• respondent to the determination that the user is performing the activity, determine, based on the activity and by an activity response engine comprising one or more response models, one or more actions, the one or more actions selected from among a plurality of actions available to the one or more response models.