Machine learning for home understanding and notification

A method comprising:

• obtaining, by one or more processors, reference videos from a camera within a premises of a home;
• determining, by the one or more processors and from the reference videos, timing of actions in a routine that a particular person performs before leaving the home;
• determining, by the one or more processors and from a sample video from the camera within the home, that the particular person appears to be out of sync in performing a particular action based on the timing of actions in the routine determined from the reference videos;
• and
• in response to determining from the sample video from the camera within the home that the particular person appears to be out of sync in performing a particular action based on the timing of actions in the routine determined from the reference videos, providing a notification to the particular person.

A computer storage medium encoded with a computer program, the program comprising instructions that when executed by data processing apparatus cause the data processing apparatus to perform operations comprising:

• obtaining reference videos from a camera within a premises of a home;
• determining, from the reference videos, timing of actions in a routine that a particular person performs before leaving the home;
• determining from a sample video from the camera within the home that the particular person appears to be out of sync in performing a particular action based on the timing of actions in the routine determined from the reference videos;
• and
• in response to determining from the sample video from the camera within the home that the particular person appears to be out of sync in performing a particular action based on the timing of actions in the routine determined from the reference videos, providing a notification to the particular person.