Proactive actions based on audio and body movement

A system comprising:

• a non-transitory computer-readable storage medium;
• and
• one or more processors coupled to the non-transitory computer-readable storage medium, wherein the non-transitory computer-readable storage medium comprises program instructions that, when executed on the one or more processors, cause the system to perform operations comprising:
• obtaining first sensor data and second sensor data corresponding to a physical environment, the first sensor data corresponding to audio in the physical environment and the second sensor data corresponding to a body movement in the physical environment;
• selectively switching to different power states on an electronic device based on multiple triggers identified at the electronic device, where selectively switching through the different power states comprises:
• detecting, based on the second sensor data, that the body movement corresponds to a type of body movement indicative of user interest in music;
• based on detecting that the body movement corresponds to the type of body movement indicative of user interest in music, selectively triggering performance of audio analysis to determine if music is playing based on the first sensor data;
• determining that music is playing based on the audio analysis;
• based on determining that music is playing, selectively triggering performance of a comparison of audio elements with one or more aspects of the body movement, based on the first sensor data and the second sensor data;
• identifying a time-based relationship between one or more elements of the audio and one or more aspects of the body movement via at least the comparison;
• based on identifying the time-based relationship, selectively triggering performance of a source attribute identification process;
• and
• identifying an interest in content of the audio based at least on the source attribute identification process;
• determining to wait to provide one or more features based on a user state corresponding to the user being busy;
• and
• providing one or more features based on identifying the interest in the content, wherein a timing of providing the one or more features comprises waiting based on the user state corresponding to the user being busy.

A non-transitory computer-readable storage medium storing program instructions executable via one or more processors to perform operations comprising:

• obtaining first sensor data and second sensor data corresponding to a physical environment, the first sensor data corresponding to audio in the physical environment and the second sensor data corresponding to a body movement in the physical environment;
• selectively switching to different power states on an electronic device based on multiple triggers identified at the electronic device, where selectively switching through the different power states comprises:
• detecting, based on the second sensor data, that the body movement corresponds to a type of body movement indicative of user interest in music;
• based on detecting that the body movement corresponds to the type of body movement indicative of user interest in music, selectively triggering performance of audio analysis to determine if music is playing based on the first sensor data;
• determining that music is playing based on the audio analysis;
• based on determining that music is playing, selectively triggering performance of a comparison of audio elements with one or more aspects of the body movement, based on the first sensor data and the second sensor data;
• identifying a time-based relationship between one or more elements of the audio and one or more aspects of the body movement via at least the comparison;
• based on identifying the time-based relationship, selectively triggering performance of a source attribute identification process;
• and
• identifying an interest in content of the audio based at least on the source attribute identification process;
• determining to wait to provide one or more features based on a user state corresponding to the user being busy;
• and
• providing one or more features based on identifying the interest in the content, wherein a timing of providing the one or more features comprises waiting based on the user state corresponding to the user being busy.