Method and apparatus for sensor aided extraction of spatio-temportal features

An apparatus comprising at least one processor and at least one memory storing computer program code, wherein the at least one memory and stored computer program code are configured, with the at least one processor, to cause the apparatus to:

• receive video data captured from a camera device;
• receive sensor data captured from auxiliary sensors associated with the camera device;
• cause association of the sensor data and the video data use time data, wherein each of one or more samples of sensor data is associated with a single video frame;
• detect camera view motion in the sensor data and cause segmentation of the sensor data into stable segments;
• and
• extract one or more temporal features from the video data associated with the stable segments of the sensor data.

A computer program product comprising at least one non-transitory computer-readable storage medium having computer-readable program instructions stored therein, the computer-readable program instructions includes program instructions configured for:

• receiving video data captured from a camera device;
• receiving sensor data captured from auxiliary sensors associated with the camera device;
• causing association of the sensor data and the video data using time data, wherein each of one or more samples of sensor data is associated with a single video frame;
• detecting camera view motion in the sensor data;
• causing, utilizing a processor, segmentation of the sensor data into stable segments;
• and
• extracting one or more temporal features from the video data associated with the stable segments of the sensor data.