Systems and methods for recording haptic data for use with multi-media data

A method of providing haptics, comprising:

• recording an audio or a video of a subject of interest with a recorder;
• tracking the subject of interest with a first sensor not in contact with the subject of interest to generate non-contact sensor data based on a movement or a vibration of the subject of interest during the audio or the video and a second sensor located on the subject of interest to generate on-subject sensor data based on the movement or the vibration, wherein a movement of the first sensor is synchronized with a movement of the recorder;
• mixing the non-contact sensor data and the on-subject sensor data to generate sensor data;
• and
• generating tactile effect data from the sensor data, the tactile effect data including haptic effects corresponding to the movement or the vibration of the subject of interest during the audio or the video;
• and
• transmitting the tactile effect data, along with the audio or the video, to a plurality of devices for playback of the haptic effects in synchronization with the audio or the video.

A non-transitory computer readable medium having instructions stored thereon that, when executed by a processor, cause the processor to:

• record an audio or a video of a subject of interest with a recorder;
• track the subject of interest with a first sensor not in contact with the subject of interest to generate non-contact sensor data based on a movement or a vibration of the subject of interest during the audio or the video and a second sensor located on the subject of interest to generate on-subject sensor data based on the movement or the vibration, wherein a movement of the first sensor is synchronized with a movement of the recorder;
• and
• generate tactile effect data from the sensor data, the tactile effect data including haptic effects corresponding to the movement or the vibration of the subject of interest during the audio or the video;
• and
• transmit the tactile effect data, along with the audio or the video, to a plurality of devices for playback of the haptic effects in synchronization with the audio or the video;
• an output transformer configured to generate a tactile effect data signal from the encoded sensor data by mixing the non-contact sensor data and the on-subject sensor data, the tactile effect data signal including haptic effects corresponding to the movement or the vibration of the subject of interest during the recording;
• and
• a transmitter configured to transmit the tactile effect data signal, along with the audio or video signal, to a plurality of devices for playback of the haptic effects in synchronization with the recording.