Systems and methods for authoring immersive haptic experience using spectral centroid

A computer implemented method of authoring and transforming an audio signal into a haptic output to provide immersive haptic experience, the computer implemented method comprising:

• receiving the audio signal at a preprocessor for a fixed number of audio samples;
• applying harmonic percussive source separation to pre-processed fixed number of audio samples, wherein the harmonic percussive source separation comprises a harmonic spectrogram and a percussive spectrogram;
• calculating an array of time amplitude values and an array of time frequency values for the harmonic spectrogram and the percussive spectrogram;
• calculating an array of spectral centroid of the harmonic spectrogram and the percussive spectrogram;
• providing the array of the spectral centroid, the array of time amplitude values and the array of time frequency values to a user interface to modify at least one of the array of values of the harmonic spectrogram and the percussive spectrogram;
• transforming authored array of spectral centroid, the array of time amplitude values and the array of time frequency values to fit into a haptic perceptual bandwidth, and
• creating a computer readable file.

A haptic authoring system for converting an audio signal into a computer readable haptic file, the computer readable file when executed by a processor causes the haptic authoring system to produce an immersive haptic experience on the associated electronic computing device, the haptic authoring system comprising:

• a preprocessor module configured to an audio analysis module, wherein the audio analysis module receives a preprocessed audio signal and converts the preprocessed audio signal into an array of time amplitude values and an array of time frequency values, and wherein the audio analysis module calculates the spectral centroid of the array of time frequency values;
• an user interface for modifying the array of time amplitude values, the array of time frequency values and the array of time frequency values;
• a transformation module for transforming an authored array of time amplitude values, an authored array of time frequency values and an authored array of time frequency values to fit into a haptic perceptual bandwidth, and
• an aggregation and file management module for converting an array of transformed time amplitude values, an array of transformed time frequency values and an array of transformed time frequency values into the computer readable haptic file.