# US 2014/0152429 A1 · Sound to haptic effect conversion system using waveform > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2014/0152429 A1 - Document ID: US20140152429A1 - Status: Published application - Kind: A1 - Application number: 14/175,163 - Filed: 2014-02-07 - Published: 2014-06-05 - Earliest claimed: 2011-02-11 - Assignees: Immersion Corporation - Applicants: Immersion Corporation - Inventors: Satvir Singh BHATIA; Kanav GANDHI; Christopher J. ULLRICH; Juan Manuel CRUZ-HERNANDEZ; Herve Thu TIMONE; Jason Hoi Fun LAU - Web page: https://patentgrep.com/patent/US20140152429A1 ## CPC - G08B 6/00: Tactile signalling systems, e.g. tactile personal calling systems - G06F 3/016: {Input arrangements with force or tactile feedback as computer generated output to the user} - G06F 3/167: {Audio in a user interface, e.g. using voice commands for navigating, audio feedback} - G09G 5/006: {Details of the interface to the display terminal (specific for a display terminal using a CRT G09G1/167; using a flat panel G09G3/2096; circuits for interfacing with colour displays G09G5/04)} - G08B: SIGNALLING SYSTEMS, e.g. PERSONAL CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00) ## Abstract A haptic conversion system is provided that intercepts frames of audio data, such as a digital audio signal, converts the frames into a haptic signal, and plays the created haptic signal through an actuator to produce haptic effects. The haptic signal is based on a maximum value of each audio data frame, which defines a magnitude of the haptic signal. The haptic signal is applied to the actuator configured to receive the haptic signal, where the actuator utilizes the haptic signal to generate the one or more haptic effects. ## Claims ### Claim 1 A computer-readable medium having instructions stored thereon that, when executed by a processor, cause the processor to convert an audio signal into one or more haptic effects, the converting comprising: receiving a data frame of the audio signal; generating a maximum value of the data frame; transforming the data frame; generating at least one sine carrier waveform based on a maximum value of the transformed data frame; mixing the transformed data frame with the at least one sine carrier waveform to generate a modulated data frame; generating a haptic signal based on the maximum value and the modulated data frame; and sending the haptic signal to an actuator to generate the one or more haptic effects. ### Claim 2 (depends on 1) The computer-readable medium of claim 1, wherein the maximum value of the data frame determines whether the haptic signal is generated, and wherein the modulated data frame defines a waveform of the haptic signal. ### Claim 3 (depends on 2) The computer-readable medium of claim 2, wherein the haptic signal is generated only when the maximum value of the data frame is greater than a specified threshold. ### Claim 4 (depends on 1) The computer-readable medium of claim 1, wherein the haptic signal comprises a waveform effect. ### Claim 5 (depends on 1) The computer-readable medium of claim 1, wherein transforming the data frame comprises band-pass filtering the data frame. ### Claim 6 (depends on 1) The computer-readable medium of claim 1, wherein transforming the data frame comprises low-pass filtering the data frame. ### Claim 7 (depends on 1) The computer-readable medium of claim 1, the converting further comprising resampling the data frame before the data frame is transformed. ### Claim 8 (depends on 1) The computer-readable medium of claim 1, the converting further comprising boosting the audio signal contained within the data frame after the data frame is transformed. ### Claim 9 (depends on 1) The computer-readable medium of claim 1, the generating at least one sine carrier waveform further comprising: calculating a sine value of the transformed data frame based on a frequency of the transformed data frame and a phase of the transformed data frame; and multiplying the calculated sine value by the maximum value of the transformed data frame. ### Claim 10 (depends on 1) The computer-readable medium of claim 1, wherein the transformed data frame is mixed with the at least one sine carrier waveform according to a formula where the mix of the transformed data frame and the at least one sine carrier waveform is normalized. ### Claim 11 (depends on 1) The computer-readable medium of claim 1, the converting further comprising extracting a frequency content from the data frame using a fast fourier transformation of the data frame. ### Claim 12 (depends on 1) The computer-readable medium of claim 1, the converting further comprising extracting a frequency content from the data frame using a band-pass filter. ### Claim 13 (depends on 1) The computer-readable medium of claim 1, the converting further comprising: dividing the data frame into low frequency content, middle frequency content, and high frequency content; and extracting the middle frequency content and high frequency content. ### Claim 14 A computer-implemented method for converting an audio signal into one or more haptic effects, the computer-implemented method comprising: receiving a data frame of the audio signal; generating a maximum value of the data frame; transforming the data frame; generating at least one sine carrier waveform based on a maximum value of the transformed data frame; mixing the transformed data frame with the at least one sine carrier waveform to generate a modulated data frame; generating a haptic signal based on the maximum value and the modulated data frame; and sending the haptic signal to an actuator to generate the one or more haptic effects. ### Claim 15 (depends on 14) The computer-implemented method of claim 14, wherein the maximum value of the data frame determines whether the haptic signal is generated, and wherein the modulated data frame defines a precision of the haptic signal. ### Claim 16 (depends on 15) The computer-implemented method of claim 15, wherein the haptic signal is generated only when the maximum value of the data frame is greater than a specified threshold. ### Claim 17 (depends on 14) The computer-implemented method of claim 14, wherein the haptic signal comprises a waveform effect. ### Claim 18 (depends on 14) The computer-implemented method of claim 14, wherein transforming the data frame comprises band-pass filtering the data frame. ### Claim 19 (depends on 14) The computer-implemented method of claim 14, further comprising extracting a frequency content from the data frame using a fast fourier transformation of the data frame. ### Claim 20 (depends on 14) The computer-implemented method of claim 14, further comprising extracting a frequency content from the data frame using a band-pass filter. ### Claim 21 (depends on 14) The computer-implemented method of claim 14, further comprising: dividing the data frame into low frequency content, middle frequency content, and high frequency content; and extracting the middle frequency content and high frequency content. ### Claim 22 A haptic conversion system comprising: a memory configured to store a haptic conversion module, wherein the haptic conversion module comprises a reverb module, a boombox module, and a transformation module; a processor configured to execute the haptic conversion module stored on the memory; and an actuator configured to output one or more haptic effects; wherein the reverb module is configured to receive a data frame of the audio signal; wherein the boombox module is configured to generate a maximum value of the data frame; wherein the transformation module is configured to transform the data frame; wherein the boombox module is further configured to generate at least one sine carrier waveform based on a maximum value of the transformed data frame; wherein the boombox module is further configured to mix the transformed data frame with the at least one sine carrier waveform to generate a modulated data frame; wherein the reverb module is further configured to generate a haptic signal based on the maximum value of the data frame and the modulated data frame; and wherein the reverb module is further configured to send the haptic signal to an actuator to generate the one or more haptic effects. ### Claim 23 (depends on 22) The haptic conversion system of claim 22, wherein the maximum value of the data frame determines whether the haptic signal is generated, and wherein the modulated data frame defines a precision of the haptic signal. ### Claim 24 (depends on 23) The haptic conversion system of claim 23, wherein the reverb module is further configured to generate the haptic signal only when the maximum value of the data frame is greater than a specified threshold. ### Claim 25 (depends on 22) The haptic conversion system of claim 22, wherein the haptic signal comprises a waveform effect. ### Claim 26 (depends on 22) The haptic conversion system of claim 22, wherein the transformation module further comprises a band-pass filter configured to band-pass filter the data frame. ### Claim 27 (depends on 22) The haptic conversion system of claim 22, wherein the boombox module is further configured to extract a frequency content from the data frame using a fast fourier transformation of the data frame. ### Claim 28 (depends on 22) The haptic conversion system of claim 22, wherein the boombox module is further configured to extract a frequency content from the data frame using a band-pass filter. ### Claim 29 (depends on 22) The haptic conversion system of claim 22, wherein the boombox module is further configured to: divide the data frame into low frequency content, middle frequency content, and high frequency content; and extract the middle frequency content and high frequency content.