Haptic effect conversion system using granular synthesis
AssigneeImmersion Corporation
InventorsJuan Manuel CRUZ HERNANDEZ, Ali MODARRES, Liwen WU, David BIRNBAUM
Life of this patent
Estimating the term…
Abstract
A system is provided that converts an input, such as audio data, into one or more haptic effects. The system applies a granular synthesis algorithm to the input in order to generate a haptic signal. The system subsequently outputs the one or more haptic effects based on the generated haptic signal. The system can also shift a frequency of the input, and also filter the input, before the system applies the granular synthesis algorithm to the input.
Claims19
1-20. (canceled)
A computer-implemented method to generate a haptic effect comprising:
- receiving an input signal corresponding to a user gesture captured by a sensor;
- selecting a first grain comprising a first enveloped waveform;
- selecting a second grain comprising a second enveloped waveform;
- interpolating between the first grain and the second grain according to the input signal to generate an interpolated grain;
- and
- generating a haptic effect based on the interpolated grain.
A system for generating a haptic effect, the system comprising:
- a sensor configured to capture user gestures;
- a memory configured to store a haptic conversion module;
- a processor configured to execute the haptic conversion module stored on the memory,
- wherein the haptic conversion module is configured to
- receive an input signal corresponding to a user gesture captured by the sensor;
- select a first grain comprising a first enveloped waveform;
- select a second grain comprising a second enveloped waveform;
- interpolate between the first grain and the second grain according to the input signal to generate an interpolated grain;
- and
- generate a haptic effect based on the interpolated grain.
A computer-implemented method for converting an input waveform into one or more haptic effects, the method comprising:
- receiving the input waveform, wherein the input waveform is a multimodal waveform including audio and video content;
- segmenting the input waveform into a plurality of waveforms, wherein each waveform comprises at least a portion of the input waveform;
- combining each waveform with an envelope to generate a grain, wherein a plurality of grains are generated;
- combining the plurality of grains to generate a cloud, wherein the cloud comprises a representation of the plurality of grains;
- and
- generating the one or more haptic effects based on the cloud.
Dependencies are inferred from the claim text.