# US 2016/0260298 A1 · Sound to haptic effect conversion system using mapping

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2016/0260298 A1
- Document ID: US20160260298A1
- Status: Published application
- Kind: A1
- Application number: 15/152,699
- Filed: 2016-05-12
- Published: 2016-09-08
- Earliest claimed: 2012-08-31
- Assignees: Immersion Corporation
- Applicants: Immersion Corporation
- Inventors: Juan Manuel CRUZ-HERNANDEZ; Christopher J. ULLRICH
- Web page: https://patentgrep.com/patent/US20160260298A1

## CPC

- G08B 6/00: Tactile signalling systems, e.g. tactile personal calling systems
- G06F 3/016: {Input arrangements with force or tactile feedback as computer generated output to the user}
- G08B: SIGNALLING SYSTEMS, e.g. PERSONAL CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

A system generates a haptic signal. The system receives an audio signal, pre-processes the audio signal by modifying the audio signal to create a modified audio signal, and maps the modified audio signal to a haptic signal. The system then sends the haptic signal to an actuator to generate one or more haptic effects.

## Claims

### Claim 1

A non-transitory computer-readable medium having instructions stored thereon that, when executed by a processor, cause the processor to generate a haptic signal, the generating comprising:
receiving an audio signal;
pre-processing the audio signal by modifying the audio signal to create a modified audio signal;
mapping the modified audio signal to a haptic signal; and
sending the haptic signal to an actuator to generate one or more haptic effects.

### Claim 2 (depends on 1)

The non-transitory computer-readable medium of claim 1, wherein the modifying of the audio signal comprises under-sampling the audio signal.

### Claim 3 (depends on 1)

The non-transitory computer-readable medium of claim 1, wherein the modifying of the audio signal comprises fusing an average of two or more channels of the audio signal.

### Claim 4 (depends on 1)

The non-transitory computer-readable medium of claim 1, wherein the modifying of the audio signal comprises filtering the audio signal.

### Claim 5 (depends on 1)

The non-transitory computer-readable medium of claim 1, wherein the pre-processing of the audio signal further comprises adjusting one or more parameters of the modified audio signal, wherein the mapping is based on the adjusted one or more parameters of the audio signal.

### Claim 6 (depends on 1)

The non-transitory computer-readable medium of claim 1, wherein one or more frequencies in the haptic signal are selected based on one or more characteristics of the actuator.

### Claim 7 (depends on 6)

The non-transitory computer-readable medium of claim 6, wherein the modified audio signal comprises one or more audio sub-signals with a frequency within a low range, wherein the one or more audio sub-signals are mapped to corresponding haptic signals with the one or more frequencies.

### Claim 8 (depends on 6)

The non-transitory computer-readable medium of claim 6, wherein the modified audio signal comprises one or more audio sub-signals with a frequency within a middle range, wherein the one or more audio sub-signals are mapped to corresponding haptic signals with the one or more frequencies.

### Claim 9 (depends on 6)

The non-transitory computer-readable medium of claim 6, wherein the modified audio signal comprises one or more audio sub-signals with a frequency within a high range, wherein the one or more audio sub-signals are mapped to corresponding haptic signals with the one or more frequencies.

### Claim 10 (depends on 1)

The non-transitory computer-readable medium of claim 1, wherein the mapping of the modified audio signal to the haptic signal comprises:
mapping the modified audio signal to one or more haptic signals; and
combining the one or more haptic signals into the haptic signal.

### Claim 11 (depends on 1)

The non-transitory computer-readable medium of claim 1, wherein the mapping of the modified audio signal to the haptic signal comprises modifying the haptic signal based on one or more characteristics of the actuator.

### Claim 12 (depends on 11)

The non-transitory computer-readable medium of claim 11, wherein the modifying of the haptic signal comprises filtering the haptic signal.

### Claim 13 (depends on 11)

The non-transitory computer-readable medium of claim 11, wherein the mapping of the haptic signal is based on a dynamic range, a frequency response, an amplitude, or a physical location of the actuator.

### Claim 14 (depends on 1)

The non-transitory computer-readable medium of claim 1, wherein the pre-processing of the audio signal enables vibrotactile feedback for foreground events.

### Claim 15 (depends on 1)

The non-transitory computer-readable medium of claim 1, wherein the pre-processing of the audio signal reduces vibrotactile feedback for background events.

### Claim 16 (depends on 1)

The non-transitory computer-readable medium of claim 1, further comprising mapping the haptic signal to the actuator based on one or more characteristics of the actuator.

### Claim 17 (depends on 1)

The non-transitory computer-readable medium of claim 1, wherein the one or more characteristics of the actuator include a dynamic range, a frequency response, an amplitude, or a physical location of the actuator.

### Claim 18 (depends on 1)

The non-transitory computer-readable medium of claim 1, wherein the sending of the haptic signal to the actuator comprises sending the haptic signal to a haptic effect player, wherein the haptic effect player sends the haptic signal to the actuator to generate the one or more haptic effects.

### Claim 19

A computer-implemented method for generating a haptic signal, comprising:
receiving an audio signal;
pre-processing the audio signal by modifying the audio signal to create a modified audio signal;
mapping the modified audio signal to a haptic signal; and
sending the haptic signal to an actuator to generate one or more haptic effects

### Claim 20

A haptic signal generation system comprising:
a memory configured to store a haptic module;
a processor configured to execute the haptic module stored on the memory; and
an actuator configured to output one or more haptic effects;
wherein the haptic module is configured to:
receive an audio signal;
pre-process the audio signal by modifying the audio signal to create a modified audio signal;
map the modified audio signal to a haptic signal; and
send the haptic signal to the actuator to generate the one or more haptic effects.
