# US 2019/0378384 A1 · Systems and methods for Designing Haptics Using Speech Commands

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0378384 A1
- Document ID: US20190378384A1
- Status: Published application
- Kind: A1
- Application number: 16/437,580
- Filed: 2019-06-11
- Published: 2019-12-12
- Earliest claimed: 2018-06-11
- Assignees: Immersion Corporation
- Applicants: Immersion Corporation
- Inventors: Jamal Saboune; Juan Manuel Cruz-Hernandez
- Web page: https://patentgrep.com/patent/US20190378384A1

## CPC

- G08B 6/00: Tactile signalling systems, e.g. tactile personal calling systems
- G06F 3/167: {Audio in a user interface, e.g. using voice commands for navigating, audio feedback}
- G10L 15/22: Procedures used during a speech recognition process, e.g. man-machine dialogue
- G10L 2015/223: {Execution procedure of a spoken command}
- G08B: SIGNALLING SYSTEMS, e.g. PERSONAL CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING

## Abstract

Systems and methods for designing haptics using speech commands are disclosed. One illustrative system described herein includes: a processor configured to: receive an audio signal from an audio capture device, the audio signal associated with vocal user interaction; determine a haptic effect based in part on the audio signal, the haptic effect configured to be output by a haptic output device; and store the haptic effect on a data store.

## Claims

### Claim 1

A system comprising:
a haptic output device;
a processor coupled to the haptic output device and configured to:
receive an audio signal from an audio capture device, the audio signal comprising sounds mimicking a desired haptic effect;
determine a haptic signal based in part on the sounds; and
output the haptic signal to the haptic output device.

### Claim 2 (depends on 1)

The system of claim 1, wherein determining the haptic signal further comprises receiving a signal associated with a preexisting haptic effect and modifying the signal to match the desired haptic effect.

### Claim 3 (depends on 1)

The system of claim 1, wherein the audio signal further comprises a spoken word.

### Claim 4 (depends on 2)

The system of claim 2, wherein the spoken word is a characteristic of the desired haptic effect, and wherein determining the haptic signal further comprises determining the haptic signal with the characteristic.

### Claim 5 (depends on 4)

The system of claim 4, wherein the characteristic comprises one or more of: a wave shape, a frequency, an intensity, a type, or a duration.

### Claim 6 (depends on 2)

The system of claim 2, wherein the spoken word comprises a concept associated with the desired haptic effect, and wherein determining the haptic signal further comprises searching a database comprising data associated with a plurality of haptic effects for a stored haptic effect associated with the concept.

### Claim 7 (depends on 1)

The system of claim 1, wherein the processor is further configured to store the haptic effect in a data store

### Claim 8 (depends on 7)

The system of claim 7, wherein the processor is further configured to receive an input signal associated with user interaction confirming the haptic effect prior to storing the haptic effect on the data store.

### Claim 9 (depends on 1)

The system of claim 1, wherein the haptic output device comprises one or more of: a piezoelectric actuator, an electric motor, an electro-magnetic actuator, a voice coil, a shape memory alloy, an electro-active polymer, a solenoid, an eccentric rotating mass motor (ERM), or a linear resonant actuator (LRA).

### Claim 10

A method comprising:
receiving an audio signal from an audio capture device, the audio signal comprising sounds mimicking a desired haptic effect;
determining a haptic signal based in part on the sounds; and
outputting the haptic signal to a haptic output device.

### Claim 11 (depends on 10)

The method of claim 10, wherein determining the haptic signal further comprises receiving a signal associated with a preexisting haptic effect and modifying the signal to match the desired haptic effect.

### Claim 12 (depends on 10)

The method of claim 10, wherein the audio signal further comprises a spoken word.

### Claim 13 (depends on 11)

The method of claim 11, wherein the spoken word comprises a description of a characteristic of the desired haptic effect, and wherein determining the haptic signal further comprises determining the haptic signal with the characteristic.

### Claim 14 (depends on 13)

The method of claim 13, wherein the characteristic comprises one or more of: a wave shape, a frequency, an intensity, a type, or a duration.

### Claim 15 (depends on 11)

The method of claim 11, wherein the spoken word comprises a concept associated with the desired haptic effect, and wherein determining the haptic signal further comprises searching a database comprising data associated with a plurality of haptic effects for a stored haptic effect associated with the concept.

### Claim 16 (depends on 10)

The method of claim 10, further comprising storing the haptic effect in a data store

### Claim 17 (depends on 16)

The method of claim 16, further comprising receiving an input signal associated with user interaction confirming the haptic effect prior to storing the haptic effect on the data store.

### Claim 18

A non-transitory computer readable medium comprising program code, which when executed by a processor is configured to cause the processor to:
receive an audio signal from an audio capture device, the audio signal comprising sounds mimicking a desired haptic effect;
determine a haptic signal based in part on the sounds; and
output the haptic signal to a haptic output device.

### Claim 19 (depends on 18)

The non-transitory computer readable medium of claim 18, wherein the audio signal further comprises a spoken word.

### Claim 20 (depends on 19)

The non-transitory computer readable medium of claim 19, wherein the spoken word comprises a characteristic of the desired haptic effect, and wherein determining the haptic signal further comprises determining the haptic signal with the characteristic.
