# US 2019/0379976 A1 · Systems and methods for using multiple actuators for enhanced user experience

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0379976 A1
- Document ID: US20190379976A1
- Status: Published application
- Kind: A1
- Application number: 16/435,349
- Filed: 2019-06-07
- Published: 2019-12-12
- Earliest claimed: 2018-06-07
- Assignees: Lofelt GmbH
- Applicants: Lofelt GmbH
- Inventors: Gwydion ap Dafydd; Daniel Büttner; Sebastian Roos
- Web page: https://patentgrep.com/patent/US20190379976A1

## CPC

- G06N 7/02: using fuzzy logic (computing arrangements based on biological models G06N3/00; computing arrangements using knowledge-based models G06N5/00)
- G08B 6/00: Tactile signalling systems, e.g. tactile personal calling systems
- G06F 3/016: {Input arrangements with force or tactile feedback as computer generated output to the user}
- G06N 3/044: Recurrent networks, e.g. Hopfield networks
- G06N 3/045: Combinations of networks
- G06N 3/0464: Convolutional networks [CNN, ConvNet]
- G06N 3/047: Probabilistic or stochastic networks
- G06N 3/065: Analogue means
- G06N 3/08: Learning methods
- G06N 3/088: Non-supervised learning, e.g. competitive learning
- G06N 3/09: Supervised learning
- G06N 20/20: Ensemble learning
- G10H 1/0091: {Means for obtaining special acoustic effects (combined with modulation G10H1/043)}
- G10H 1/12: by filtering complex waveforms (G10H1/14, G10H1/16 take precedence)
- G10H 1/46: Volume control
- H03G 3/3005: {in amplifiers suitable for low-frequencies, e.g. audio amplifiers (H03G3/32, H03G3/34 take precedence)}
- H03G 9/14: for gain control and tone control
- H04R 1/1008: {Earpieces of the supra-aural or circum-aural type}
- H04R 1/1075: {Mountings of transducers in earphones or headphones}
- H04R 5/033: Headphones for stereophonic communication {(details thereof, e.g. relating to batteries, cables or control elements H04R1/10)}
- H04R 5/04: Circuit arrangements, {e.g. for selective connection of amplifier inputs/outputs to loudspeakers, for loudspeaker detection, or for adaptation of settings to personal preferences or hearing impairments (combinations of amplifiers H03F3/68; stereophonic systems H04S)}
- G06N 5/01: Dynamic search techniques; Heuristics; Dynamic trees; Branch-and-bound
- G06N 7/01: Probabilistic graphical models, e.g. probabilistic networks
- G06N 20/10: using kernel methods, e.g. support vector machines [SVM]
- G10H 2210/281: Reverberation or echo
- G10H 2210/315: Dynamic effects for musical purposes, i.e. musical sound effects controlled by the amplitude of the time domain audio envelope, e.g. loudness-dependent tone colour or musically desired dynamic range compression or expansion
- G10H 2220/311: with controlled tactile or haptic feedback effect; output interfaces therefor
- G10H 2250/025: Envelope processing of music signals in, e.g. time domain, transform domain or cepstrum domain
- H03G 5/165: {Equalizers; Volume or gain control in limited frequency bands}
- H04R 3/04: for correcting frequency response
- H04R 2205/022: Plurality of transducers corresponding to a plurality of sound channels in each earpiece of headphones or in a single enclosure
- H04R 2400/03: Transducers capable of generating both sound as well as tactile vibration, e.g. as used in cellular phones
- H04R 2430/03: Synergistic effects of band splitting and sub-band processing
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G08B: SIGNALLING SYSTEMS, e.g. PERSONAL CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G10H: ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
- H03G: CONTROL OF AMPLIFICATION
- H04R: LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS (producing sounds with frequency not determined by supply frequency G10K)

## Abstract

Systems and methods for generating a haptic output from an audio signal having a continuous stream of sampled digital audio data are provided. A haptic processing system receives the digital audio data, analyses the digital audio data for processing and extracts haptic signals for generating a haptic effect through an actuator. The method includes passing the digital audio signal on through dynamic processor(s), adjusting the dynamic range of the digital audio signal, extracting the signal envelope of the audio data, synthesising low-frequency signals from the extracted signal envelope, and enhancing the low-frequency content using a resonator. The haptic output is generated by mixing the digital audio signal with outputs from the different modules of the haptic processing system. An analytics module monitors, controls and adjusts the processing of the digital audio signal at the noise gate module, the compressor module and the envelope module to enhance the haptic output.

## Claims

### Claim 1

A method of processing haptic data from an input audio signal to produce haptic experience, the method comprising:
receiving an audio input signal simultaneously in a digital signal processing chain and an analytics processor;
processing the input audio signal in the digital signal processing chain having at least one gain control processor;
analyzing the input audio signal in the analytics processor to determine at least one control parameter;
passing the at least one control parameter to the digital signal processing chain to control the processing of the input audio signal in the at least one gain control processor;
providing the haptic output signal to one or more actuators for producing haptic experience; and
determining the haptic output based on at least one control parameter, to trigger a boost signal to drive one or more booster actuators in synchronization with the one or more actuators.

### Claim 2 (depends on 1)

The method of processing haptic data of claim 1, wherein the one or more booster actuators is triggered based on the at least one control parameter from the analytics processor and a mixer.

### Claim 3 (depends on 1)

The method of haptic processing data of claim 1, wherein the at least one control parameter is a gain.

### Claim 4 (depends on 1)

The method of haptic processing data of claim 1, wherein the at least one control parameter is a threshold.

### Claim 5 (depends on 1)

The method of haptic processing data of claim 1, wherein a booster analytics processor directly controls the trigger to drive the one or more booster actuators.

### Claim 6 (depends on 1)

The method of haptic processing data of claim 1, wherein the one or more actuators are configured in a stereo arrangement with a left digital signal processing chain and a left actuator, a right digital signal processing chain and a right actuator, and at least one of the one or more booster actuators.

### Claim 7 (depends on 1)

The method of haptic processing data of claim 1, wherein the one or more actuators are configured in a quadraphonic arrangement with a left digital signal processing chain having at least two left actuators, a right digital signal process chain and having at least two right actuators, and at least one of the one or more booster actuators.

### Claim 8

A haptic processing system for generating haptic output from an input audio signal to produce haptic experience, the haptic processing system comprising:
a digital signal processing chain having at least one gain control processor coupled to one or more actuators and to one or more booster actuators;
an analytics processor comprising:
a peak analyzer to calculate an instantaneous peak value;
an RMS signal generator to calculate an instantaneous RMS value;
a predictive and intelligence processor configured to determine at least one instantaneous control parameter using the instantaneous peak value and the instantaneous RMS value for controlling the haptic processing in the digital signal processing chain;
a boost controller configured to drive the one or more booster actuators to provide a boost to the one or more actuators based on the at least one instantaneous control parameter, wherein the one or more booster actuators operate in synchronization with the one or more actuators.

### Claim 9 (depends on 8)

The haptic processing system of claim 8, wherein the one or more booster actuators is triggered based on the at least one control parameter from the analytics processor and the mixer.

### Claim 10 (depends on 8)

The haptic processing system of claim 8, wherein the at least one control parameter is a gain.

### Claim 11 (depends on 8)

The haptic processing system of claim 8, wherein the at least one control parameter is a threshold.

### Claim 12 (depends on 8)

The haptic processing system of claim 8, wherein the one or more actuators are configured in a stereo arrangement with a left digital signal processing chain and one or more left actuators, a right digital signal processing chain and one or more right actuators, and at least one of the one or more booster actuators.

### Claim 13 (depends on 8)

The haptic processing system of claim 8, wherein the one or more actuators are configured in a quadraphonic arrangement with a left digital signal processing chain and at least two left actuators, a right digital signal processing chain and at least two right actuators, and at least one of the one or more booster actuators.

### Claim 14

A computer program product having encoded instructions embodied therein, when executed by a processor performs the steps to produce a haptic experience from an input audio signal, the steps comprising:
receiving the input audio signal simultaneously in a digital signal processing chain and an analytics processor;
processing the input audio signal in the digital signal processing chain having one or more gain control processors, one or more actuators, and one or more booster actuators;
determining an instantaneous peak value and an instantaneous RMS value of the input audio signal to calculate at least one control parameter to be applied to at least one gain control processor; and
sending an output signal to a mixer and a boost controller to produce the haptic output, wherein the haptic output is generated by the one or more actuators, and the boost controller triggers at least one booster actuator of the one or more booster actuators based on the at least one control parameter to provide a boost to haptic output in synchronization with the one or more actuators.

### Claim 15 (depends on 14)

The method of processing haptic data of claim 14, wherein the one or more booster actuators is triggered based on the at least one control parameter from the analytics processor and the mixer.

### Claim 16 (depends on 14)

The computer program product of claim 14, wherein the at least one control parameter is a gain.

### Claim 17 (depends on 14)

The computer program product of claim 14, wherein the at least one control parameter is a threshold.

### Claim 18 (depends on 14)

The computer program product of claim 14, wherein the one or more actuators are configured in a stereo arrangement with a left digital signal processing chain and one or more left actuators, a right digital signal processing chain and one or more right actuators, and at least one of the one or more booster actuators.

### Claim 19 (depends on 14)

The computer program product of claim 14, wherein the one or more actuators are configured in a quadraphonic arrangement with a left digital signal processing chain and at least two left actuators, a right digital signal processing chain and at least two right actuators, and at least one of the one or more booster actuators.
