Haptic communication using dominant frequencies in speech signal
AssigneeFacebook, Inc.
InventorRobert Turcott
Life of this patent
Estimating the term…
Abstract
Embodiments relate to performing haptic communication using frequency decomposition of speech where dominant frequencies of a speech is detected at a speech source and then sent to a signal generator to actuate actuators mapped to the dominant frequencies. The digitized version of the speech is segmented into a plurality of frames and then a predetermined number of dominant frequencies are detected from each frame. The dominant frequencies of frequencies are sent over to the signal generator so that the actuators corresponding to the dominant frequencies are activated for a time period corresponding to the frame.
Claims17
A method, comprising:
- generating a digitized version of a speech signal;
- processing the digitized speech signal to generate processed speech signal by:
- at least segmenting the digitized signal into frames, each of the frames having a predetermined length, and
- performing spectral estimation on each of the frames to generate a frequency domain spectrum;
- detecting dominant frequencies in the processed speech signal in each of the frames by at least determining a first dominant frequency at which a magnitude of the frequency domain spectrum is highest, to generate dominant frequency information;
- and
- providing the detected dominant frequencies to generate actuator signals for activating cutaneous actuators on a receiving user's skin.
A haptic system comprising:
- an analog-to-digital converter configured to generate a digitized version of a speech signal;
- a frequency decomposition encoder configured to:
- process the digitized speech signal to generated processed speech signal by (i) at least segmenting the digitized signal into frames, each of the frames having a predetermined length, and (ii) performing spectral estimation on each of the frames to generate a frequency domain spectrum, and
- detect dominant frequencies in the processed speech signal in each of the frames by at least determining a first dominant frequency at which a magnitude of the frequency domain spectrum is highest, to generate dominant frequency information;
- and
- a communication module configured to provide the detected dominant frequencies to generate actuator signals for activating cutaneous actuators on a receiving user's skin.
A non-transitory computer-readable storage medium storing instructions, the instructions when executed by a processor cause the processor to:
- generate a digitized version of a speech signal;
- process the digitized speech signal to generate processed speech signal by (i) at least segmenting the digitized signal into frames, each of the frames having a predetermined length and (ii) performing spectral estimation on each of the frames to generate a frequency domain spectrum;
- detect dominant frequencies in the processed speech signal in each of the frames by at least determining a first dominant frequency at which a magnitude of the frequency domain spectrum is highest, to generate dominant frequency information;
- and
- provide the detected dominant frequencies to generate actuator signals for activating cutaneous actuators on a receiving user's skin.
Dependencies are inferred from the claim text.