# US 10,455,320 B2 · System, method and apparatus for translating, converting and/or transforming audio energy into haptic and/or visual representation > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 10,455,320 B2 - Document ID: US10455320B2 - Status: Granted - Kind: B2 - Application number: 16/051,073 - Filed: 2018-07-31 - Published: 2019-02-07 - Granted: 2019-10-22 - Earliest claimed: 2017-08-02 - Assignees: Body Beats, LLC - Applicants: Brandon Ralph - Inventors: Brandon Ralph - Web page: https://patentgrep.com/patent/US10455320B2 ## CPC - H04R 1/222: {for microphones (H04R1/24, H04R1/26 take precedence)} - B06B 1/06: operating with piezoelectric effect or with electrostriction (piezoelectric or electrostrictive devices per se H10N30/00) - G02F 1/0121: {Operation of devices; Circuit arrangements, not otherwise provided for in this subclass} - G06F 3/016: {Input arrangements with force or tactile feedback as computer generated output to the user} - H04R 1/028: {associated with devices performing functions other than acoustics, e.g. electric candles} - H04R 1/04: Structural association of microphone with electric circuitry therefor (in electric hearing aids H04R25/00) - H04R 1/2807: {Enclosures comprising vibrating or resonating arrangements (for the reduction of undesired resonances or vibrations H04R1/2869)} - B06B 1/04: operating with electromagnetism (dynamo-electric motors with vibrating magnet, armature or coil system H02K33/00) - G06F 1/163: {Wearable computers, e.g. on a belt} - H04R 3/00: Circuits for transducers (arrangements for producing a reverberation or echo sound G10K15/08; amplifiers H03F) - H04R 19/04: Microphones (H04R19/01 takes precedence) - H04R 2201/023: Transducers incorporated in garment, rucksacks or the like - H04R: LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS (producing sounds with frequency not determined by supply frequency G10K) - B06B: METHODS OR APPARATUS FOR GENERATING OR TRANSMITTING MECHANICAL VIBRATIONS OF INFRASONIC, SONIC, OR ULTRASONIC FREQUENCY, {e.g.} FOR PERFORMING MECHANICAL WORK IN GENERAL (for particular applications, see the relevant subclasses, e.g. B07B1/40, B23Q17/12, B24B31/06; measurement of mechanical vibrations G01H; in direction finding, locating, distance or velocity measuring G01S; {generating seismic energy G01V1/02}; control of mechanical vibrations in general G05D; sound-producing devices, e.g. bells, sirens, whistles G10K, {e.g. methods or devices for transmitting, conducting, or directing sound in general G10K11/00}; generation of electrical oscillations H03B; electromechanical resonators in general H03H; electromechanical transducers {for communication techniques, e.g. microphones, speakers} H04R) - G02F: OPTICAL DEVICES OR ARRANGEMENTS FOR THE CONTROL OF LIGHT BY MODIFICATION OF THE OPTICAL PROPERTIES OF THE MEDIA OF THE ELEMENTS INVOLVED THEREIN; NON-LINEAR OPTICS; FREQUENCY-CHANGING OF LIGHT; OPTICAL LOGIC ELEMENTS; OPTICAL ANALOGUE/DIGITAL CONVERTERS - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) ## Abstract A device can be worn by a user and can include a microphone to analyze music and other sound in the surrounding environment. In one embodiment, the device can translate audio into a haptic and/or light of the sound's or music's bassline, in real-time. In one embodiment, no music is recorded by the device. The haptic or vibrational representation of the music can be generated by a motor. In some examples, the light representation of the music can be generated via a red/green/blue light emitting diode. ## Claims ### Claim 1 A system for translating, converting or transforming audio energy into at least one haptic and visual representation, comprising: a microphone that converts a plurality of physical sound waves into an output signal; a plurality of first filters that smooth frequencies of the output signal in an audible range; a second filter that attenuates frequencies of the output signal in the audible range above a predetermined frequency; a processor; and a memory operatively coupled to the processor and having computer readable instructions stored thereon which, when executed by the processor, causes the processor to: apply a moving window across a plurality of time intervals that comprise the output signal to measure a plurality of power values from the plurality of time intervals that comprise the output signal; calculate a minimum average power value and a maximum average power value across the plurality of time intervals; apply a linear compression and a non-linear compression that scale the output signal to a normalized range that falls within a one-byte range; and render a plurality of visual outputs and a haptic output in response to the normalized range. ### Claim 2 (depends on 1) The system of claim 1, wherein at least one the plurality of first filters allows all frequencies below a predetermined frequency to pass through it. ### Claim 3 (depends on 1) The system of claim 1, wherein the visual output is based on the minimum average power value and the maximum average power value. ### Claim 4 (depends on 1) The system of claim 1, wherein the haptic output and visual output is rendered in real-time. ### Claim 5 (depends on 1) The system of claim 1, further comprising a wearable device, wherein the microphone, the processor and the memory are housed in the wearable device. ### Claim 6 A system, comprising: a non-transitory computer-readable medium having a computer-readable code stored thereon that, when executed by one or more computing devices, causes the one or more computing devices to: receive audio input through a microphone of a wearable device; and translate, convert or transform signals representing the received audio input to one or more visual representations or haptic representations produced by the wearable device by: applying a moving window across a plurality of time intervals of an output signal to render a plurality of root mean square average power values within the plurality of time intervals; calculate a minimum root mean square average power value and a maximum root mean square average power value across the plurality of time intervals that comprise an entire received audio input; and apply a digital linear compression above a predetermined threshold and a digital non-linear digital compression below the predetermined threshold that scale the plurality of root mean square average power values to a normalized digital range of a byte. ### Claim 7 (depends on 6) The system of claim 6, wherein the translating, converting or transforming includes processing the received audio input as at least one digital signal and applying a low pass filter to the at least one digital signal. ### Claim 8 (depends on 6) The system of claim 6, wherein the one or more representations comprise the haptic representations. ### Claim 9 (depends on 6) The system of claim 6, wherein the one or more representations comprise the visual representations. ### Claim 10 (depends on 6) The system of claim 6, wherein the one or more representations comprise the haptic representations and the visual representations. ### Claim 11 An apparatus comprising: a microphone configured to receive audio input from a surrounding environment and render an electrical output signal; an output device; and a processor in communication with the microphone and the output device, the processor being configured to translate the audio input into one or more representations that are manifested by the output device to the surrounding environment by: applying a moving window across a plurality of time intervals of the electrical output signal to measure an average power value within each time interval of the plurality of time intervals; calculate a minimum average power value and a maximum average power value across the plurality of time intervals; and apply a linear digital compression when the average power value is above a predetermined threshold and a non-linear digital compression when an average power value is below the predetermined threshold to scale the average power value to a normalized digital range of an-eight bit range. ### Claim 12 (depends on 11) The apparatus of claim 11, wherein the output device comprises a motor including at least one of a haptic eccentric rotating mass motor, a linear haptic motor, and a piezo haptic motor. ### Claim 13 (depends on 11) The apparatus of claim 11, wherein the audio input is music received in the surrounding environment, and wherein the one or more representations are haptic representations of a music bassline. ### Claim 14 (depends on 13) The apparatus of claim 13, wherein the processor renders a haptic response through the output device and wherein the haptic response changes in intensity or frequency in response to changes in the received audio input. ### Claim 15 (depends on 11) The apparatus of claim 11, wherein the audio input comprises music received in the surrounding environment and the output device comprises a light emitting diode, and wherein the one or more representations comprise light representations of a music bassline. ### Claim 16 (depends on 15) The apparatus of claim 15, wherein the light representations change in color, frequency or intensity in response to changes in the received audio input. ### Claim 17 An apparatus comprising: a microphone configured to receive audio input; an output device; and a processor in communication with the microphone and a motor, the processor configured to process the received audio input and to direct rotational movement of a motor based on the processing that: apply a moving window across a plurality of time intervals of the output signal to measure an average power value within each time interval of the plurality of time intervals of the received audio input; calculate a first boundary based on a minimum average power value and a second boundary based on a maximum average power value measured across the plurality of time intervals; and apply a linear digital compression above a predetermined threshold and a non-linear digital compression below the predetermined threshold that assign each average power value of the received audio input to a range within the first boundary and the second boundary; and render a modulated output processed to generate a visual output and a haptic output in response to the assignment of each average power value within the range between the first boundary and the second boundary; where the range between the first boundary and the second boundary is restricted to a one-byte range. ### Claim 18 (depends on 17) The apparatus of claim 17, where the apparatus is wearable by a user. ### Claim 19 (depends on 17) The apparatus of claim 17, where the output device comprises at least one of a haptic motor, an eccentric rotating mass motor, a linear haptic motor, and a piezo haptic motor. ### Claim 20 (depends on 17) The apparatus of claim 17, wherein the output device comprises a light emitting diode.