# US 11,308,925 B2 · System and method for creating a sensory experience by merging biometric data with user-provided content > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 11,308,925 B2 - Document ID: US11308925B2 - Status: Granted - Kind: B2 - Application number: 16/872,940 - Filed: 2020-05-12 - Published: 2020-11-19 - Granted: 2022-04-19 - Earliest claimed: 2019-05-13 - Applicants: Paul Senn - Inventors: Paul Senn - Web page: https://patentgrep.com/patent/US11308925B2 ## CPC - G10H 1/0008: {Associated control or indicating means} - G10H 1/0066: {using a MIDI interface} - G06F 3/015: {Input arrangements based on nervous system activity detection, e.g. brain waves [EEG] detection, electromyograms [EMG] detection, electrodermal response detection} - G06F 3/017: {Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883)} - G10H 1/46: Volume control - G10L 19/02: using spectral analysis, e.g. transform vocoders or subband vocoders - H04R 5/033: Headphones for stereophonic communication {(details thereof, e.g. relating to batteries, cables or control elements H04R1/10)} - H04R 5/04: Circuit arrangements, {e.g. for selective connection of amplifier inputs/outputs to loudspeakers, for loudspeaker detection, or for adaptation of settings to personal preferences or hearing impairments (combinations of amplifiers H03F3/68; stereophonic systems H04S)} - G10H 2210/031: Musical analysis, i.e. isolation, extraction or identification of musical elements or musical parameters from a raw acoustic signal or from an encoded audio signal - G10H 2210/525: Diatonic scales, e.g. aeolian, ionian or major, dorian, locrian, lydian, mixolydian, phrygian, i.e. seven note, octave-repeating musical scales comprising five whole steps and two half steps for each octave, in which the two half steps are separated from each other by either two or three whole steps - G10H 2210/555: Tonality processing, involving the key in which a musical piece or melody is played - G10H 2220/376: using brain waves, e.g. EEG - G10H 2240/056: MIDI or other note-oriented file format - G10H 2240/131: Library retrieval, i.e. searching a database or selecting a specific musical piece, segment, pattern, rule or parameter set - G10H: ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING - H04R: LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS (producing sounds with frequency not determined by supply frequency G10K) ## Abstract Systems and methods are provided for using a common “vocabulary,” predefined or dynamically generated based on user-provided content, to transform biometric and/or neurometric data collected from one or more people into a coherent audio and/or visual result. One method comprises receiving a first incoming signal from a bio-generated data sensing device worn by a first user; determining a first set of output values based on the first incoming signal, a common vocabulary comprising a list of possible output values, and a parameter file comprising a set of instructions for applying the common vocabulary to the first incoming signal to derive the first set of output values; generating a first output array comprising the first set of output values; and providing the first output array to an output delivery system configured to render the first output array as a first audio and/or visual output. ## Claims ### Claim 1 A method of creating a coherent output based on biometric and/or neurometric data using a computing device comprising one or more processors and memory, comprising: receiving a first incoming signal from a bio-generated data sensing device worn by a first user; receiving, from an input system, a first input signal representing audio and/or visual content experienced by the first user during receipt of the first incoming signal; identifying one or more aspects of the first input signal using a spectral analyzer; using the one or more processors, populating a common vocabulary with one or more values determined based on the one or more identified aspects; determining, using the one or more processors, a first set of output values based on the first incoming signal, the common vocabulary stored in the memory, and a parameter file stored in the memory, the common vocabulary comprising a list of possible output values, and the parameter file comprising a set of instructions for applying the common vocabulary to the first incoming signal to derive the first set of output values; generating, using the one or more processors, a first output array comprising the first set of output values; and providing the first output array to an output delivery system configured to render the first output array as a first audio and/or visual output. ### Claim 2 (depends on 1) The method of claim 1, wherein the first set of output values comprises output values corresponding to at least a first variable and a second variable, and determining the first set of output values comprises: selecting a first output value from the list of possible output values for the first variable based on a frequency band of the first incoming signal and the parameter file, and selecting a second output value from the list of possible output values for the second variable based on a power level of the first incoming signal and the parameter file. ### Claim 3 (depends on 2) The method of claim 2, wherein the first and second variables are configured to control rendering of an audio output, the first variable being pitch and the second variable being velocity. ### Claim 4 (depends on 2) The method of claim 2, wherein the first and second variables are configured to control rendering of a visual output. ### Claim 5 (depends on 1) The method of claim 1, wherein the one or more aspects include a frequency component and a power component. ### Claim 6 (depends on 5) The method of claim 5, wherein the one or more values include a pitch value determined based on the frequency component and a velocity value determined based on the power component. ### Claim 7 (depends on 5) The method of claim 5, wherein the one or more values includes a shape value and a color value determined based on the frequency component and an angle value determined based on the power component. ### Claim 8 (depends on 1) The method of claim 1, further comprising: receiving a second incoming signal from a second bio-generated data sensing device worn by a second user; and determining, using the one or more processors, a second set of output values based on the second incoming signal, the common vocabulary, and the parameter file; generating, using the one or more processors, a second output array comprising the second set of output values; and providing the second output array to the output delivery system. ### Claim 9 (depends on 8) The method of claim 8, wherein the first set of output values comprises a first channel value for indicating a MIDI channel assigned to the first output array associated with the first user, and the second set of output values comprises a second channel value for indicating a MIDI channel assigned to the second output array associated with the second user. ### Claim 10 (depends on 8) The method of claim 8, further comprising receiving a second input signal from the an audio/visual input system, the second input signal representing content produced by the second user. ### Claim 11 (depends on 1) The method of claim 1, further comprising: generating a feedback output array upon receiving a feedback signal from the first bio-generated data sensing device, the feedback signal being generated responsive to the first user experiencing the first audio and/or visual output, wherein the feedback output array comprises a set of output values determined based on the feedback signal, the common vocabulary, and the parameter file, and wherein the feedback output array is provided to the output delivery system for rendering the feedback output array as a second audio and/or visual output. ### Claim 12 (depends on 1) The method of claim 1, wherein the first input signal is spoken word recited by the first user for creating a hypnotic suggestion. ### Claim 13 (depends on 1) The method of claim 1, wherein the first input signal is an audio track. ### Claim 14 (depends on 1) The method of claim 1, wherein the first set of output values comprises Musical Instrument Digital Interface (“MIDI”) data. ### Claim 15 (depends on 8) The method of claim 8, wherein the output delivery system is further configured to simultaneously render the first and second output arrays as the first audio and/or video output. ### Claim 16 (depends on 10) The method of claim 10, further comprising identifying one or more aspects of the second input signal using the spectral analyzer; and additionally basing the common vocabulary on the one or more aspects of the second input signal. ### Claim 17 (depends on 14) The method of claim 14 wherein the MIDI data comprises at least one of a MIDI pitch number, a MIDI velocity number, and a MIDI channel number. ### Claim 18 A system, comprising: a first bio-generated data sensing device worn by a first user and configured to detect a first electrical signal representing biometric and/or neurometric data of the first user; a second bio-generated data sensing device worn by a second user and configured to detect a second electrical signal representing biometric and/or neurometric data of the second user; a memory configured to store a parameter file and a common vocabulary; one or more processors configured to: determine a first set of output values based on the detected signal, the common vocabulary, and the parameter file; determine a second set of output values based on the second electrical signal, the common vocabulary, and the parameter file; generate a first output array comprising the first set of output values; and generate a second output array comprising the second set of output values; and an output delivery system configured to render the first output array as a first audio and/or visual output and the second output array as the second audio and/or visual output, wherein the common vocabulary comprises a list of possible output values, and the parameter file comprises a set of instructions for applying the common vocabulary to the detected signal to derive the first set of output values. ### Claim 19 (depends on 18) The system of claim 18, wherein the first bio-generated data sensing device is a headset configured to collect electroencephalography (“EEG”) signals of the first user. ### Claim 20 (depends on 18) The system of claim 18, wherein the output delivery system comprises an audio engine configured to generate an audio output signal based on the first output array and provide said signal to an audio output device. ### Claim 21 (depends on 18) The system of claim 18, wherein the first set of output values comprises Musical Instrument Digital Interface (“MIDI”) data for generating an audio output signal. ### Claim 22 (depends on 18) The system of claim 18, wherein the output delivery system comprises a visual engine configured to generate a visual output signal based on the output array and provide said signal to a display device. ### Claim 23 (depends on 22) The system of claim 22, wherein the first set of output values corresponds to a plurality of visual variables for generating the visual output signal, the visual variables comprising geometric shape, color, and angle. ### Claim 24 (depends on 18) The system of claim 18, further comprising an input system configured to provide user-provided content to the one or more processors, and a spectral analyzer configured to identify one or more aspects of the user-provided content, wherein the one or more processors is further configured to generate the common vocabulary based on the identified aspects. ### Claim 25 (depends on 24) The system of claim 24, wherein the input system comprises a microphone configured to capture audio signals representing an audio component of the user-provided content. ### Claim 26 (depends on 24) The system of claim 24, wherein the input system comprises a camera configured to capture video signals representing a visual component of the user-provided content. ### Claim 27 (depends on 18) The system of claim 18, wherein the first set of output values comprises a first channel value for indicating a MIDI channel assigned to the first output array associated with the first user, and the second set of output values comprises a second channel value for indicating a MIDI channel assigned to the second output array associated with the second user. ### Claim 28 (depends on 18) The system of claim 18, wherein the common vocabulary comprises a pitch vocabulary for selecting different musical notes based on different frequency bands of the detected signal. ### Claim 29 (depends on 18) The system of claim 18, wherein the common vocabulary comprises a shape vocabulary for selecting different visual characteristics based on various aspects of the detected signal. ### Claim 30 (depends on 18) The system of claim 18, wherein the output delivery system is further configured to render the first output array as a first audio and/or visual output and the second output array as the second audio and/or visual output simultaneously. ### Claim 31 (depends on 24) The system of claim 24, wherein the user-provided content from which the spectral analyzer is configured to identify the one or more aspects comprises content provided by the first user and content provided by the second user. ### Claim 32 A system comprising: a first bio-generated data sensing device worn by a first user and configured to detect a first electrical signal representing biometric and/or neurometric data of the first user; a memory configured to store a parameter file and a common vocabulary; one or more processors configured to: determine a first set of output values based on the detected signal, the common vocabulary, and the parameter file; generate a first output array comprising the first set of output values; and generate a feedback output array upon receiving a feedback signal from the first bio-generated data sensing device, the feedback signal being generated responsive to the first user experiencing a first audio and/or visual output; and an output delivery system configured to render the first output array as the first audio and/or visual output; wherein the common vocabulary comprises a list of possible output values, and the parameter file comprises a set of instructions for applying the common vocabulary to the detected signal to derive the first set of output values; wherein the feedback output array comprises a set of output values determined based on the feedback signal, the common vocabulary, and the parameter file, and wherein the output delivery system is further configured to render the feedback output array as a second audio and/or visual output.