Free-space human interface for interactive music, full-body musical instrument, and immersive media controller

Abstract

“Method and apparatus entraining interactive media players into a sustained experience of “Kinesthetic Spatial Sync,” defined as a perceived simultaneity and spatial superposition between a non-tactile, full body (“free-space”) input control process and immersive multisensory feedback. Asynchronous player input actions and (MIDI tempo) clock-synchronous media feedback events exhibit a seamless synesthesia1 or multisensory events fused into an integral event perception, this being between musical sound (hearing), visual responses (sight), and body kinesthetic (radial extension, angular position, height, speed, timing, and precision). This non-tactile interface process and multisensory feedback “look and feel” is embodied as an optimal ergonomic human interface for interactive music and as a six-degrees-of-freedom full-body-interactive immersive media controller. The invention provides for a wide scope of fully reconfigurable transfer functions between kinesthetic input features and media responses (“Creative Zone Behaviors”) managed by means of MIDI protocol and/or display interface commands. Alternative forms of optomechanical embodiments are disclosed, including floor Platform systems and floor-stand-mounted Console systems, all of which exhibit identical free-space input and integrated media response paradigms.”

Dependencies are inferred from the claim text.