# US 12,182,331 B1 · Apparatus and method for developmental and/or rehabilitative sensory substitution > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,182,331 B1 - Document ID: US12182331B1 - Status: Granted - Kind: B1 - Application number: 18/474,537 - Filed: 2023-09-26 - Granted: 2024-12-31 - Earliest claimed: 2021-09-07 - Assignees: University of North Florida Board of Trustees - Applicants: Juan Aceros; Matthew Cantwell; John Prisco - Inventors: Juan Aceros; Matthew Cantwell; John Prisco - Web page: https://patentgrep.com/patent/US12182331B1 ## CPC - G06F 3/016: {Input arrangements with force or tactile feedback as computer generated output to the user} - G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)} - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) ## Abstract Described herein relates to an apparatus and method for developmental and/or rehabilitative sensory substitution to augment at least one low-functioning and/or non-functioning senses in at least one user. The apparatus may include an input module that may allow the user to perform various tasks designed to enhance development of or sensory recognition by the user. The apparatus may be capable of multiple different proportional controls and of being used across ages, sizes, and developmental stages. For example, the apparatus may include at least one joystick, button, lever, and accelerometer, such that a sensory feedback response (e.g., haptic/tactile, visual, and/or auditory) may be provided to the user across a plurality of exercises. Additionally, the apparatus may provide a new standard of care for individuals with special needs and/or those recovering from a traumatic physical and/or mental injury, regardless of ability level and age. ## Claims ### Claim 1 A sensory substitution apparatus for augmenting a low-functioning sense, a non-functioning sense, or both, of a user, the sensory substitution apparatus comprising: a processor; an input module communicatively coupled to the processor, the input module comprising at least one interface, wherein the at least one interface is configured to detect an engagement of the user, whereby responsive to an engagement of the user, the input module is configured to produce at least one signal; an output module communicatively coupled to the processor, wherein the output module is configured to provide a sensory feedback response to a user; wherein responsive to receiving the at least one signal from the input module, the processor is configured to activate the output module, whereby the output module provides the sensory feedback response proportional to the engagement of the user; wherein an electric current supplied to the output module is configured to increase or decrease, in real-time, in direct response to changes in the engagement of the user with the at least one interface; and wherein the sensory feedback response augments the low-functioning sense, the non-functioning sense, or both, of the user. ### Claim 2 (depends on 1) The sensory substitution apparatus of claim 1, further comprising: a housing, wherein the processor is configured to be disposed within the housing. ### Claim 3 (depends on 2) The sensory substitution apparatus of claim 2, wherein the housing further comprises a first end and a second end, whereby a first handle is disposed at the first end and a second handle is disposed at the second end. ### Claim 4 (depends on 3) The sensory substitution apparatus of claim 3, wherein the output module further comprises at least one haptic motor disposed within the first handle, the second handle, or both, and wherein responsive to the output module being activated, the at least one haptic motor, via the first handle, the second handle, or both, respectively, is configured to output the sensory feedback response to the user. ### Claim 5 (depends on 4) The sensory substitution apparatus of claim 4, wherein the input module comprises at least one sensor, whereby the at least one sensor is configured to detect a normal distance of the housing with respect to the user, a predefined area, or both. ### Claim 6 (depends on 5) The sensory substitution apparatus of claim 5, wherein the engagement of the user with the at least one interface comprises changes in the normal distance between the housing and the user, the predefined area, or both, as the user translates the housing from a first predetermined location toward a second predetermined location. ### Claim 7 (depends on 2) The sensory substitution apparatus of claim 2, wherein the at least one interface comprises a surface configured to be touched by the user. ### Claim 8 (depends on 2) The sensory substitution apparatus of claim 2, wherein the input module is selected from a group consisting of a button, a handle, a joystick, a sensor, a microphone, a wheel, a yoke, a handle, and a combination of thereof. ### Claim 9 (depends on 1) The sensory substitution apparatus of claim 1, wherein the output module is selected from a group consisting of at least one light, at least one light array, at least one haptic motor, a fan, an audio-based device, and a combination of thereof. ### Claim 10 A sensory substitution apparatus for augmenting a low-functioning sense, a non-functioning sense, or both, of a user, the sensory substitution apparatus comprising: a housing comprising a processor; an input module communicatively coupled to the processor, the input module comprising at least one interface, wherein the at least one interface is configured to detect an engagement of the user, whereby responsive to an engagement of the user, the input module is configured to produce at least one signal; an output module communicatively coupled to the processor, the output module comprising at least one light; wherein responsive to receiving the at least one signal from the input module, the processor is configured to activate the output module; wherein responsive to the output module being activated, the at least one light is configured to output the sensory feedback response proportional to the engagement of the user; wherein an electric current supplied to the output module is configured to increase or decrease, in real-time, in direct response to changes in the engagement of the user with the at least one interface; and wherein the sensory feedback response augments the low-functioning sense, the non-functioning sense, or both, of the user, thereby optimizing development, rehabilitation, or both, of the low-functioning sense, the non-functioning sense, or both of the user. ### Claim 11 (depends on 10) The sensory substitution apparatus of claim 10, wherein the housing further comprises a first end and a second end, whereby a first handle is disposed at the first end and a second handle is disposed at the second end. ### Claim 12 (depends on 11) The sensory substitution apparatus of claim 11, further comprising an input module configured to be selectively coupled to the housing, the input module comprising at least one interface, wherein the interface is configured to detect an engagement of the user, whereby responsive to the engagement of the user, the input module is configured produce at least one signal. ### Claim 13 (depends on 12) The sensory substitution apparatus of claim 12, wherein the input module comprises at least one sensor, whereby the at least one sensor is configured to detect a normal distance of the housing with respect to the user, a predefined area, or both. ### Claim 14 (depends on 12) The sensory substitution apparatus of claim 12, wherein an electric current supplied to the output module is configured to increase or decrease in response to changes in the normal distance between the housing and the user, the predefined area, or both, as the user translates the housing from a first predetermined location toward a second predetermined location. ### Claim 15 (depends on 12) The sensory substitution apparatus of claim 12, wherein the at least one interface comprises a surface configured to be touched by the user. ### Claim 16 (depends on 10) The sensory substitution apparatus of claim 10, wherein the at least one light is configured to be temporarily affixed to at least one portion of the housing. ### Claim 17 A method of producing a sensory substitution apparatus for augmenting a low-functioning sense, a non-functioning sense, or both, of a user, the method comprising: providing a processor; communicatively coupling an input module to the processor, wherein the input module comprises at least one interface, and wherein the at least one interface is configured to detect an engagement of the user, whereby responsive to an engagement of the user, the input module is configured to produce at least one signal; communicatively coupling an output module to the processor, wherein the output module is configured to provide a sensory feedback response to a user; wherein responsive to receiving the at least one signal from the input module, the processor is configured to activate the output module, whereby the output module provides the sensory feedback response proportional to the engagement of the user; and wherein an electric current supplied to the output module is configured to increase or decrease, in real-time, in direct response to changes in the engagement of the user with the at least one interface. ### Claim 18 (depends on 17) The method of claim 17, wherein the at least one interface comprises a surface configured to be touched by the user. ### Claim 19 (depends on 17) The method of claim 17, wherein the input module is selected from a group consisting of a button, a joystick, a sensor, a microphone, a wheel, a yoke, a handle, and a combination of thereof.