# US 10,121,388 B2 · Methods, systems, and apparatuses to convey chorded input > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 10,121,388 B2 - Document ID: US10121388B2 - Status: Granted - Kind: B2 - Application number: 14/700,102 - Filed: 2015-04-29 - Published: 2015-10-29 - Granted: 2018-11-06 - Earliest claimed: 2014-04-29 - Assignees: Georgia Tech Research Corporation - Applicants: Georgia Tech Research Corporation - Inventors: Caitlyn Seim; Thad Eugene Starner - Web page: https://patentgrep.com/patent/US10121388B2 ## CPC - G09B 19/00: Teaching not covered by other main groups of this subclass (teaching or practice apparatus for gun-aiming or gun-laying F41G3/26) - G09B 15/00: Teaching music (metronomes G04F5/02) - G09B 21/00: Teaching, or communicating with, the blind, deaf or mute (audible presentation of material to be studied G09B5/04; devices or methods for replacing direct visual or auditory perception by another kind of perception A61F9/08, A61F11/04; audible indication of meter readings or of colour G01D7/12; watches for blind persons G04B25/02; speech analysis, speech recognition G10L; sound-recording or reproducing, per se G11B) - G09B 21/001: {Teaching or communicating with blind persons (G09B21/02 - G09B21/06 take precedence)} - G09B 21/003: {using tactile presentation of the information, e.g. Braille displays} - G09B: EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS (devices for psychotechnics or for testing reaction times A61B5/16; games, sports, amusements A63; projectors, projector screens G03B) ## Abstract Disclosed herein are methods, systems, computer readable media, and apparatuses for conveying chorded input to a user. Chorded input can be conveyed by one or more sequences of stimulation events, wherein each sequence represents a particular chorded input. ## Claims ### Claim 1 A method of conveying a first and a second chorded input, the first chorded input comprising a first set of multiple actions to be undertaken simultaneously and the second chorded input comprising a second set of multiple actions to be undertaken simultaneously, the method comprising: generating, by a processor in electrical communication with a plurality of actuators and an output device, a first stimulation sequence, the first stimulation sequence comprising instructions for sequentially activating, with a predetermined temporal offset between sequential activations, a first plurality of the plurality of actuators in a first sequential order, the predetermined temporal offset being selected by the processor; according to the instructions of the first stimulation sequence, generating, by the processor, a first plurality of stimulation sequence signals configured to cause a first plurality of activations in which each of the first plurality of the plurality of actuators is activated in the first sequential order, wherein each of the first plurality of activations is a discrete stimulation event representing an action of the first set of multiple actions, the first plurality of activations conveying the first chorded input by sequentially representing each action of the first set of multiple actions to be undertaken simultaneously; responsive to the first plurality of the plurality of actuators activating in the first sequential order, generating, by the processor, an output signal to cause a perceptible indication by the output device; generating, by the processor, a second stimulation sequence, the second stimulation sequence comprising instructions for activating a second plurality of the plurality of actuators in a second sequential order; and according to the instructions of the second stimulation sequence, generating, by the processor, a second plurality of stimulation sequence signals configured to cause a second plurality of activations in which each of a second plurality of the plurality of actuators is activated in the second sequential order, wherein each of the second plurality of activations is a discrete stimulation event representing an action of the second set of multiple actions, the second plurality of activations conveying the second chorded input by sequentially representing each action of the second set of multiple actions to be undertaken simultaneously. ### Claim 2 (depends on 1) The method of claim 1, wherein a first activation and a second activation of the first plurality of activations are separated by a first predetermined offset such that the first activation begins at a first time and the second activation begins at a second time that is equal to the first time plus a duration of time equal to the first predetermined offset. ### Claim 3 (depends on 1) The method of claim 1, wherein a first activation and a second activation of the second plurality of activations are separated by a second predetermined offset such that the first activation begins at a first time and the second activation begins at a second time that is equal to the first time plus a duration of time equal to the second predetermined offset. ### Claim 4 (depends on 1) The method of claim 1, wherein the first and/or the second chorded input is conveyed via passive haptic learning such that each stimulation event comprises a haptic event to be experienced by a user. ### Claim 5 (depends on 1) The method of claim 1, wherein each stimulation event is a vibrational stimulation, an audio stimulation, a tactile stimulation, or a combination thereof. ### Claim 6 (depends on 1) The method of claim 1, wherein execution of the second stimulation sequence begins from 100 milliseconds to 1 second after the first plurality of activations ends. ### Claim 7 (depends on 1) The method of claim 1, wherein the first and/or the second chorded input represents a word, a letter, a syllable, a code, a number, a symbol, a musical note, a musical chord, or a combination thereof. ### Claim 8 (depends on 1) The method of claim 1, wherein each of the plurality of actuators is positioned on or within a wearable device configured to stimulate a portion of a device-wearer's body. ### Claim 9 (depends on 8) The method of claim 8, wherein the wearable device comprises a glove, wherein the portion of the device-wearer's body comprises a left hand or a right hand, and wherein each of the actuators is configured to stimulate via vibrating a portion of the left hand or the right hand. ### Claim 10 (depends on 1) The method of claim 1 further comprising: before executing the first stimulation sequence, generating, by a processor, a signal to cause a parsing device to generate a parsing indication to a user. ### Claim 11 (depends on 10) The method of claim 10, wherein the parsing indication represents a letter of the alphabet. ### Claim 12 (depends on 10) The method of claim 10, wherein the parsing indication comprises a visual cue, an audible sound, a pause, a vibration, or a combination thereof. ### Claim 13 (depends on 12) The method of claim 12, wherein the parsing indication comprises a visual cue, and wherein the device comprises a screen of a wearable headset configured for display of the visual cue. ### Claim 14 (depends on 2) The method of claim 2, wherein the first predetermined time offset is from 5 milliseconds to 50 milliseconds. ### Claim 15 (depends on 1) The method of claim 1, wherein each of the plurality of actuators comprise a vibration motor, a speaker, a bone-conduction device, or a combination thereof. ### Claim 16 (depends on 1) The method of claim 1, wherein the perceptible indication comprises a visual cue, an audible sound, a pause, a vibration, or a combination thereof. ### Claim 17 (depends on 16) The method of claim 16, wherein the perceptible indication comprises an audible sound, and wherein the output device comprises an audio output device configured to generate the audible sound. ### Claim 18 A non-transitory computer-readable medium that stores instructions that, when executed by at least one processor, causes the at least one processor to perform a method of conveying a first and a second chorded input, the first chorded input comprising a first set of multiple actions to be undertaken simultaneously and the second chorded input comprising a second set of multiple actions to be undertaken simultaneously, the method comprising: generating, by a processor in electrical communication with a plurality of actuators and an output device, a first stimulation sequence, the first stimulation sequence comprising instructions for sequentially activating, with a predetermined temporal offset between sequential activations, a first plurality of the plurality of actuators in a first sequential order, the predetermined temporal offset being selected by the processor; according to the instructions of the first stimulation sequence, generating, by the processor, a first plurality of stimulation sequence signals configured to cause a first plurality of activations in which each of the first plurality of the plurality of actuators is activated in the first sequential order, wherein each of the first plurality of activations is a discrete stimulation event representing an action of the first set of multiple actions, the first plurality of activations conveying a first chorded input by sequentially representing each action of the first set of multiple actions to be undertaken simultaneously; responsive to the plurality of actuators activating in the first sequential order, generating, by the processor, an output signal to cause a perceptible indication by the output device; generating, by the processor, a second stimulation sequence, the second stimulation sequence comprising instructions for activating a second plurality of the plurality of actuators in a second sequential order; and according to the instructions of the second stimulation sequence, generating, by the processor, a second plurality of stimulation sequence signals configured to cause a second plurality of activations in which each of a second plurality of the plurality of actuators is activated in the second sequential order, wherein each of the second plurality of activations is a discrete stimulation event representing an action of the second set of multiple actions, the second plurality of activations conveying the second chorded input by sequentially representing each action of the second set of multiple actions to be undertaken simultaneously. ### Claim 19 A system for conveying a first and a second chorded input, the first chorded input comprising a first set of multiple actions to be undertaken simultaneously and the second chorded input comprising a second set of multiple actions to be undertaken simultaneously, the system comprising: at least one memory operatively coupled to at least one processor and configured for storing data and instructions that, when executed by the at least one processor, cause the system to: generate, by a processor in electrical communication with a plurality of actuators and an output device, a first stimulation sequence, the first stimulation sequence comprising instructions for sequentially activating, with a predetermined temporal offset between sequential activations, a first plurality of the plurality of actuators in a first sequential order, the predetermined temporal offset being selected by the processor; according to the instructions of the first stimulation sequence, generate, by the processor, a first plurality of stimulation sequence signals configured to cause a first plurality of activations in which each of the first plurality of the plurality of actuators is activated in the first sequential order, wherein each of the first plurality of activations is a discrete stimulation event representing an action of the first set of multiple actions, the first plurality of activations conveying the first chorded input by sequentially representing each action of the first set of multiple actions to be undertaken simultaneously; responsive to the plurality of actuators activating in the first sequential order, generate, by the processor, an output signal to cause a perceptible indication by the output device; generate, by the processor, a second stimulation sequence, the second stimulation sequence comprising instructions for activating a second plurality of the plurality of actuators in a second sequential order; and according to the instructions of the second stimulation sequence, generate, by the processor, a second plurality of stimulation sequence signals configured to cause a second plurality of activations in which each of a second plurality of the plurality of actuators is activated in the second sequential order, wherein each of the second plurality of activations is a discrete stimulation event representing an action of the second set of multiple actions, the second plurality of activations conveying the second chorded input by sequentially representing each action of the second set of multiple actions to be undertaken simultaneously.